2024-03-07T10:05:51.443 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-07T10:05:51.443 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} --name leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102 --verbose -- /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/orig.config.yaml 2024-03-07T10:05:51.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T10:05:51.581 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102 branch: wip-lusov-qdb description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} email: null first_in_suite: false job_id: '7584102' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-qdb ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - Replacing daemon mds sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-qdb sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 owner: scheduled_leonidus@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 9221 sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-qdb suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcuvnD9W9UEaovtugF5xdq6S//5bnBDPN4f4bV9+zKUMAwXxbuDt7k29czyZhbstjH4xgvLaqj/TXW42flZXHc= smithi196.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb6taPdbTC/BenGE1njNfdBR7s+nctwr0j2vFop1258j4Q543NzF1i+ButPWS8pLoDjH0WMPKvK7cRiSAtwnFI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - mds_thrash: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-07_05:46:12 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-07T10:05:51.581 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa; will attempt to use it 2024-03-07T10:05:51.582 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks 2024-03-07T10:05:51.582 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-07T10:05:51.584 INFO:teuthology.task.internal:Checking packages... 2024-03-07T10:05:51.607 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8b896a9e145796119f0451201dc4d53ddac97db0' 2024-03-07T10:05:51.607 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-07T10:05:51.607 INFO:teuthology.packaging:ref: None 2024-03-07T10:05:51.607 INFO:teuthology.packaging:tag: None 2024-03-07T10:05:51.607 INFO:teuthology.packaging:branch: wip-lusov-qdb 2024-03-07T10:05:51.607 INFO:teuthology.packaging:sha1: 8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:05:51.607 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-qdb 2024-03-07T10:05:51.756 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1848.g8b896a9e 2024-03-07T10:05:51.758 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-07T10:05:51.764 INFO:teuthology.task.internal:no buildpackages task found 2024-03-07T10:05:51.764 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-07T10:05:51.786 INFO:teuthology.task.internal:Saving configuration 2024-03-07T10:05:51.805 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-07T10:05:51.813 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T10:05:51.839 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 10:00:57.384006', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcuvnD9W9UEaovtugF5xdq6S//5bnBDPN4f4bV9+zKUMAwXxbuDt7k29czyZhbstjH4xgvLaqj/TXW42flZXHc='} 2024-03-07T10:05:51.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 10:00:57.382524', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb6taPdbTC/BenGE1njNfdBR7s+nctwr0j2vFop1258j4Q543NzF1i+ButPWS8pLoDjH0WMPKvK7cRiSAtwnFI='} 2024-03-07T10:05:51.863 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-07T10:05:51.870 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-03-07T10:05:51.870 INFO:teuthology.task.internal:roles: ubuntu@smithi196.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-03-07T10:05:51.870 INFO:teuthology.run_tasks:Running task console_log... 2024-03-07T10:05:51.959 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa618f80ee0>, signals=[15]) 2024-03-07T10:05:51.960 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-07T10:05:51.966 INFO:teuthology.task.internal:Opening connections... 2024-03-07T10:05:51.967 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:05:51.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:05:52.099 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:05:52.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:05:52.187 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-07T10:05:52.193 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-03-07T10:05:52.212 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-03-07T10:05:52.212 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-03-07T10:05:52.268 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T10:05:52.269 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T10:05:52.270 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-03-07T10:05:52.294 DEBUG:teuthology.orchestra.run.smithi196:> uname -m 2024-03-07T10:05:52.311 INFO:teuthology.orchestra.run.smithi196.stdout:x86_64 2024-03-07T10:05:52.312 DEBUG:teuthology.orchestra.run.smithi196:> cat /etc/os-release 2024-03-07T10:05:52.368 INFO:teuthology.orchestra.run.smithi196.stdout:NAME="CentOS Stream" 2024-03-07T10:05:52.368 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION="9" 2024-03-07T10:05:52.368 INFO:teuthology.orchestra.run.smithi196.stdout:ID="centos" 2024-03-07T10:05:52.368 INFO:teuthology.orchestra.run.smithi196.stdout:ID_LIKE="rhel fedora" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:VERSION_ID="9" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:PLATFORM_ID="platform:el9" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:ANSI_COLOR="0;31" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:LOGO="fedora-logo-icon" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:HOME_URL="https://centos.org/" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-07T10:05:52.369 INFO:teuthology.orchestra.run.smithi196.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-07T10:05:52.369 INFO:teuthology.lock.ops:Updating smithi196.front.sepia.ceph.com on lock server 2024-03-07T10:05:52.394 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-07T10:05:52.403 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-07T10:05:52.443 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-07T10:05:52.444 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-03-07T10:05:52.446 DEBUG:teuthology.orchestra.run.smithi196:> test '!' -e /home/ubuntu/cephtest 2024-03-07T10:05:52.462 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-07T10:05:52.472 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-07T10:05:52.472 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-03-07T10:05:52.502 DEBUG:teuthology.orchestra.run.smithi196:> test -z $(ls -A /var/lib/ceph) 2024-03-07T10:05:52.564 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-07T10:05:52.618 INFO:teuthology.run_tasks:Running task kernel... 2024-03-07T10:05:52.633 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-07T10:05:52.634 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-03-07T10:05:52.634 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-07T10:05:52.634 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-07T10:05:52.634 DEBUG:teuthology.orchestra.run.smithi196:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-07T10:05:52.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:05:52.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-07T10:05:52.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:05:52.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-07T10:05:52.904 DEBUG:teuthology.task.kernel:sha1 for client.1 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:05:52.904 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-07T10:05:52.905 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-07T10:05:52.906 DEBUG:teuthology.task.kernel:sha1 for client.0 is dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:05:52.906 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412"... 2024-03-07T10:05:52.906 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-03-07T10:05:52.923 INFO:teuthology.orchestra.run.smithi196.stdout:5.14.0-361.el9.x86_64 2024-03-07T10:05:52.924 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:05:52.924 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-07T10:05:52.924 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum upgrade -y linux-firmware 2024-03-07T10:05:52.926 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-361.el9.x86_64 2024-03-07T10:05:52.926 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:05:52.926 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-07T10:05:52.926 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum upgrade -y linux-firmware 2024-03-07T10:05:55.151 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-03-07T10:05:55.513 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 8.1 MB/s | 8.1 MB 00:01 2024-03-07T10:05:56.910 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-9 - BaseOS 5.6 MB/s | 2.5 MB 00:00 2024-03-07T10:05:57.213 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.5 MB 00:00 2024-03-07T10:05:58.201 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.0 MB 00:00 2024-03-07T10:06:00.518 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-03-07T10:06:04.660 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.1 MB 00:00 2024-03-07T10:06:06.410 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2024-03-07T10:06:07.094 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 871 kB/s | 8.0 MB 00:09 2024-03-07T10:06:07.854 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-03-07T10:06:12.845 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 11 kB/s | 1.7 kB 00:00 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr:Modular dependency problems: 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 1: conflicting requests 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240227110532:20125149.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 2: conflicting requests 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 3: conflicting requests 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 4: conflicting requests 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.042 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 5: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 6: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 7: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240222150954:49cc9d1b.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 8: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 9: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 10: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 11: conflicting requests 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.043 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 12: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 13: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 14: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 15: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 16: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 17: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 18: conflicting requests 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.044 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 19: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 20: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 21: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 22: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 23: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 24: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 25: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 26: conflicting requests 2024-03-07T10:06:15.045 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 27: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 28: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 29: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 30: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 31: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 32: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 33: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 34: conflicting requests 2024-03-07T10:06:15.046 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 35: conflicting requests 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 36: conflicting requests 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 37: conflicting requests 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 38: cannot install the best candidate for the job 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 39: conflicting requests 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.047 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 40: cannot install the best candidate for the job 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 41: cannot install the best candidate for the job 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 42: cannot install the best candidate for the job 2024-03-07T10:06:15.048 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 43: cannot install the best candidate for the job 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 44: cannot install the best candidate for the job 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 45: cannot install the best candidate for the job 2024-03-07T10:06:15.049 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.050 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.050 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.050 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-03-07T10:06:15.605 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-03-07T10:06:15.615 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-03-07T10:06:15.615 INFO:teuthology.orchestra.run.smithi196.stdout: Package Architecture Version Repository Size 2024-03-07T10:06:15.615 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:================================================================================ 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 1 Package 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 376 M 2024-03-07T10:06:15.616 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-03-07T10:06:30.575 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 869 kB/s | 19 MB 00:22 2024-03-07T10:06:36.901 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.1 MB 00:02 2024-03-07T10:06:38.402 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 15 kB 00:00 2024-03-07T10:06:39.586 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-03-07T10:06:44.510 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-07T10:06:46.756 INFO:teuthology.orchestra.run.smithi194.stderr:Modular dependency problems: 2024-03-07T10:06:46.756 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-03-07T10:06:46.756 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 1: conflicting requests 2024-03-07T10:06:46.756 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240227110532:20125149.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.756 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 2: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 3: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 4: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 5: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 6: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 7: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240222150954:49cc9d1b.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 8: conflicting requests 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.757 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 9: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 10: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 11: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 12: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 13: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 14: conflicting requests 2024-03-07T10:06:46.758 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 15: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 16: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 17: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 18: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 19: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 20: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 21: conflicting requests 2024-03-07T10:06:46.759 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 22: conflicting requests 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 23: conflicting requests 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 24: conflicting requests 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 25: conflicting requests 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 26: conflicting requests 2024-03-07T10:06:46.760 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 27: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 28: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 29: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 30: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 31: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 32: conflicting requests 2024-03-07T10:06:46.761 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 33: conflicting requests 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 34: conflicting requests 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 35: conflicting requests 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 36: conflicting requests 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 37: conflicting requests 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 38: cannot install the best candidate for the job 2024-03-07T10:06:46.762 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 39: conflicting requests 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 40: cannot install the best candidate for the job 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.763 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 41: cannot install the best candidate for the job 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 42: cannot install the best candidate for the job 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.764 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 43: cannot install the best candidate for the job 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 44: cannot install the best candidate for the job 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 45: cannot install the best candidate for the job 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.765 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-03-07T10:06:46.766 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-03-07T10:06:47.301 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-03-07T10:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-07T10:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: Package Architecture Version Repository Size 2024-03-07T10:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-07T10:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-03-07T10:06:47.313 INFO:teuthology.orchestra.run.smithi194.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:================================================================================ 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 1 Package 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 376 M 2024-03-07T10:06:47.314 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-03-07T10:06:55.961 INFO:teuthology.orchestra.run.smithi194.stdout:linux-firmware-20240219-143.el9.noarch.rpm 44 MB/s | 376 MB 00:08 2024-03-07T10:06:55.962 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-03-07T10:06:55.962 INFO:teuthology.orchestra.run.smithi194.stdout:Total 43 MB/s | 376 MB 00:08 2024-03-07T10:06:59.000 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-03-07T10:06:59.176 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-03-07T10:06:59.176 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-03-07T10:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-03-07T10:07:02.361 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-03-07T10:07:09.410 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-03-07T10:07:09.778 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-07T10:07:09.863 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:07:11.093 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:07:11.094 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-07T10:07:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:07:11.503 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:07:11.504 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-03-07T10:07:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-07T10:07:11.504 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:07:11.504 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-03-07T10:07:11.832 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-07T10:07:11.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:07:11.983 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-07T10:07:11.983 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-07T10:07:11.986 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-03-07T10:07:23.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07 10:07:23 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-07T10:07:23.407 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2024-03-07 10:07:23-- 2024-03-07T10:07:23.407 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 11s 2024-03-07T10:07:23.407 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 321M in 11s (28.8 MB/s) 2024-03-07T10:07:23.410 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.0... 2024-03-07T10:07:23.410 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-07T10:07:25.340 INFO:teuthology.orchestra.run.smithi194.stdout:Verifying... ######################################## 2024-03-07T10:07:25.473 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing... ######################################## 2024-03-07T10:07:25.552 INFO:teuthology.orchestra.run.smithi194.stdout:Updating / installing... 2024-03-07T10:07:33.127 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-07T10:07:47.598 INFO:teuthology.orchestra.run.smithi196.stdout:linux-firmware-20240219-143.el9.noarch.rpm 4.1 MB/s | 376 MB 01:31 2024-03-07T10:07:47.598 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-03-07T10:07:47.599 INFO:teuthology.orchestra.run.smithi196.stdout:Total 4.1 MB/s | 376 MB 01:31 2024-03-07T10:07:48.561 INFO:teuthology.orchestra.run.smithi194.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-07T10:07:50.641 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-03-07T10:07:50.958 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-03-07T10:07:50.958 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-03-07T10:07:54.170 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-03-07T10:07:54.170 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-03-07T10:08:01.460 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-03-07T10:08:01.904 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-07T10:08:01.999 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:08:02.903 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:08:02.903 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:08:03.305 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-03-07T10:08:03.601 INFO:teuthology.task.kernel:Downloading kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-07T10:08:03.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 2024-03-07T10:08:03.836 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ 2024-03-07T10:08:03.837 DEBUG:teuthology.orchestra.run.smithi196:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-07T10:08:03.839 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi196.front.sepia.ceph.com to complete... 2024-03-07T10:08:10.846 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-07T10:08:10.846 DEBUG:teuthology.orchestra.run.smithi194:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-07T10:08:10.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:10.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-07T10:08:10.911 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-07T10:08:10.912 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-07T10:08:10.913 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-07T10:08:10.914 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-07T10:08:10.915 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-07T10:08:10.916 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-07T10:08:10.917 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-07T10:08:10.918 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-07T10:08:10.919 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-07T10:08:10.920 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-07T10:08:10.921 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-07T10:08:10.922 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-07T10:08:10.923 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-07T10:08:10.924 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-07T10:08:10.925 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-07T10:08:10.926 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-07T10:08:10.927 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-07T10:08:10.928 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-07T10:08:10.929 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-07T10:08:10.930 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-07T10:08:10.931 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-07T10:08:10.932 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-07T10:08:10.933 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-07T10:08:10.934 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-07T10:08:10.935 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-07T10:08:10.936 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-07T10:08:10.937 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-07T10:08:10.938 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-07T10:08:10.939 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-07T10:08:10.940 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-07T10:08:10.941 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-07T10:08:10.942 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-07T10:08:10.943 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-07T10:08:10.944 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-07T10:08:10.945 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-07T10:08:10.946 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-07T10:08:10.947 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-07T10:08:10.948 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-07T10:08:10.949 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-07T10:08:10.950 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-07T10:08:10.951 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-07T10:08:10.952 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-07T10:08:10.953 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-07T10:08:10.954 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-07T10:08:10.955 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-07T10:08:10.956 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-07T10:08:10.957 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-07T10:08:10.958 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-07T10:08:10.959 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-07T10:08:10.960 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-07T10:08:10.961 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-07T10:08:10.962 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-07T10:08:10.963 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-07T10:08:10.964 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-07T10:08:10.965 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-07T10:08:10.966 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-07T10:08:10.967 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-07T10:08:10.968 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-07T10:08:10.969 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-07T10:08:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-07T10:08:10.971 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-07T10:08:10.972 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-07T10:08:10.973 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-07T10:08:10.974 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-07T10:08:10.975 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-07T10:08:10.976 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-07T10:08:10.977 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-07T10:08:10.978 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-07T10:08:10.979 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-07T10:08:10.980 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-07T10:08:10.981 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-07T10:08:10.982 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-07T10:08:10.983 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-07T10:08:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-07T10:08:10.985 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-07T10:08:10.986 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-07T10:08:10.987 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-07T10:08:10.988 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-07T10:08:10.989 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-07T10:08:10.990 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-07T10:08:10.991 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-07T10:08:10.992 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-07T10:08:10.993 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-07T10:08:10.994 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-07T10:08:10.995 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-07T10:08:10.996 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-07T10:08:10.997 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-07T10:08:10.998 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-07T10:08:10.999 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-07T10:08:11.000 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-07T10:08:11.001 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-07T10:08:11.002 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-07T10:08:11.003 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-07T10:08:11.004 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-07T10:08:11.005 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-07T10:08:11.006 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-07T10:08:11.007 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-07T10:08:11.008 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-07T10:08:11.009 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-07T10:08:11.010 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-07T10:08:11.011 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-07T10:08:11.012 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-07T10:08:11.013 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-07T10:08:11.014 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-07T10:08:11.015 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-07T10:08:11.016 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-07T10:08:11.017 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-07T10:08:11.018 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-07T10:08:11.019 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-07T10:08:11.020 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-07T10:08:11.021 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-07T10:08:11.022 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-07T10:08:11.023 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-07T10:08:11.024 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-07T10:08:11.025 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-07T10:08:11.026 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-07T10:08:11.027 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-07T10:08:11.028 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-07T10:08:11.029 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-07T10:08:11.030 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-07T10:08:11.031 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-07T10:08:11.032 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-07T10:08:11.033 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-07T10:08:11.034 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-07T10:08:11.035 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-07T10:08:11.036 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-07T10:08:11.037 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-07T10:08:11.038 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-07T10:08:11.039 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-07T10:08:11.040 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-07T10:08:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-07T10:08:11.042 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-07T10:08:11.043 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-07T10:08:11.047 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:11.047 DEBUG:teuthology.orchestra.run.smithi194:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:postinstall scriptlet (using /bin/sh): 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:for file in vmlinuz System.map config; do 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout: fi 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-03-07T10:08:11.069 INFO:teuthology.orchestra.run.smithi194.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:11.070 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-03-07T10:08:11.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-03-07T10:08:11.144 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-03-07T10:08:11.144 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 68.el9 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8264254 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-03-07T10:08:11.145 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:08:11.146 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-03-07T10:08:11.147 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-07T10:08:11.147 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:11.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-07T10:08:11.810 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-03-07T10:08:13.159 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-07T10:08:13.197 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-03-07T10:08:13.199 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-03-07T10:08:13.214 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.o6GFCnOzJQ 2024-03-07T10:08:13.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.o6GFCnOzJQ 2024-03-07T10:08:13.287 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.o6GFCnOzJQ 2024-03-07T10:08:13.427 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.o6GFCnOzJQ is 6KB 2024-03-07T10:08:13.476 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.o6GFCnOzJQ 2024-03-07T10:08:13.491 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-03-07T10:08:13.556 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-07T10:08:13.556 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-07T10:08:13.556 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-07T10:08:13.556 INFO:teuthology.orchestra.run.smithi194.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-07T10:08:13.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:08:13.700 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-03-07T10:08:16.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07 10:08:16 URL:https://2.chacra.ceph.com/r/kernel/testing/dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gdd5c1cd17167-1.x86_64.rpm [336216379/336216379] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-07T10:08:16.525 INFO:teuthology.orchestra.run.smithi196.stderr:FINISHED --2024-03-07 10:08:16-- 2024-03-07T10:08:16.525 INFO:teuthology.orchestra.run.smithi196.stderr:Total wall clock time: 13s 2024-03-07T10:08:16.525 INFO:teuthology.orchestra.run.smithi196.stderr:Downloaded: 1 files, 321M in 12s (25.9 MB/s) 2024-03-07T10:08:16.529 INFO:teuthology.task.kernel:Installing kernel dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 on client.1... 2024-03-07T10:08:16.529 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-07T10:08:18.468 INFO:teuthology.orchestra.run.smithi196.stdout:Verifying... ######################################## 2024-03-07T10:08:18.523 INFO:teuthology.orchestra.run.smithi196.stdout:Preparing... ######################################## 2024-03-07T10:08:18.604 INFO:teuthology.orchestra.run.smithi196.stdout:Updating / installing... 2024-03-07T10:08:26.146 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-6.8.0_rc7_gdd5c1cd17167-1 ######################################## 2024-03-07T10:08:42.236 INFO:teuthology.orchestra.run.smithi196.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-07T10:08:43.703 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-07T10:08:43.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-07T10:08:43.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:09:04.599 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi196.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-07T10:09:04.600 DEBUG:teuthology.orchestra.run.smithi196:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/System.map 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/config 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-07T10:09:04.673 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-07T10:09:04.674 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/arch/x86/kvm/kvm.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ansi_cprng.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/anubis.ko 2024-03-07T10:09:04.675 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/arc4.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_memcpy.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_pq.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_tx.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/async_xor.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/async_tx/raid6test.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authenc.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/authencesn.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blake2b_generic.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_common.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/blowfish_generic.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/camellia_generic.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast5_generic.ko 2024-03-07T10:09:04.676 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast6_generic.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cast_common.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/ccm.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cmac.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crc32_generic.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_engine.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/crypto_user.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/cts.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/des_generic.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/dh_generic.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/echainiv.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/essiv.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/fcrypt.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/khazad.ko 2024-03-07T10:09:04.677 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/lz4hc.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/md4.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/michael_mic.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcbc.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/pcrypt.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/rmd160.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/seed.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/serpent_generic.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tcrypt.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/tea.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_common.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/twofish_generic.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/vmac.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/wp512.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xcbc.ko 2024-03-07T10:09:04.678 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xor.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/crypto/xxhash_generic.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/acpi_pad.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/custom_method.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/ec_sys.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/platform_profile.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbs.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/sbshc.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/acpi/video.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/acard-ahci.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ahci_platform.ko 2024-03-07T10:09:04.679 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/ata_generic.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/libahci_platform.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_acpi.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ali.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_amd.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_artop.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atiixp.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_atp867x.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd640.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cmd64x.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_cypress.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_efar.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt366.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt37x.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-07T10:09:04.680 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it8213.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_it821x.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_jmicron.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_marvell.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_mpiix.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_netcell.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ninja32.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87410.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_ns87415.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_oldpiix.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_opti.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_optidma.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pcmcia.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-07T10:09:04.681 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_piccolo.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_rdc.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sch.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_serverworks.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sil680.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sis.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_sl82c105.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_triflex.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pata_via.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/pdc_adma.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_inic162x.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_mv.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_nv.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_promise.ko 2024-03-07T10:09:04.682 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_qstor.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sil24.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sis.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_svw.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_sx4.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_uli.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_via.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ata/sata_vsc.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/auxdisplay/ks0108.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-07T10:09:04.683 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/bcma/bcma.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/aoe/aoe.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/brd.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/drbd/drbd.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/floppy.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/loop.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/nbd.ko 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk 2024-03-07T10:09:04.684 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/null_blk/null_blk.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/pktcdvd.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/rbd.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/virtio_blk.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/xen-blkfront.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/block/zram/zram.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hangcheck-timer.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-07T10:09:04.685 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/via-rng.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/lp.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/mwave/mwave.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/ppdev.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tlclk.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-07T10:09:04.686 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/uv_mmtimer.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/char/virtio_console.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp 2024-03-07T10:09:04.687 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/ccp/ccp.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-aes.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/padlock-sha.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dca/dca.ko 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq 2024-03-07T10:09:04.688 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/amd64_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/e752x_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/edac_mce_amd.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3000_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i3200_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5100_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i5400_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7300_edac.ko 2024-03-07T10:09:04.689 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i7core_edac.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/i82975x_edac.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/ie31200_edac.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/sb_edac.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/edac/x38_edac.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/edd.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-ich.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-appleir.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-aureal.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-axff.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-dr.ko 2024-03-07T10:09:04.690 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elecom.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-elo.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-emsff.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gaff.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gt683r.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-gyration.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-holtekff.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-hyperv.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-icade.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-keytouch.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-kye.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lcpower.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-led.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-lenovo.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-07T10:09:04.691 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-multitouch.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-ortek.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-penmount.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-petalynx.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-picolcd.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-pl.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-plantronics.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-primax.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-rmi.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-common.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-07T10:09:04.692 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-roccat.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-saitek.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-samsung.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sjoy.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sony.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-speedlink.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-steelseries.ko 2024-03-07T10:09:04.693 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-sunplus.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tivo.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-tmff.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-topseed.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-twinhan.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-uclogic.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-waltop.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-wiimote.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-xinmo.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zpff.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/hid-zydacron.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/uhid.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hid/wacom.ko 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv 2024-03-07T10:09:04.694 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_balloon.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_utils.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hv/hv_vmbus.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/abituguru3.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7414.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ad7418.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adc128d818.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1025.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1026.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1029.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm1031.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adm9240.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ads7828.ko 2024-03-07T10:09:04.695 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7410.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7411.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7462.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7470.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7475.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/adt7x10.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/amc6821.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/applesmc.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asb100.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asc7621.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/atxp1.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/coretemp.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-07T10:09:04.696 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/dme1737.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds1621.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ds620.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc1403.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/emc6w201.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71805f.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f71882fg.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/f75375s.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fam15h_power.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/fschmd.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g760a.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/g762.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl518sm.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/gl520sm.ko 2024-03-07T10:09:04.697 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5500_temp.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/i5k_amb.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmaem.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ibmpex.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina209.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ina2xx.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/it87.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k10temp.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/k8temp.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lineage-pem.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm63.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm73.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm75.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm77.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm78.ko 2024-03-07T10:09:04.698 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm80.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm83.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm85.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm87.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm90.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm92.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm93.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95234.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95241.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/lm95245.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc2945.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4151.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4215.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4222.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4245.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4260.ko 2024-03-07T10:09:04.699 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/ltc4261.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max16065.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1619.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max1668.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max197.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6639.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6650.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/max6697.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/mcp3021.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6683.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775-core.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct6775.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/nct7802.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87360.ko 2024-03-07T10:09:04.700 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pc87427.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pcf8591.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/powr1220.ko 2024-03-07T10:09:04.701 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5627.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch5636.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht15.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sht21.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/shtc1.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/sis5595.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47b397.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m1.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/smsc47m192.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/thmc50.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp102.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp103.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp401.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/tmp421.ko 2024-03-07T10:09:04.702 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via-cputemp.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/via686a.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt1211.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/vt8231.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627ehf.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83627hf.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83781d.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83791d.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83792d.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83793.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83795.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l785ts.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/hwmon/w83l786ng.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-07T10:09:04.703 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-07T10:09:04.704 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-dev.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-mux.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-smbus.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/i2c/i2c-stub.ko 2024-03-07T10:09:04.705 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_core.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5 2024-03-07T10:09:04.706 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport 2024-03-07T10:09:04.707 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/gameport/gameport.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/joydev.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/appletouch.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/bcm5974.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/cyapatp.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/sermouse.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-07T10:09:04.708 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/altera_ps2.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/arc_ps2.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/serio/serio_raw.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/input/sparse-keymap.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-blinkm.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lm3530.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-lp3944.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/leds-ss4200.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-07T10:09:04.709 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/bcache/bcache.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-bio-prison.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache-smq.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-cache.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-crypt.ko 2024-03-07T10:09:04.710 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-delay.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-flakey.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-log-userspace.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-multipath.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-queue-length.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-raid.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-round-robin.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-service-time.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-switch.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-thin-pool.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/dm-verity.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid0.ko 2024-03-07T10:09:04.711 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid1.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid10.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/md/raid456.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptbase.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptctl.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptfc.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptlan.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptsas.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptscsih.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/message/fusion/mptspi.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_ich.ko 2024-03-07T10:09:04.712 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/lpc_sch.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/mfd-core.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/sm501.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/viperboard.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/vx855.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/mfd/wl1273-core.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds9802als.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/apds990x.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/bh1770glc.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/cb710/cb710.ko 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom 2024-03-07T10:09:04.713 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/at24.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/eeprom/max6875.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/enclosure.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/hpilo.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29003.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/isl29020.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-me.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei-txe.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/mei/mei.ko 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru 2024-03-07T10:09:04.714 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_7xx1.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tifm_core.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/tsl2550.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_balloon.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/bonding/bonding.ko 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa 2024-03-07T10:09:04.715 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/dummy.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/eql.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-07T10:09:04.716 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-07T10:09:04.717 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-07T10:09:04.718 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-07T10:09:04.719 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-07T10:09:04.720 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/dnet.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ethoc.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/fealnx.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000 2024-03-07T10:09:04.721 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-07T10:09:04.722 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/jme.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel 2024-03-07T10:09:04.723 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-07T10:09:04.724 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-07T10:09:04.725 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-07T10:09:04.726 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet 2024-03-07T10:09:04.727 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/geneve.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ifb.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvlan.ko 2024-03-07T10:09:04.728 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/macvtap.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/mii.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/net_failover.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/netconsole.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/nlmon.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/amd.ko 2024-03-07T10:09:04.729 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/bcm87xx.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/broadcom.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/cicada.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/davicom.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/dp83640.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/et1011c.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/icplus.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/lxt.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/marvell.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/micrel.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/national.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/phylink.ko 2024-03-07T10:09:04.730 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/qsemi.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/realtek.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/smsc.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/ste10Xp.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/phy/vitesse.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_async.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppoe.ko 2024-03-07T10:09:04.731 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pppox.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/ppp/pptp.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slhc.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/slip/slip.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/sungem_phy.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tap.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_random.ko 2024-03-07T10:09:04.732 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/tun.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/veth.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/virtio_net.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/vxlan/vxlan.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/net/xen-netfront.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ntb/ntb.ko 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host 2024-03-07T10:09:04.733 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme-core.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/nvme/host/nvme.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_cs.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_pc.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/parport/parport_serial.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pci/xen-pcifront.ko 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia 2024-03-07T10:09:04.734 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/i82092.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/pd6729.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/acerhdf.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-07T10:09:04.735 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/hdaps.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/intel_ips.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-07T10:09:04.736 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/platform/x86/wmi.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/clients/pps_parport.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/pps/pps_core.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp.ko 2024-03-07T10:09:04.737 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ptp/ptp_kvm.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-em3027.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-07T10:09:04.738 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-max6900.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-07T10:09:04.739 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/rtc/rtc-x1205.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-9xxx.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-sas.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/3w-xxxx.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/BusLogic.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/a100u2w.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/advansys.ko 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx 2024-03-07T10:09:04.740 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/am53c974.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/atp870u.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bfa/bfa.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ch.ko 2024-03-07T10:09:04.741 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dc395x.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/dmx3191d.ko 2024-03-07T10:09:04.742 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/esp_scsi.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/fnic/fnic.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hpsa.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hptiop.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/hv_storvsc.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/initio.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ipr.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ips.ko 2024-03-07T10:09:04.743 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/isci/isci.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libfc/libfc.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/libsas/libsas.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid.ko 2024-03-07T10:09:04.744 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/mvumi.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/pmcraid.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla1280.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-07T10:09:04.745 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/raid_class.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_debug.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/ses.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/st.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/stex.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/virtio_scsi.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-07T10:09:04.746 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/scsi/wd719x.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ssb/ssb.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_file.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_iblock.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_mod.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_pscsi.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/target_core_user.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal 2024-03-07T10:09:04.747 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-07T10:09:04.748 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_gsm.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/n_hdlc.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/nozomi.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-07T10:09:04.749 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/arc_uart.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_aec.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_cif.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_pci_generic.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/uio/uio_sercos3.ko 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb 2024-03-07T10:09:04.750 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-acm.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usblp.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/class/usbtmc.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/mdc800.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/image/microtek.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/adutux.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/appledisplay.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi26.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/emi62.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ezusb.ko 2024-03-07T10:09:04.751 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/idmouse.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/iowarrior.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/ldusb.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/legousbtower.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usb3503.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usblcd.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/uss720.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/misc/yurex.ko 2024-03-07T10:09:04.752 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/phy/phy-generic.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/aircable.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ark3116.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ch341.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cp210x.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cyberjack.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/empeg.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/io_ti.ko 2024-03-07T10:09:04.753 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipaq.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ipw.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ir-usb.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mct_u232.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7720.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/mos7840.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/navman.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/omninet.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/opticon.ko 2024-03-07T10:09:04.754 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/option.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/oti6858.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/pl2303.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcaux.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/qcserial.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/quatech2.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/safe_serial.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/sierra.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ssu100.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/symbolserial.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_debug.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-07T10:09:04.755 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/visor.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/whiteheat.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/uas.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-karma.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-07T10:09:04.756 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/storage/usb-storage.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio.ko 2024-03-07T10:09:04.757 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_net.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/vhost/vhost_scsi.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/apple_bl.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/lcd.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_balloon.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_mmio.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci.ko 2024-03-07T10:09:04.758 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/virtio/virtio_ring.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2482.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/masters/ds2490.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-07T10:09:04.759 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/w1/wire.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/hpwdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/i6300esb.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ib700wdt.ko 2024-03-07T10:09:04.760 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ibmasr.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/it87_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/machzwd.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/nv_tco.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/softdog.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/via_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-07T10:09:04.761 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/wdt_pci.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/watchdog/xen_wdt.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-evtchn.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntalloc.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-gntdev.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xen-privcmd.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/9p/9p.ko 2024-03-07T10:09:04.762 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/affs/affs.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/befs/befs.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/binfmt_misc.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/btrfs/btrfs.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cachefiles/cachefiles.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ceph/ceph.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/coda/coda.ko 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs 2024-03-07T10:09:04.763 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/cramfs/cramfs.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/dlm/dlm.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/f2fs/f2fs.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/fat.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/msdos.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fat/vfat.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/cuse.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/fuse/fuse.ko 2024-03-07T10:09:04.764 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/gfs2/gfs2.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfs/hfs.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/hfsplus/hfsplus.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/isofs/isofs.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/jfs/jfs.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/lockd/lockd.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/minix/minix.ko 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs 2024-03-07T10:09:04.765 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/netfs/netfs.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfs.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv3.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs/nfsv4.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/grace.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfs_common/nfs_acl.ko 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd 2024-03-07T10:09:04.766 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nfsd/nfsd.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nilfs2/nilfs2.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-celtic.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-centeuro.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-croatian.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-cyrillic.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-gaelic.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-greek.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-iceland.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-inuit.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-roman.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-romanian.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/mac-turkish.ko 2024-03-07T10:09:04.767 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1250.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1251.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp1255.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp737.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp775.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp850.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp852.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp855.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp857.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp860.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp861.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp862.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp863.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp864.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp865.ko 2024-03-07T10:09:04.768 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp866.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp869.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp874.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp932.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp936.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp949.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_cp950.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_euc-jp.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-1.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-13.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-14.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-15.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-2.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-3.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-4.ko 2024-03-07T10:09:04.769 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-5.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-6.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-7.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_iso8859-9.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-r.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-ru.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_koi8-u.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/nls/nls_utf8.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs 2024-03-07T10:09:04.770 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/overlayfs/overlay.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/pstore/ramoops.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/reiserfs/reiserfs.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/romfs/romfs.ko 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client 2024-03-07T10:09:04.771 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/client/cifs.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_arc4.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/smb/common/cifs_md4.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/squashfs/squashfs.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/sysv/sysv.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/udf/udf.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/ufs/ufs.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/fs/xfs/xfs.ko 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel 2024-03-07T10:09:04.772 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/rcu/rcutorture.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/torture.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/asn1_encoder.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc-itu-t.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crc8.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libarc4.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/crypto/libdes.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/libcrc32c.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lru_cache.ko 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4 2024-03-07T10:09:04.773 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4_compress.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/lz4/lz4hc_compress.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/math/cordic.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/raid6/raid6_pq.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_bm.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_fsm.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/ts_kmp.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/lib/zstd/zstd_compress.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/mm/hwpoison-inject.ko 2024-03-07T10:09:04.774 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/6lowpan.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_dest.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_fragment.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_hop.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_mobility.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_routing.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/6lowpan/nhc_udp.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/garp.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/mrp.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/p8022.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/psnap.ko 2024-03-07T10:09:04.775 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/802/stp.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/8021q/8021q.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_fd.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_rdma.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/9p/9pnet_virtio.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/batman-adv/batman-adv.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/br_netfilter.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/bridge.ko 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter 2024-03-07T10:09:04.776 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-07T10:09:04.777 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/ebtables.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ceph/libceph.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/failover.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/core/pktgen.ko 2024-03-07T10:09:04.778 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_diag.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv4.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dccp/dccp_ipv6.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dns_resolver/dns_resolver.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/dsa_core.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_brcm.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_dsa.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_none.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/dsa/tag_trailer.ko 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan 2024-03-07T10:09:04.779 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ah4.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/esp4.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/fou.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/gre.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/inet_diag.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_gre.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_tunnel.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ip_vti.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipcomp.ko 2024-03-07T10:09:04.780 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/ipip.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-07T10:09:04.781 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_bic.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_dctcp.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_diag.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_highspeed.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_htcp.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_hybla.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_illinois.ko 2024-03-07T10:09:04.782 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_lp.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_scalable.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_vegas.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_veno.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_westwood.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tcp_yeah.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/tunnel4.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_diag.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/udp_tunnel.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ah6.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/esp6.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/fou6.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_tunnel.ko 2024-03-07T10:09:04.783 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ip6_vti.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/ipcomp6.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-07T10:09:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-07T10:09:04.785 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/sit.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/tunnel6.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/key/af_key.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_core.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_eth.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ip6.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_netlink.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/l2tp/l2tp_ppp.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/llc/llc.ko 2024-03-07T10:09:04.786 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mac802154/mac802154.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/mpls/mpls_gso.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-07T10:09:04.787 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-07T10:09:04.788 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conncount.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-07T10:09:04.789 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_log_syslog.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-07T10:09:04.790 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_irc.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_sip.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nf_tables.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_log.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_chain_nat.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_compat.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_ct.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fib.ko 2024-03-07T10:09:04.791 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_hash.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_limit.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_log.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_masq.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_nat.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_numgen.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_queue.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_quota.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_redir.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_reject_inet.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_socket.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/nft_tunnel.ko 2024-03-07T10:09:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_AUDIT.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_CT.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_DSCP.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HL.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_HMARK.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LED.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_LOG.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NETMAP.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFLOG.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-07T10:09:04.793 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_RATEEST.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_SECMARK.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TEE.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TPROXY.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_TRACE.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_addrtype.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_bpf.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cgroup.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cluster.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_comment.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connbytes.ko 2024-03-07T10:09:04.794 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlabel.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connlimit.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_connmark.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_conntrack.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_cpu.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dccp.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_devgroup.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_dscp.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ecn.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_esp.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hashlimit.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_helper.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_hl.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipcomp.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_iprange.ko 2024-03-07T10:09:04.795 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_ipvs.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_l2tp.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_length.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_limit.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mac.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_mark.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_multiport.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nat.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_nfacct.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_osf.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_owner.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_physdev.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_pkttype.ko 2024-03-07T10:09:04.796 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_policy.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_quota.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_rateest.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_realm.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_recent.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_sctp.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_set.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_socket.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_state.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_statistic.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_string.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_tcpmss.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_time.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netfilter/xt_u32.ko 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink 2024-03-07T10:09:04.797 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/netlink/netlink_diag.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/nsh/nsh.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/openvswitch.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-geneve.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-gre.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/openvswitch/vport-vxlan.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/packet/af_packet_diag.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_rdma.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/rds/rds_tcp.ko 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched 2024-03-07T10:09:04.798 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_csum.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_gact.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_mirred.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_nat.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_pedit.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_police.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_simple.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_skbedit.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/act_vlan.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_basic.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_bpf.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_flow.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_fw.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_route.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/cls_u32.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_cmp.ko 2024-03-07T10:09:04.799 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_ipset.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_meta.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_nbyte.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_text.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/em_u32.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_choke.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_codel.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_drr.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_fq.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_gred.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hfsc.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_hhf.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_htb.ko 2024-03-07T10:09:04.800 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_ingress.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_mqprio_lib.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_multiq.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_netem.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_pie.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_plug.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_prio.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_qfq.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_red.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfb.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_sfq.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_tbf.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sched/sch_teql.ko 2024-03-07T10:09:04.801 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sctp/sctp_diag.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/sunrpc.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/diag.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/tipc/tipc.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/unix/unix_diag.ko 2024-03-07T10:09:04.802 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/security/keys/trusted-keys/trusted.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/kernel/virt/lib/irqbypass.ko 2024-03-07T10:09:04.803 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.alias.bin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.alias.bin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.bin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.builtin.modinfo 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.dep.bin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.devname 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.order 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.softdep 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/modules.symbols.bin 2024-03-07T10:09:04.804 INFO:teuthology.orchestra.run.smithi196.stdout:/lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-07T10:09:04.808 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:04.808 DEBUG:teuthology.orchestra.run.smithi196:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:postinstall scriptlet (using /bin/sh): 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gdd5c1cd17167 /lib/modules/6.8.0-rc7-gdd5c1cd17167/vmlinuz 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:for file in vmlinuz System.map config; do 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167"; then 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout: cp "/lib/modules/6.8.0-rc7-gdd5c1cd17167/${file}" "/boot/${file}-6.8.0-rc7-gdd5c1cd17167" 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout: fi 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:done 2024-03-07T10:09:04.830 INFO:teuthology.orchestra.run.smithi196.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:new-kernel-pkg --remove 6.8.0-rc7-gdd5c1cd17167 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gdd5c1cd17167.img 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:kernel-install remove 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:04.831 INFO:teuthology.orchestra.run.smithi196.stdout:fi 2024-03-07T10:09:04.832 DEBUG:teuthology.orchestra.run.smithi196:> sudo rpm -qi grub2-tools 2024-03-07T10:09:04.918 INFO:teuthology.orchestra.run.smithi196.stdout:Name : grub2-tools 2024-03-07T10:09:04.918 INFO:teuthology.orchestra.run.smithi196.stdout:Epoch : 1 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Version : 2.06 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Release : 68.el9 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Architecture: x86_64 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Group : Unspecified 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Size : 8264254 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:License : GPLv3+ 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Packager : builder@centos.org 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Vendor : CentOS 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-07T10:09:04.919 INFO:teuthology.orchestra.run.smithi196.stdout:Summary : Support tools for GRUB. 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:Description : 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:hardware devices. 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:09:04.920 INFO:teuthology.orchestra.run.smithi196.stdout:This subpackage provides tools for support of all platforms. 2024-03-07T10:09:04.921 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-07T10:09:04.921 INFO:teuthology.task.kernel:Updating grub on smithi196 to boot 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:04.921 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-07T10:09:05.457 INFO:teuthology.orchestra.run.smithi196.stderr:Generating grub configuration file ... 2024-03-07T10:09:06.857 INFO:teuthology.orchestra.run.smithi196.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-07T10:09:06.892 INFO:teuthology.orchestra.run.smithi196.stderr:done 2024-03-07T10:09:06.894 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-07T10:09:06.909 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.7Q0ifExI4A 2024-03-07T10:09:06.910 DEBUG:teuthology.orchestra.run.smithi196:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7Q0ifExI4A 2024-03-07T10:09:06.978 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.7Q0ifExI4A 2024-03-07T10:09:07.117 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.7Q0ifExI4A is 6KB 2024-03-07T10:09:07.165 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.7Q0ifExI4A 2024-03-07T10:09:07.180 DEBUG:teuthology.orchestra.run.smithi196:> sudo /bin/ls /boot/loader/entries || true 2024-03-07T10:09:07.246 INFO:teuthology.orchestra.run.smithi196.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-07T10:09:07.246 INFO:teuthology.orchestra.run.smithi196.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-07T10:09:07.246 INFO:teuthology.orchestra.run.smithi196.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-07T10:09:07.246 INFO:teuthology.orchestra.run.smithi196.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167.conf 2024-03-07T10:09:07.248 DEBUG:teuthology.orchestra.run.smithi196:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:09:07.427 DEBUG:teuthology.orchestra.run.smithi196:> sudo shutdown -r now 2024-03-07T10:09:37.450 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-07T10:09:37.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T10:09:37.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:09:43.712 DEBUG:teuthology.orchestra.remote:timed out 2024-03-07T10:09:52.722 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-07T10:09:52.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:10:00.412 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-07T10:10:01.114 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-07T10:10:01.115 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-07T10:10:01.115 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-03-07T10:10:01.150 INFO:teuthology.orchestra.run.smithi194.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:10:01.150 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:10:01.150 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-07T10:10:01.150 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-07T10:10:02.154 DEBUG:teuthology.parallel:result is None 2024-03-07T10:10:37.456 DEBUG:teuthology.orchestra.remote:timed out 2024-03-07T10:10:46.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T10:10:46.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:10:49.891 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-07T10:10:50.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T10:10:50.603 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc7-gdd5c1cd17167"... 2024-03-07T10:10:50.603 DEBUG:teuthology.orchestra.run.smithi196:> uname -r 2024-03-07T10:10:50.641 INFO:teuthology.orchestra.run.smithi196.stdout:6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:10:50.641 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gdd5c1cd17167 vs 6.8.0-rc7-gdd5c1cd17167 2024-03-07T10:10:50.641 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-07T10:10:50.641 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-07T10:10:51.644 DEBUG:teuthology.parallel:result is None 2024-03-07T10:10:51.645 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-07T10:10:51.652 INFO:teuthology.task.internal:Creating test directory... 2024-03-07T10:10:51.652 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-07T10:10:51.662 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-07T10:10:51.714 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-07T10:10:51.721 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-07T10:10:51.752 INFO:teuthology.task.internal:Creating archive directory... 2024-03-07T10:10:51.752 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-07T10:10:51.760 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-07T10:10:51.832 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-07T10:10:51.840 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-07T10:10:51.841 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-07T10:10:51.848 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-07T10:10:51.957 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T10:10:52.005 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T10:10:52.047 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T10:10:52.064 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-07T10:10:52.069 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-07T10:10:52.076 INFO:teuthology.task.internal:Configuring sudo... 2024-03-07T10:10:52.077 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-07T10:10:52.081 DEBUG:teuthology.orchestra.run.smithi196:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-07T10:10:52.168 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-07T10:10:52.177 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-07T10:10:52.177 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-07T10:10:52.184 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-07T10:10:52.230 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T10:10:52.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T10:10:52.419 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T10:10:52.504 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T10:10:52.603 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:10:52.604 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-07T10:10:52.699 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T10:10:52.777 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-07T10:10:52.860 DEBUG:teuthology.orchestra.run.smithi196:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T10:10:52.930 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-07T10:10:53.010 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:10:53.010 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-07T10:10:53.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-03-07T10:10:53.109 DEBUG:teuthology.orchestra.run.smithi196:> sudo service rsyslog restart 2024-03-07T10:10:53.234 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-07T10:10:53.244 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-07T10:10:53.649 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-07T10:10:53.657 INFO:teuthology.task.internal:Starting timer... 2024-03-07T10:10:53.657 INFO:teuthology.run_tasks:Running task pcp... 2024-03-07T10:10:53.714 INFO:teuthology.run_tasks:Running task selinux... 2024-03-07T10:10:53.754 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-03-07T10:10:53.875 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-03-07T10:10:53.879 DEBUG:teuthology.orchestra.run.smithi196:> sudo service auditd rotate 2024-03-07T10:10:54.010 INFO:teuthology.orchestra.run.smithi196.stdout:Rotating logs: 2024-03-07T10:10:54.014 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-07T10:10:54.015 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-03-07T10:10:54.075 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-03-07T10:10:54.075 DEBUG:teuthology.orchestra.run.smithi196:> /usr/sbin/getenforce 2024-03-07T10:10:54.117 INFO:teuthology.orchestra.run.smithi196.stdout:Permissive 2024-03-07T10:10:54.117 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi194.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi196.front.sepia.ceph.com': 'permissive'} 2024-03-07T10:10:54.118 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-07T10:10:54.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:10:54.205 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-07T10:10:54.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:10:54.284 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-07T10:10:54.285 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-03-07T10:10:54.377 DEBUG:teuthology.orchestra.run.smithi196:> sudo /usr/sbin/setenforce permissive 2024-03-07T10:10:54.473 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-07T10:10:54.483 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-07T10:10:54.499 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-07T10:10:54.500 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi194.front.sepia.ceph.com,smithi196.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-07T10:17:02.846 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi194.front.sepia.ceph.com'), Remote(name='ubuntu@smithi196.front.sepia.ceph.com')] 2024-03-07T10:17:02.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-07T10:17:02.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:17:02.994 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-03-07T10:17:03.155 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-03-07T10:17:03.156 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T10:17:03.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi196.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-07T10:17:03.297 DEBUG:teuthology.orchestra.run.smithi196:> true 2024-03-07T10:17:03.440 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi196.front.sepia.ceph.com' 2024-03-07T10:17:03.440 INFO:teuthology.run_tasks:Running task clock... 2024-03-07T10:17:03.451 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-07T10:17:03.451 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-07T10:17:03.452 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T10:17:03.459 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-07T10:17:03.460 DEBUG:teuthology.orchestra.run.smithi196:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T10:17:03.547 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-07T10:17:03.556 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-07T10:17:03.598 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-07T10:17:03.610 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-07T10:17:03.692 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-03-07T10:17:03.701 INFO:teuthology.orchestra.run.smithi196.stderr:sudo: ntpd: command not found 2024-03-07T10:17:03.732 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-03-07T10:17:03.742 INFO:teuthology.orchestra.run.smithi196.stdout:506 Cannot talk to daemon 2024-03-07T10:17:03.781 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-07T10:17:03.790 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-07T10:17:03.834 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-07T10:17:03.841 INFO:teuthology.orchestra.run.smithi196.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-07T10:17:03.962 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-03-07T10:17:03.965 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.971 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.973 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:17:03.974 INFO:teuthology.run_tasks:Running task install... 2024-03-07T10:17:03.983 DEBUG:teuthology.task.install:project ceph 2024-03-07T10:17:03.983 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}} 2024-03-07T10:17:03.983 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'} 2024-03-07T10:17:03.983 INFO:teuthology.task.install:Using flavor: default 2024-03-07T10:17:03.989 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-07T10:17:03.989 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-07T10:17:03.989 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'tag': None, 'wait_for_package': False} 2024-03-07T10:17:03.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:17:03.992 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'tag': None, 'wait_for_package': False} 2024-03-07T10:17:03.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:17:04.214 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/ 2024-03-07T10:17:04.215 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1848.g8b896a9e 2024-03-07T10:17:04.223 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/ 2024-03-07T10:17:04.223 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1848.g8b896a9e 2024-03-07T10:17:04.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-07T10:17:04.338 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:17:04.338 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-07T10:17:04.389 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-lusov-qdb/8b896a9e145796119f0451201dc4d53ddac97db0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-07T10:17:04.389 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:17:04.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-07T10:17:04.439 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-07T10:17:04.439 DEBUG:teuthology.orchestra.run.smithi196:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8b896a9e145796119f0451201dc4d53ddac97db0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-07T10:17:04.489 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-07T10:17:04.489 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8b896a9e145796119f0451201dc4d53ddac97db0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-07T10:17:04.575 DEBUG:teuthology.orchestra.run.smithi196:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-07T10:17:04.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-07T10:17:04.702 DEBUG:teuthology.orchestra.run.smithi196:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-07T10:17:04.755 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-07T10:17:04.792 INFO:teuthology.orchestra.run.smithi196.stdout:check_obsoletes = 1 2024-03-07T10:17:04.797 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum clean all 2024-03-07T10:17:04.846 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-03-07T10:17:04.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-03-07T10:17:05.166 INFO:teuthology.orchestra.run.smithi196.stdout:74 files removed 2024-03-07T10:17:05.206 DEBUG:teuthology.orchestra.run.smithi196:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-07T10:17:05.221 INFO:teuthology.orchestra.run.smithi194.stdout:74 files removed 2024-03-07T10:17:05.263 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-07T10:17:06.226 INFO:teuthology.orchestra.run.smithi196.stdout:ceph packages for x86_64 162 kB/s | 83 kB 00:00 2024-03-07T10:17:06.364 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 140 kB/s | 83 kB 00:00 2024-03-07T10:17:06.809 INFO:teuthology.orchestra.run.smithi196.stdout:ceph noarch packages 20 kB/s | 10 kB 00:00 2024-03-07T10:17:06.906 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 22 kB/s | 10 kB 00:00 2024-03-07T10:17:07.475 INFO:teuthology.orchestra.run.smithi196.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-03-07T10:17:07.503 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-03-07T10:17:08.462 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - AppStream 9.1 MB/s | 8.1 MB 00:00 2024-03-07T10:17:08.514 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-9 - AppStream 8.4 MB/s | 8.1 MB 00:00 2024-03-07T10:17:10.328 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.5 MB 00:00 2024-03-07T10:17:10.421 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.5 MB 00:00 2024-03-07T10:17:11.642 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-07T10:17:12.866 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:02 2024-03-07T10:17:18.193 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 19 MB 00:05 2024-03-07T10:17:24.285 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.1 MB 00:02 2024-03-07T10:17:26.077 INFO:teuthology.orchestra.run.smithi196.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2024-03-07T10:17:30.769 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-03-07T10:17:35.744 INFO:teuthology.orchestra.run.smithi196.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 21 MB 00:09 2024-03-07T10:17:41.519 INFO:teuthology.orchestra.run.smithi196.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-07T10:17:43.106 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 741 kB/s | 6.1 MB 00:08 2024-03-07T10:17:44.101 INFO:teuthology.orchestra.run.smithi196.stderr:Modular dependency problems: 2024-03-07T10:17:44.101 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-03-07T10:17:44.101 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 1: conflicting requests 2024-03-07T10:17:44.101 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240227110532:20125149.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.101 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 2: conflicting requests 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 3: conflicting requests 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 4: conflicting requests 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 5: conflicting requests 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 6: conflicting requests 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.102 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 7: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240222150954:49cc9d1b.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 8: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 9: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 10: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 11: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 12: conflicting requests 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.103 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 13: conflicting requests 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 14: conflicting requests 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 15: conflicting requests 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 16: conflicting requests 2024-03-07T10:17:44.104 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 17: conflicting requests 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 18: conflicting requests 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 19: conflicting requests 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 20: conflicting requests 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 21: conflicting requests 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.105 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 22: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 23: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 24: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 25: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 26: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 27: conflicting requests 2024-03-07T10:17:44.106 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 28: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 29: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 30: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 31: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 32: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 33: conflicting requests 2024-03-07T10:17:44.107 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 34: conflicting requests 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 35: conflicting requests 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 36: conflicting requests 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 37: conflicting requests 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 38: cannot install the best candidate for the job 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.108 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 39: conflicting requests 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 40: cannot install the best candidate for the job 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.109 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 41: cannot install the best candidate for the job 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 42: cannot install the best candidate for the job 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 43: cannot install the best candidate for the job 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.110 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 44: cannot install the best candidate for the job 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: Problem 45: cannot install the best candidate for the job 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.111 INFO:teuthology.orchestra.run.smithi196.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-03-07T10:17:44.696 INFO:teuthology.orchestra.run.smithi196.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-07T10:17:44.698 INFO:teuthology.orchestra.run.smithi196.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-07T10:17:44.715 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 15 kB 00:00 2024-03-07T10:17:44.721 INFO:teuthology.orchestra.run.smithi196.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-07T10:17:44.723 INFO:teuthology.orchestra.run.smithi196.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-07T10:17:44.724 INFO:teuthology.orchestra.run.smithi196.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-07T10:17:44.726 INFO:teuthology.orchestra.run.smithi196.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-07T10:17:44.728 INFO:teuthology.orchestra.run.smithi196.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-07T10:17:44.732 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-07T10:17:44.733 INFO:teuthology.orchestra.run.smithi196.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-07T10:17:44.835 INFO:teuthology.orchestra.run.smithi196.stdout:Dependencies resolved. 2024-03-07T10:17:44.864 INFO:teuthology.orchestra.run.smithi196.stdout:========================================================================================= 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: Package Arch Version Repository Size 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout:========================================================================================= 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout:Installing: 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 6.6 k 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 5.3 M 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 889 k 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 145 k 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 1.5 M 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 138 k 2024-03-07T10:17:44.865 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 1.8 M 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 7.4 M 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 49 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 9.8 M 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 47 M 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 264 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 748 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 220 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 27 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 18 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 31 k 2024-03-07T10:17:44.866 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 746 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 127 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 161 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 320 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 298 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 99 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 85 k 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.1 M 2024-03-07T10:17:44.867 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 170 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrading: 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-07T10:17:44.868 INFO:teuthology.orchestra.run.smithi196.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: librados2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.4 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.1 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout:Installing dependencies: 2024-03-07T10:17:44.869 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 20 M 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 31 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 2.3 M 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 248 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 4.7 M 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 17 M 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 16 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 25 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-03-07T10:17:44.870 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 163 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 501 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-03-07T10:17:44.871 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 5.1 M 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-03-07T10:17:44.872 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 45 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 131 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-07T10:17:44.873 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-07T10:17:44.874 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-07T10:17:44.875 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-07T10:17:44.876 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout:Installing weak dependencies: 2024-03-07T10:17:44.877 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction Summary 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:========================================================================================= 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:Install 150 Packages 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:Upgrade 24 Packages 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:Total download size: 226 M 2024-03-07T10:17:44.878 INFO:teuthology.orchestra.run.smithi196.stdout:Downloading Packages: 2024-03-07T10:17:46.037 INFO:teuthology.orchestra.run.smithi196.stdout:(1/174): ceph-19.0.0-1848.g8b896a9e.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-03-07T10:17:46.075 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 18 MB/s | 21 MB 00:01 2024-03-07T10:17:46.437 INFO:teuthology.orchestra.run.smithi196.stdout:(2/174): ceph-fuse-19.0.0-1848.g8b896a9e.el9.x8 2.2 MB/s | 889 kB 00:00 2024-03-07T10:17:46.512 INFO:teuthology.orchestra.run.smithi196.stdout:(3/174): ceph-immutable-object-cache-19.0.0-184 1.9 MB/s | 145 kB 00:00 2024-03-07T10:17:46.688 INFO:teuthology.orchestra.run.smithi196.stdout:(4/174): ceph-base-19.0.0-1848.g8b896a9e.el9.x8 5.6 MB/s | 5.3 MB 00:00 2024-03-07T10:17:46.837 INFO:teuthology.orchestra.run.smithi196.stdout:(5/174): ceph-mgr-19.0.0-1848.g8b896a9e.el9.x86 10 MB/s | 1.5 MB 00:00 2024-03-07T10:17:47.152 INFO:teuthology.orchestra.run.smithi196.stdout:(6/174): ceph-mds-19.0.0-1848.g8b896a9e.el9.x86 3.6 MB/s | 2.3 MB 00:00 2024-03-07T10:17:47.263 INFO:teuthology.orchestra.run.smithi196.stdout:(7/174): ceph-mon-19.0.0-1848.g8b896a9e.el9.x86 11 MB/s | 4.7 MB 00:00 2024-03-07T10:17:47.972 INFO:teuthology.orchestra.run.smithi196.stdout:(8/174): ceph-radosgw-19.0.0-1848.g8b896a9e.el9 14 MB/s | 9.8 MB 00:00 2024-03-07T10:17:48.022 INFO:teuthology.orchestra.run.smithi196.stdout:(9/174): ceph-selinux-19.0.0-1848.g8b896a9e.el9 515 kB/s | 25 kB 00:00 2024-03-07T10:17:49.880 INFO:teuthology.orchestra.run.smithi196.stdout:(10/174): ceph-common-19.0.0-1848.g8b896a9e.el9 4.9 MB/s | 20 MB 00:04 2024-03-07T10:17:50.014 INFO:teuthology.orchestra.run.smithi196.stdout:(11/174): cephfs-mirror-19.0.0-1848.g8b896a9e.e 1.6 MB/s | 220 kB 00:00 2024-03-07T10:17:50.114 INFO:teuthology.orchestra.run.smithi196.stdout:(12/174): cephfs-shell-19.0.0-1848.g8b896a9e.el 272 kB/s | 27 kB 00:00 2024-03-07T10:17:50.231 INFO:teuthology.orchestra.run.smithi196.stdout:(13/174): libcephfs-devel-19.0.0-1848.g8b896a9e 270 kB/s | 31 kB 00:00 2024-03-07T10:17:50.448 INFO:teuthology.orchestra.run.smithi196.stdout:(14/174): libcephfs2-19.0.0-1848.g8b896a9e.el9. 3.4 MB/s | 746 kB 00:00 2024-03-07T10:17:50.948 INFO:teuthology.orchestra.run.smithi196.stdout:(15/174): ceph-test-19.0.0-1848.g8b896a9e.el9.x 16 MB/s | 47 MB 00:02 2024-03-07T10:17:50.973 INFO:teuthology.orchestra.run.smithi196.stdout:(16/174): libcephsqlite-19.0.0-1848.g8b896a9e.e 311 kB/s | 163 kB 00:00 2024-03-07T10:17:50.999 INFO:teuthology.orchestra.run.smithi196.stdout:(17/174): librados-devel-19.0.0-1848.g8b896a9e. 2.5 MB/s | 127 kB 00:00 2024-03-07T10:17:51.258 INFO:teuthology.orchestra.run.smithi196.stdout:(18/174): ceph-osd-19.0.0-1848.g8b896a9e.el9.x8 4.1 MB/s | 17 MB 00:04 2024-03-07T10:17:51.299 INFO:teuthology.orchestra.run.smithi196.stdout:(19/174): libradosstriper1-19.0.0-1848.g8b896a9 1.5 MB/s | 501 kB 00:00 2024-03-07T10:17:51.324 INFO:teuthology.orchestra.run.smithi196.stdout:(20/174): python3-ceph-argparse-19.0.0-1848.g8b 688 kB/s | 45 kB 00:00 2024-03-07T10:17:51.367 INFO:teuthology.orchestra.run.smithi196.stdout:(21/174): python3-ceph-common-19.0.0-1848.g8b89 1.9 MB/s | 131 kB 00:00 2024-03-07T10:17:51.400 INFO:teuthology.orchestra.run.smithi196.stdout:(22/174): python3-cephfs-19.0.0-1848.g8b896a9e. 2.1 MB/s | 161 kB 00:00 2024-03-07T10:17:51.475 INFO:teuthology.orchestra.run.smithi196.stdout:(23/174): python3-rados-19.0.0-1848.g8b896a9e.e 2.9 MB/s | 320 kB 00:00 2024-03-07T10:17:51.500 INFO:teuthology.orchestra.run.smithi196.stdout:(24/174): python3-rbd-19.0.0-1848.g8b896a9e.el9 2.9 MB/s | 298 kB 00:00 2024-03-07T10:17:51.617 INFO:teuthology.orchestra.run.smithi196.stdout:(25/174): librgw2-19.0.0-1848.g8b896a9e.el9.x86 8.3 MB/s | 5.1 MB 00:00 2024-03-07T10:17:51.643 INFO:teuthology.orchestra.run.smithi196.stdout:(26/174): rbd-fuse-19.0.0-1848.g8b896a9e.el9.x8 604 kB/s | 85 kB 00:00 2024-03-07T10:17:51.668 INFO:teuthology.orchestra.run.smithi196.stdout:(27/174): python3-rgw-19.0.0-1848.g8b896a9e.el9 517 kB/s | 99 kB 00:00 2024-03-07T10:17:51.735 INFO:teuthology.orchestra.run.smithi196.stdout:(28/174): rbd-nbd-19.0.0-1848.g8b896a9e.el9.x86 1.8 MB/s | 170 kB 00:00 2024-03-07T10:17:51.761 INFO:teuthology.orchestra.run.smithi196.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1848.g 344 kB/s | 31 kB 00:00 2024-03-07T10:17:51.852 INFO:teuthology.orchestra.run.smithi196.stdout:(30/174): rbd-mirror-19.0.0-1848.g8b896a9e.el9. 13 MB/s | 3.1 MB 00:00 2024-03-07T10:17:51.874 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-03-07T10:17:51.886 INFO:teuthology.orchestra.run.smithi196.stdout:(31/174): ceph-mgr-cephadm-19.0.0-1848.g8b896a9 924 kB/s | 138 kB 00:00 2024-03-07T10:17:52.020 INFO:teuthology.orchestra.run.smithi196.stdout:(32/174): ceph-mgr-modules-core-19.0.0-1848.g8b 1.8 MB/s | 248 kB 00:00 2024-03-07T10:17:52.120 INFO:teuthology.orchestra.run.smithi196.stdout:(33/174): ceph-mgr-rook-19.0.0-1848.g8b896a9e.e 497 kB/s | 49 kB 00:00 2024-03-07T10:17:52.178 INFO:teuthology.orchestra.run.smithi196.stdout:(34/174): ceph-mgr-dashboard-19.0.0-1848.g8b896 4.3 MB/s | 1.8 MB 00:00 2024-03-07T10:17:52.203 INFO:teuthology.orchestra.run.smithi196.stdout:(35/174): ceph-prometheus-alerts-19.0.0-1848.g8 199 kB/s | 16 kB 00:00 2024-03-07T10:17:52.279 INFO:teuthology.orchestra.run.smithi196.stdout:(36/174): ceph-volume-19.0.0-1848.g8b896a9e.el9 2.6 MB/s | 264 kB 00:00 2024-03-07T10:17:52.413 INFO:teuthology.orchestra.run.smithi196.stdout:(37/174): ceph-mgr-diskprediction-local-19.0.0- 13 MB/s | 7.4 MB 00:00 2024-03-07T10:17:52.429 INFO:teuthology.orchestra.run.smithi196.stdout:(38/174): cephfs-top-19.0.0-1848.g8b896a9e.el9. 122 kB/s | 18 kB 00:00 2024-03-07T10:17:52.471 INFO:teuthology.orchestra.run.smithi196.stdout:(39/174): cephadm-19.0.0-1848.g8b896a9e.el9.noa 2.7 MB/s | 748 kB 00:00 2024-03-07T10:17:52.597 INFO:teuthology.orchestra.run.smithi196.stdout:(40/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 96 kB/s | 18 kB 00:00 2024-03-07T10:17:52.730 INFO:teuthology.orchestra.run.smithi196.stdout:(41/174): fuse-2.9.9-15.el9.x86_64.rpm 268 kB/s | 80 kB 00:00 2024-03-07T10:17:52.831 INFO:teuthology.orchestra.run.smithi196.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 640 kB/s | 187 kB 00:00 2024-03-07T10:17:52.864 INFO:teuthology.orchestra.run.smithi196.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 195 kB 00:00 2024-03-07T10:17:52.939 INFO:teuthology.orchestra.run.smithi196.stdout:(44/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-03-07T10:17:52.956 INFO:teuthology.orchestra.run.smithi196.stdout:(45/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.7 MB/s | 218 kB 00:00 2024-03-07T10:17:52.990 INFO:teuthology.orchestra.run.smithi196.stdout:(46/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 803 kB 00:00 2024-03-07T10:17:53.015 INFO:teuthology.orchestra.run.smithi196.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-03-07T10:17:53.048 INFO:teuthology.orchestra.run.smithi196.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-03-07T10:17:53.124 INFO:teuthology.orchestra.run.smithi196.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-07T10:17:53.157 INFO:teuthology.orchestra.run.smithi196.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-03-07T10:17:53.224 INFO:teuthology.orchestra.run.smithi196.stdout:(51/174): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-03-07T10:17:53.308 INFO:teuthology.orchestra.run.smithi196.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-03-07T10:17:53.383 INFO:teuthology.orchestra.run.smithi196.stdout:(53/174): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-03-07T10:17:53.409 INFO:teuthology.orchestra.run.smithi196.stdout:(54/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-03-07T10:17:53.442 INFO:teuthology.orchestra.run.smithi196.stdout:(55/174): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-03-07T10:17:53.476 INFO:teuthology.orchestra.run.smithi196.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 494 kB/s | 33 kB 00:00 2024-03-07T10:17:53.501 INFO:teuthology.orchestra.run.smithi196.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-03-07T10:17:53.535 INFO:teuthology.orchestra.run.smithi196.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-03-07T10:17:53.568 INFO:teuthology.orchestra.run.smithi196.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-03-07T10:17:53.595 INFO:teuthology.orchestra.run.smithi196.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 783 kB/s | 45 kB 00:00 2024-03-07T10:17:53.694 INFO:teuthology.orchestra.run.smithi196.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-03-07T10:17:53.728 INFO:teuthology.orchestra.run.smithi196.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 4.3 MB/s | 582 kB 00:00 2024-03-07T10:17:53.753 INFO:teuthology.orchestra.run.smithi196.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 441 kB/s | 25 kB 00:00 2024-03-07T10:17:53.778 INFO:teuthology.orchestra.run.smithi196.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 961 kB/s | 47 kB 00:00 2024-03-07T10:17:53.812 INFO:teuthology.orchestra.run.smithi196.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-03-07T10:17:53.845 INFO:teuthology.orchestra.run.smithi196.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-03-07T10:17:53.879 INFO:teuthology.orchestra.run.smithi196.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 533 kB/s | 35 kB 00:00 2024-03-07T10:17:53.979 INFO:teuthology.orchestra.run.smithi196.stdout:(68/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.6 MB/s | 3.0 MB 00:00 2024-03-07T10:17:54.171 INFO:teuthology.orchestra.run.smithi196.stdout:(69/174): postgresql-13.11-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-03-07T10:17:54.338 INFO:teuthology.orchestra.run.smithi196.stdout:(70/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 9.0 MB/s | 4.1 MB 00:00 2024-03-07T10:17:54.380 INFO:teuthology.orchestra.run.smithi196.stdout:(71/174): postgresql-contrib-13.11-1.el9.x86_64 4.3 MB/s | 905 kB 00:00 2024-03-07T10:17:54.415 INFO:teuthology.orchestra.run.smithi196.stdout:(72/174): postgresql-private-libs-13.11-1.el9.x 1.8 MB/s | 135 kB 00:00 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr:Modular dependency problems: 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 1: conflicting requests 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240227110532:20125149.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 2: conflicting requests 2024-03-07T10:17:54.483 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 3: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 4: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 5: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 6: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 7: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240222150954:49cc9d1b.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 8: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 9: conflicting requests 2024-03-07T10:17:54.484 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 10: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 11: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 12: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 13: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 14: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 15: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 16: conflicting requests 2024-03-07T10:17:54.485 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 17: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 18: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 19: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 20: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 21: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 22: conflicting requests 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.486 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 23: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 24: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 25: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 26: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 27: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 28: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 29: conflicting requests 2024-03-07T10:17:54.487 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 30: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 31: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 32: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 33: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 34: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 35: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 36: conflicting requests 2024-03-07T10:17:54.488 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 37: conflicting requests 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 38: cannot install the best candidate for the job 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 39: conflicting requests 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.489 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 40: cannot install the best candidate for the job 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 41: cannot install the best candidate for the job 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 42: cannot install the best candidate for the job 2024-03-07T10:17:54.490 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 43: cannot install the best candidate for the job 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 44: cannot install the best candidate for the job 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.491 INFO:teuthology.orchestra.run.smithi194.stderr: Problem 45: cannot install the best candidate for the job 2024-03-07T10:17:54.492 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.492 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.492 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.492 INFO:teuthology.orchestra.run.smithi194.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-03-07T10:17:54.522 INFO:teuthology.orchestra.run.smithi196.stdout:(73/174): openblas-openmp-0.3.21-2.el9.x86_64.r 7.0 MB/s | 4.7 MB 00:00 2024-03-07T10:17:54.581 INFO:teuthology.orchestra.run.smithi196.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-07T10:17:54.606 INFO:teuthology.orchestra.run.smithi196.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-03-07T10:17:54.681 INFO:teuthology.orchestra.run.smithi196.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.2 MB/s | 245 kB 00:00 2024-03-07T10:17:54.756 INFO:teuthology.orchestra.run.smithi196.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-03-07T10:17:54.806 INFO:teuthology.orchestra.run.smithi196.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 522 kB/s | 26 kB 00:00 2024-03-07T10:17:54.882 INFO:teuthology.orchestra.run.smithi196.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 258 kB/s | 19 kB 00:00 2024-03-07T10:17:55.007 INFO:teuthology.orchestra.run.smithi196.stdout:(80/174): postgresql-server-13.11-1.el9.x86_64. 9.2 MB/s | 5.7 MB 00:00 2024-03-07T10:17:55.041 INFO:teuthology.orchestra.run.smithi196.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-03-07T10:17:55.066 INFO:teuthology.orchestra.run.smithi196.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 603 kB/s | 35 kB 00:00 2024-03-07T10:17:55.110 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-07T10:17:55.112 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-07T10:17:55.124 INFO:teuthology.orchestra.run.smithi196.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-03-07T10:17:55.133 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-07T10:17:55.135 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-07T10:17:55.136 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-07T10:17:55.137 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-07T10:17:55.140 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-07T10:17:55.143 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-07T10:17:55.145 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-07T10:17:55.233 INFO:teuthology.orchestra.run.smithi196.stdout:(84/174): python3-babel-2.9.1-2.el9.noarch.rpm 9.2 MB/s | 6.0 MB 00:00 2024-03-07T10:17:55.246 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-03-07T10:17:55.267 INFO:teuthology.orchestra.run.smithi196.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-03-07T10:17:55.272 INFO:teuthology.orchestra.run.smithi194.stdout:========================================================================================= 2024-03-07T10:17:55.272 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout:========================================================================================= 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 6.6 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 5.3 M 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 889 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 145 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 1.5 M 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 138 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 1.8 M 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 7.4 M 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 49 k 2024-03-07T10:17:55.273 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 9.8 M 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 47 M 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 264 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 748 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 220 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 27 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 18 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 31 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 746 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 127 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-03-07T10:17:55.274 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.11-1.el9 appstream 1.6 M 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.11-1.el9 appstream 905 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.11-1.el9 appstream 5.7 M 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 161 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 320 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 298 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 99 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 85 k 2024-03-07T10:17:55.275 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.1 M 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 170 k 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-07T10:17:55.276 INFO:teuthology.orchestra.run.smithi194.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.4 M 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 3.1 M 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-07T10:17:55.277 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 20 M 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 31 k 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 2.3 M 2024-03-07T10:17:55.278 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 248 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 4.7 M 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 17 M 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1848.g8b896a9e.el9 ceph-noarch 16 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 25 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 163 k 2024-03-07T10:17:55.279 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 501 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 5.1 M 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-03-07T10:17:55.280 INFO:teuthology.orchestra.run.smithi194.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.11-1.el9 appstream 135 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-03-07T10:17:55.281 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 45 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:19.0.0-1848.g8b896a9e.el9 ceph 131 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-07T10:17:55.282 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-03-07T10:17:55.283 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-03-07T10:17:55.284 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-03-07T10:17:55.285 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-07T10:17:55.286 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-07T10:17:55.286 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-03-07T10:17:55.286 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-07T10:17:55.286 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-07T10:17:55.287 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout:Installing weak dependencies: 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout:========================================================================================= 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout:Install 150 Packages 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 24 Packages 2024-03-07T10:17:55.288 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:17:55.289 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 226 M 2024-03-07T10:17:55.289 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-03-07T10:17:55.292 INFO:teuthology.orchestra.run.smithi196.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-03-07T10:17:55.342 INFO:teuthology.orchestra.run.smithi196.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 568 kB/s | 42 kB 00:00 2024-03-07T10:17:55.376 INFO:teuthology.orchestra.run.smithi196.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-03-07T10:17:55.409 INFO:teuthology.orchestra.run.smithi196.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-03-07T10:17:55.443 INFO:teuthology.orchestra.run.smithi196.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-03-07T10:17:55.477 INFO:teuthology.orchestra.run.smithi196.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 769 kB/s | 51 kB 00:00 2024-03-07T10:17:55.519 INFO:teuthology.orchestra.run.smithi196.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 719 kB/s | 54 kB 00:00 2024-03-07T10:17:55.644 INFO:teuthology.orchestra.run.smithi196.stdout:(93/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.5 MB/s | 5.1 MB 00:00 2024-03-07T10:17:55.669 INFO:teuthology.orchestra.run.smithi196.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 279 kB/s | 42 kB 00:00 2024-03-07T10:17:55.878 INFO:teuthology.orchestra.run.smithi196.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 189 kB/s | 44 kB 00:00 2024-03-07T10:17:55.912 INFO:teuthology.orchestra.run.smithi196.stdout:(96/174): qatlib-23.11.0-1.el9.x86_64.rpm 897 kB/s | 216 kB 00:00 2024-03-07T10:17:55.945 INFO:teuthology.orchestra.run.smithi196.stdout:(97/174): qatlib-service-23.11.0-1.el9.x86_64.r 528 kB/s | 35 kB 00:00 2024-03-07T10:17:55.970 INFO:teuthology.orchestra.run.smithi196.stdout:(98/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 769 kB/s | 44 kB 00:00 2024-03-07T10:17:56.004 INFO:teuthology.orchestra.run.smithi196.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 5.2 MB/s | 305 kB 00:00 2024-03-07T10:17:56.029 INFO:teuthology.orchestra.run.smithi196.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-03-07T10:17:56.071 INFO:teuthology.orchestra.run.smithi196.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-03-07T10:17:56.105 INFO:teuthology.orchestra.run.smithi196.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 855 kB/s | 64 kB 00:00 2024-03-07T10:17:56.147 INFO:teuthology.orchestra.run.smithi196.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 605 kB/s | 45 kB 00:00 2024-03-07T10:17:56.239 INFO:teuthology.orchestra.run.smithi196.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 168 kB/s | 22 kB 00:00 2024-03-07T10:17:56.597 INFO:teuthology.orchestra.run.smithi196.stdout:(105/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 15 MB/s | 16 MB 00:01 2024-03-07T10:17:56.656 INFO:teuthology.orchestra.run.smithi196.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.7 MB/s | 863 kB 00:00 2024-03-07T10:17:56.659 INFO:teuthology.orchestra.run.smithi194.stdout:(1/174): ceph-19.0.0-1848.g8b896a9e.el9.x86_64. 19 kB/s | 6.6 kB 00:00 2024-03-07T10:17:57.084 INFO:teuthology.orchestra.run.smithi194.stdout:(2/174): ceph-fuse-19.0.0-1848.g8b896a9e.el9.x8 2.0 MB/s | 889 kB 00:00 2024-03-07T10:17:57.156 INFO:teuthology.orchestra.run.smithi196.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 39 kB/s | 19 kB 00:00 2024-03-07T10:17:57.159 INFO:teuthology.orchestra.run.smithi194.stdout:(3/174): ceph-immutable-object-cache-19.0.0-184 1.9 MB/s | 145 kB 00:00 2024-03-07T10:17:57.277 INFO:teuthology.orchestra.run.smithi194.stdout:(4/174): ceph-base-19.0.0-1848.g8b896a9e.el9.x8 5.6 MB/s | 5.3 MB 00:00 2024-03-07T10:17:57.460 INFO:teuthology.orchestra.run.smithi194.stdout:(5/174): ceph-mgr-19.0.0-1848.g8b896a9e.el9.x86 8.2 MB/s | 1.5 MB 00:00 2024-03-07T10:17:57.531 INFO:teuthology.orchestra.run.smithi196.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 332 kB/s | 309 kB 00:00 2024-03-07T10:17:57.565 INFO:teuthology.orchestra.run.smithi196.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 414 kB/s | 548 kB 00:01 2024-03-07T10:17:57.640 INFO:teuthology.orchestra.run.smithi196.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 241 kB/s | 26 kB 00:00 2024-03-07T10:17:57.682 INFO:teuthology.orchestra.run.smithi196.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 417 kB/s | 49 kB 00:00 2024-03-07T10:17:57.741 INFO:teuthology.orchestra.run.smithi196.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 676 kB/s | 67 kB 00:00 2024-03-07T10:17:57.961 INFO:teuthology.orchestra.run.smithi194.stdout:(6/174): ceph-mon-19.0.0-1848.g8b896a9e.el9.x86 9.4 MB/s | 4.7 MB 00:00 2024-03-07T10:17:58.283 INFO:teuthology.orchestra.run.smithi196.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 519 kB/s | 151 kB 00:00 2024-03-07T10:17:58.283 INFO:teuthology.orchestra.run.smithi194.stdout:(7/174): ceph-mds-19.0.0-1848.g8b896a9e.el9.x86 2.7 MB/s | 2.3 MB 00:00 2024-03-07T10:17:58.638 INFO:teuthology.orchestra.run.smithi194.stdout:(8/174): ceph-common-19.0.0-1848.g8b896a9e.el9. 8.8 MB/s | 20 MB 00:02 2024-03-07T10:17:58.686 INFO:teuthology.orchestra.run.smithi194.stdout:(9/174): ceph-selinux-19.0.0-1848.g8b896a9e.el9 513 kB/s | 25 kB 00:00 2024-03-07T10:17:58.766 INFO:teuthology.orchestra.run.smithi196.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 692 kB/s | 548 kB 00:00 2024-03-07T10:17:58.891 INFO:teuthology.orchestra.run.smithi196.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 350 kB/s | 43 kB 00:00 2024-03-07T10:17:59.008 INFO:teuthology.orchestra.run.smithi196.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 662 kB/s | 838 kB 00:01 2024-03-07T10:17:59.035 INFO:teuthology.orchestra.run.smithi196.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 227 kB/s | 32 kB 00:00 2024-03-07T10:17:59.142 INFO:teuthology.orchestra.run.smithi196.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 113 kB/s | 15 kB 00:00 2024-03-07T10:17:59.392 INFO:teuthology.orchestra.run.smithi196.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 480 kB/s | 172 kB 00:00 2024-03-07T10:17:59.412 INFO:teuthology.orchestra.run.smithi194.stdout:(10/174): ceph-osd-19.0.0-1848.g8b896a9e.el9.x8 12 MB/s | 17 MB 00:01 2024-03-07T10:17:59.487 INFO:teuthology.orchestra.run.smithi194.stdout:(11/174): cephfs-mirror-19.0.0-1848.g8b896a9e.e 2.9 MB/s | 220 kB 00:00 2024-03-07T10:17:59.553 INFO:teuthology.orchestra.run.smithi194.stdout:(12/174): cephfs-shell-19.0.0-1848.g8b896a9e.el 410 kB/s | 27 kB 00:00 2024-03-07T10:17:59.639 INFO:teuthology.orchestra.run.smithi194.stdout:(13/174): libcephfs-devel-19.0.0-1848.g8b896a9e 370 kB/s | 31 kB 00:00 2024-03-07T10:17:59.763 INFO:teuthology.orchestra.run.smithi194.stdout:(14/174): libcephfs2-19.0.0-1848.g8b896a9e.el9. 6.0 MB/s | 746 kB 00:00 2024-03-07T10:17:59.809 INFO:teuthology.orchestra.run.smithi196.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 538 kB/s | 358 kB 00:00 2024-03-07T10:17:59.829 INFO:teuthology.orchestra.run.smithi194.stdout:(15/174): libcephsqlite-19.0.0-1848.g8b896a9e.e 2.4 MB/s | 163 kB 00:00 2024-03-07T10:17:59.888 INFO:teuthology.orchestra.run.smithi194.stdout:(16/174): librados-devel-19.0.0-1848.g8b896a9e. 2.2 MB/s | 127 kB 00:00 2024-03-07T10:17:59.951 INFO:teuthology.orchestra.run.smithi196.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 543 kB/s | 303 kB 00:00 2024-03-07T10:17:59.969 INFO:teuthology.orchestra.run.smithi196.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 224 kB/s | 35 kB 00:00 2024-03-07T10:18:00.049 INFO:teuthology.orchestra.run.smithi194.stdout:(17/174): libradosstriper1-19.0.0-1848.g8b896a9 3.0 MB/s | 501 kB 00:00 2024-03-07T10:18:00.320 INFO:teuthology.orchestra.run.smithi196.stdout:(123/174): python3-google-auth-2.28.0-1.el9.noa 554 kB/s | 203 kB 00:00 2024-03-07T10:18:00.513 INFO:teuthology.orchestra.run.smithi194.stdout:(18/174): librgw2-19.0.0-1848.g8b896a9e.el9.x86 11 MB/s | 5.1 MB 00:00 2024-03-07T10:18:00.572 INFO:teuthology.orchestra.run.smithi194.stdout:(19/174): python3-ceph-argparse-19.0.0-1848.g8b 790 kB/s | 45 kB 00:00 2024-03-07T10:18:00.585 INFO:teuthology.orchestra.run.smithi196.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 543 kB/s | 144 kB 00:00 2024-03-07T10:18:00.647 INFO:teuthology.orchestra.run.smithi194.stdout:(20/174): python3-ceph-common-19.0.0-1848.g8b89 1.7 MB/s | 131 kB 00:00 2024-03-07T10:18:00.703 INFO:teuthology.orchestra.run.smithi196.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2024-03-07T10:18:00.723 INFO:teuthology.orchestra.run.smithi194.stdout:(21/174): python3-cephfs-19.0.0-1848.g8b896a9e. 2.1 MB/s | 161 kB 00:00 2024-03-07T10:18:00.803 INFO:teuthology.orchestra.run.smithi196.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 178 kB/s | 18 kB 00:00 2024-03-07T10:18:00.829 INFO:teuthology.orchestra.run.smithi194.stdout:(22/174): python3-rados-19.0.0-1848.g8b896a9e.e 3.0 MB/s | 320 kB 00:00 2024-03-07T10:18:00.903 INFO:teuthology.orchestra.run.smithi196.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 233 kB/s | 23 kB 00:00 2024-03-07T10:18:00.906 INFO:teuthology.orchestra.run.smithi194.stdout:(23/174): python3-rbd-19.0.0-1848.g8b896a9e.el9 3.8 MB/s | 298 kB 00:00 2024-03-07T10:18:00.974 INFO:teuthology.orchestra.run.smithi194.stdout:(24/174): python3-rgw-19.0.0-1848.g8b896a9e.el9 1.5 MB/s | 99 kB 00:00 2024-03-07T10:18:01.003 INFO:teuthology.orchestra.run.smithi196.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 196 kB/s | 19 kB 00:00 2024-03-07T10:18:01.040 INFO:teuthology.orchestra.run.smithi194.stdout:(25/174): rbd-fuse-19.0.0-1848.g8b896a9e.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-07T10:18:01.103 INFO:teuthology.orchestra.run.smithi196.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 198 kB/s | 20 kB 00:00 2024-03-07T10:18:01.357 INFO:teuthology.orchestra.run.smithi194.stdout:(26/174): rbd-mirror-19.0.0-1848.g8b896a9e.el9. 9.8 MB/s | 3.1 MB 00:00 2024-03-07T10:18:01.516 INFO:teuthology.orchestra.run.smithi194.stdout:(27/174): ceph-radosgw-19.0.0-1848.g8b896a9e.el 2.8 MB/s | 9.8 MB 00:03 2024-03-07T10:18:01.549 INFO:teuthology.orchestra.run.smithi194.stdout:(28/174): rbd-nbd-19.0.0-1848.g8b896a9e.el9.x86 894 kB/s | 170 kB 00:00 2024-03-07T10:18:01.616 INFO:teuthology.orchestra.run.smithi194.stdout:(29/174): ceph-grafana-dashboards-19.0.0-1848.g 317 kB/s | 31 kB 00:00 2024-03-07T10:18:01.650 INFO:teuthology.orchestra.run.smithi194.stdout:(30/174): ceph-mgr-cephadm-19.0.0-1848.g8b896a9 1.4 MB/s | 138 kB 00:00 2024-03-07T10:18:02.225 INFO:teuthology.orchestra.run.smithi194.stdout:(31/174): ceph-test-19.0.0-1848.g8b896a9e.el9.x 13 MB/s | 47 MB 00:03 2024-03-07T10:18:02.325 INFO:teuthology.orchestra.run.smithi194.stdout:(32/174): ceph-mgr-dashboard-19.0.0-1848.g8b896 2.5 MB/s | 1.8 MB 00:00 2024-03-07T10:18:02.359 INFO:teuthology.orchestra.run.smithi194.stdout:(33/174): ceph-mgr-modules-core-19.0.0-1848.g8b 1.8 MB/s | 248 kB 00:00 2024-03-07T10:18:02.392 INFO:teuthology.orchestra.run.smithi194.stdout:(34/174): ceph-mgr-rook-19.0.0-1848.g8b896a9e.e 749 kB/s | 49 kB 00:00 2024-03-07T10:18:02.418 INFO:teuthology.orchestra.run.smithi194.stdout:(35/174): ceph-prometheus-alerts-19.0.0-1848.g8 285 kB/s | 16 kB 00:00 2024-03-07T10:18:02.437 INFO:teuthology.orchestra.run.smithi196.stdout:(130/174): python3-kubernetes-26.1.0-2.el9.noar 784 kB/s | 1.0 MB 00:01 2024-03-07T10:18:02.502 INFO:teuthology.orchestra.run.smithi194.stdout:(36/174): cephadm-19.0.0-1848.g8b896a9e.el9.noa 8.8 MB/s | 748 kB 00:00 2024-03-07T10:18:02.546 INFO:teuthology.orchestra.run.smithi196.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 431 kB/s | 46 kB 00:00 2024-03-07T10:18:02.560 INFO:teuthology.orchestra.run.smithi194.stdout:(37/174): ceph-volume-19.0.0-1848.g8b896a9e.el9 1.5 MB/s | 264 kB 00:00 2024-03-07T10:18:02.588 INFO:teuthology.orchestra.run.smithi194.stdout:(38/174): cephfs-top-19.0.0-1848.g8b896a9e.el9. 220 kB/s | 18 kB 00:00 2024-03-07T10:18:02.687 INFO:teuthology.orchestra.run.smithi196.stdout:(132/174): python3-grpcio-1.46.7-10.el9.x86_64. 767 kB/s | 2.0 MB 00:02 2024-03-07T10:18:02.713 INFO:teuthology.orchestra.run.smithi196.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 473 kB/s | 79 kB 00:00 2024-03-07T10:18:02.777 INFO:teuthology.orchestra.run.smithi194.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 6.6 MB/s | 7.4 MB 00:01 2024-03-07T10:18:02.791 INFO:teuthology.orchestra.run.smithi196.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2024-03-07T10:18:02.819 INFO:teuthology.orchestra.run.smithi194.stdout:(40/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 68 kB/s | 18 kB 00:00 2024-03-07T10:18:02.888 INFO:teuthology.orchestra.run.smithi196.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 165 kB/s | 16 kB 00:00 2024-03-07T10:18:03.020 INFO:teuthology.orchestra.run.smithi194.stdout:(41/174): fuse-2.9.9-15.el9.x86_64.rpm 185 kB/s | 80 kB 00:00 2024-03-07T10:18:03.089 INFO:teuthology.orchestra.run.smithi196.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 726 kB/s | 272 kB 00:00 2024-03-07T10:18:03.106 INFO:teuthology.orchestra.run.smithi196.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 416 kB/s | 90 kB 00:00 2024-03-07T10:18:03.200 INFO:teuthology.orchestra.run.smithi196.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-03-07T10:18:03.222 INFO:teuthology.orchestra.run.smithi196.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 264 kB/s | 31 kB 00:00 2024-03-07T10:18:03.323 INFO:teuthology.orchestra.run.smithi196.stdout:(140/174): libarrow-9.0.0-10.el9.x86_64.rpm 734 kB/s | 4.4 MB 00:06 2024-03-07T10:18:03.323 INFO:teuthology.orchestra.run.smithi194.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 646 kB/s | 195 kB 00:00 2024-03-07T10:18:03.348 INFO:teuthology.orchestra.run.smithi196.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2024-03-07T10:18:03.353 INFO:teuthology.orchestra.run.smithi194.stdout:(43/174): jq-1.6-16.el9.x86_64.rpm 327 kB/s | 187 kB 00:00 2024-03-07T10:18:03.437 INFO:teuthology.orchestra.run.smithi194.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.9 MB/s | 218 kB 00:00 2024-03-07T10:18:03.440 INFO:teuthology.orchestra.run.smithi196.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 308 kB/s | 36 kB 00:00 2024-03-07T10:18:03.465 INFO:teuthology.orchestra.run.smithi196.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 439 kB/s | 51 kB 00:00 2024-03-07T10:18:03.521 INFO:teuthology.orchestra.run.smithi194.stdout:(45/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 803 kB 00:00 2024-03-07T10:18:03.533 INFO:teuthology.orchestra.run.smithi196.stdout:(144/174): python3-routes-2.5.1-5.el9.noarch.rp 565 kB/s | 188 kB 00:00 2024-03-07T10:18:03.554 INFO:teuthology.orchestra.run.smithi194.stdout:(46/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-03-07T10:18:03.630 INFO:teuthology.orchestra.run.smithi194.stdout:(47/174): python3-ply-3.11-14.el9.noarch.rpm 990 kB/s | 106 kB 00:00 2024-03-07T10:18:03.650 INFO:teuthology.orchestra.run.smithi196.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 490 kB/s | 90 kB 00:00 2024-03-07T10:18:03.663 INFO:teuthology.orchestra.run.smithi194.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-03-07T10:18:03.747 INFO:teuthology.orchestra.run.smithi194.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.0 MB/s | 125 kB 00:00 2024-03-07T10:18:03.766 INFO:teuthology.orchestra.run.smithi196.stdout:(146/174): python3-zc-lockfile-2.0-10.el9.noarc 172 kB/s | 20 kB 00:00 2024-03-07T10:18:03.789 INFO:teuthology.orchestra.run.smithi194.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-03-07T10:18:03.808 INFO:teuthology.orchestra.run.smithi196.stdout:(147/174): python3-webob-1.8.7-6.el9.noarch.rpm 626 kB/s | 230 kB 00:00 2024-03-07T10:18:03.839 INFO:teuthology.orchestra.run.smithi194.stdout:(51/174): python3-cryptography-36.0.1-4.el9.x86 3.1 MB/s | 1.2 MB 00:00 2024-03-07T10:18:04.067 INFO:teuthology.orchestra.run.smithi196.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 639 kB/s | 192 kB 00:00 2024-03-07T10:18:04.200 INFO:teuthology.orchestra.run.smithi196.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 640 kB/s | 427 kB 00:00 2024-03-07T10:18:04.273 INFO:teuthology.orchestra.run.smithi194.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 247 kB/s | 107 kB 00:00 2024-03-07T10:18:04.517 INFO:teuthology.orchestra.run.smithi196.stdout:(150/174): librbd1-19.0.0-1848.g8b896a9e.el9.x8 9.9 MB/s | 3.1 MB 00:00 2024-03-07T10:18:04.540 INFO:teuthology.orchestra.run.smithi194.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 81 kB/s | 21 kB 00:00 2024-03-07T10:18:04.784 INFO:teuthology.orchestra.run.smithi196.stdout:(151/174): librados2-19.0.0-1848.g8b896a9e.el9. 4.7 MB/s | 3.4 MB 00:00 2024-03-07T10:18:04.860 INFO:teuthology.orchestra.run.smithi196.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 6.7 MB/s | 2.3 MB 00:00 2024-03-07T10:18:04.902 INFO:teuthology.orchestra.run.smithi196.stdout:(153/174): NetworkManager-team-1.46.0-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-03-07T10:18:04.952 INFO:teuthology.orchestra.run.smithi196.stdout:(154/174): NetworkManager-tui-1.46.0-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-03-07T10:18:05.002 INFO:teuthology.orchestra.run.smithi196.stdout:(155/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-07T10:18:05.015 INFO:teuthology.orchestra.run.smithi194.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 544 kB/s | 689 kB 00:01 2024-03-07T10:18:05.047 INFO:teuthology.orchestra.run.smithi196.stdout:(156/174): elfutils-debuginfod-client-0.190-2.e 823 kB/s | 36 kB 00:00 2024-03-07T10:18:05.097 INFO:teuthology.orchestra.run.smithi196.stdout:(157/174): NetworkManager-libnm-1.46.0-1.el9.x8 5.8 MB/s | 1.8 MB 00:00 2024-03-07T10:18:05.131 INFO:teuthology.orchestra.run.smithi196.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-07T10:18:05.165 INFO:teuthology.orchestra.run.smithi196.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-03-07T10:18:05.174 INFO:teuthology.orchestra.run.smithi194.stdout:(55/174): bison-3.7.4-5.el9.x86_64.rpm 681 kB/s | 943 kB 00:01 2024-03-07T10:18:05.190 INFO:teuthology.orchestra.run.smithi196.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 396 kB/s | 23 kB 00:00 2024-03-07T10:18:05.207 INFO:teuthology.orchestra.run.smithi194.stdout:(56/174): flex-2.6.4-9.el9.x86_64.rpm 470 kB/s | 313 kB 00:00 2024-03-07T10:18:05.215 INFO:teuthology.orchestra.run.smithi196.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-07T10:18:05.249 INFO:teuthology.orchestra.run.smithi196.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 155 kB 00:00 2024-03-07T10:18:05.266 INFO:teuthology.orchestra.run.smithi196.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 136 kB 00:00 2024-03-07T10:18:05.282 INFO:teuthology.orchestra.run.smithi194.stdout:(57/174): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-03-07T10:18:05.291 INFO:teuthology.orchestra.run.smithi196.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-07T10:18:05.317 INFO:teuthology.orchestra.run.smithi196.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 574 kB/s | 29 kB 00:00 2024-03-07T10:18:05.375 INFO:teuthology.orchestra.run.smithi196.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-03-07T10:18:05.466 INFO:teuthology.orchestra.run.smithi194.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 70 kB/s | 18 kB 00:00 2024-03-07T10:18:05.492 INFO:teuthology.orchestra.run.smithi196.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-03-07T10:18:05.579 INFO:teuthology.orchestra.run.smithi196.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-03-07T10:18:05.618 INFO:teuthology.orchestra.run.smithi196.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.6 MB/s | 465 kB 00:00 2024-03-07T10:18:05.643 INFO:teuthology.orchestra.run.smithi196.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 497 kB/s | 31 kB 00:00 2024-03-07T10:18:05.676 INFO:teuthology.orchestra.run.smithi196.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 323 kB 00:00 2024-03-07T10:18:05.727 INFO:teuthology.orchestra.run.smithi196.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-07T10:18:05.752 INFO:teuthology.orchestra.run.smithi196.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 998 kB/s | 74 kB 00:00 2024-03-07T10:18:05.775 INFO:teuthology.orchestra.run.smithi194.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 326 kB/s | 160 kB 00:00 2024-03-07T10:18:05.808 INFO:teuthology.orchestra.run.smithi194.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-03-07T10:18:05.977 INFO:teuthology.orchestra.run.smithi196.stdout:(174/174): thrift-0.15.0-2.el9.x86_64.rpm 747 kB/s | 1.6 MB 00:02 2024-03-07T10:18:05.989 INFO:teuthology.orchestra.run.smithi196.stdout:-------------------------------------------------------------------------------- 2024-03-07T10:18:05.990 INFO:teuthology.orchestra.run.smithi196.stdout:Total 11 MB/s | 226 MB 00:21 2024-03-07T10:18:06.750 INFO:teuthology.orchestra.run.smithi194.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 680 kB/s | 662 kB 00:00 2024-03-07T10:18:06.934 INFO:teuthology.orchestra.run.smithi194.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 518 kB/s | 582 kB 00:01 2024-03-07T10:18:07.017 INFO:teuthology.orchestra.run.smithi194.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 96 kB/s | 25 kB 00:00 2024-03-07T10:18:07.284 INFO:teuthology.orchestra.run.smithi194.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 136 kB/s | 47 kB 00:00 2024-03-07T10:18:07.451 INFO:teuthology.orchestra.run.smithi194.stdout:(65/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.3 MB/s | 3.0 MB 00:02 2024-03-07T10:18:07.693 INFO:teuthology.orchestra.run.smithi194.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 433 kB/s | 292 kB 00:00 2024-03-07T10:18:07.718 INFO:teuthology.orchestra.run.smithi194.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 132 kB/s | 35 kB 00:00 2024-03-07T10:18:07.869 INFO:teuthology.orchestra.run.smithi194.stdout:(68/174): lua-5.4.4-4.el9.x86_64.rpm 323 kB/s | 188 kB 00:00 2024-03-07T10:18:09.577 INFO:teuthology.orchestra.run.smithi194.stdout:(69/174): postgresql-13.11-1.el9.x86_64.rpm 949 kB/s | 1.6 MB 00:01 2024-03-07T10:18:09.782 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction check 2024-03-07T10:18:10.166 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction check succeeded. 2024-03-07T10:18:10.166 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction test 2024-03-07T10:18:10.877 INFO:teuthology.orchestra.run.smithi194.stdout:(70/174): openblas-openmp-0.3.21-2.el9.x86_64.r 1.5 MB/s | 4.7 MB 00:03 2024-03-07T10:18:10.970 INFO:teuthology.orchestra.run.smithi194.stdout:(71/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 1.3 MB/s | 4.1 MB 00:03 2024-03-07T10:18:11.041 INFO:teuthology.orchestra.run.smithi194.stdout:(72/174): postgresql-contrib-13.11-1.el9.x86_64 619 kB/s | 905 kB 00:01 2024-03-07T10:18:11.427 INFO:teuthology.orchestra.run.smithi194.stdout:(73/174): postgresql-private-libs-13.11-1.el9.x 246 kB/s | 135 kB 00:00 2024-03-07T10:18:11.853 INFO:teuthology.orchestra.run.smithi194.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 206 kB/s | 87 kB 00:00 2024-03-07T10:18:12.328 INFO:teuthology.orchestra.run.smithi194.stdout:(75/174): protobuf-3.14.0-13.el9.x86_64.rpm 803 kB/s | 1.0 MB 00:01 2024-03-07T10:18:12.609 INFO:teuthology.orchestra.run.smithi196.stdout:Transaction test succeeded. 2024-03-07T10:18:12.610 INFO:teuthology.orchestra.run.smithi196.stdout:Running transaction 2024-03-07T10:18:12.903 INFO:teuthology.orchestra.run.smithi194.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 427 kB/s | 245 kB 00:00 2024-03-07T10:18:13.304 INFO:teuthology.orchestra.run.smithi194.stdout:(77/174): postgresql-server-13.11-1.el9.x86_64. 2.5 MB/s | 5.7 MB 00:02 2024-03-07T10:18:13.554 INFO:teuthology.orchestra.run.smithi194.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 382 kB/s | 248 kB 00:00 2024-03-07T10:18:13.588 INFO:teuthology.orchestra.run.smithi194.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 91 kB/s | 26 kB 00:00 2024-03-07T10:18:13.821 INFO:teuthology.orchestra.run.smithi194.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 72 kB/s | 19 kB 00:00 2024-03-07T10:18:14.088 INFO:teuthology.orchestra.run.smithi194.stdout:(81/174): python3-markupsafe-1.1.1-12.el9.x86_6 131 kB/s | 35 kB 00:00 2024-03-07T10:18:14.164 INFO:teuthology.orchestra.run.smithi194.stdout:(82/174): python3-mako-1.1.4-6.el9.noarch.rpm 299 kB/s | 172 kB 00:00 2024-03-07T10:18:14.672 INFO:teuthology.orchestra.run.smithi194.stdout:(83/174): python3-babel-2.9.1-2.el9.noarch.rpm 2.1 MB/s | 6.0 MB 00:02 2024-03-07T10:18:14.789 INFO:teuthology.orchestra.run.smithi194.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 401 kB/s | 250 kB 00:00 2024-03-07T10:18:15.139 INFO:teuthology.orchestra.run.smithi194.stdout:(85/174): python3-packaging-20.9-5.el9.noarch.r 221 kB/s | 77 kB 00:00 2024-03-07T10:18:15.331 INFO:teuthology.orchestra.run.smithi194.stdout:(86/174): python3-oauthlib-3.1.1-5.el9.noarch.r 338 kB/s | 222 kB 00:00 2024-03-07T10:18:15.482 INFO:teuthology.orchestra.run.smithi194.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 124 kB/s | 42 kB 00:00 2024-03-07T10:18:15.907 INFO:teuthology.orchestra.run.smithi194.stdout:(88/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 374 kB/s | 159 kB 00:00 2024-03-07T10:18:15.932 INFO:teuthology.orchestra.run.smithi194.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 448 kB/s | 269 kB 00:00 2024-03-07T10:18:16.274 INFO:teuthology.orchestra.run.smithi194.stdout:(90/174): python3-pytz-2021.1-5.el9.noarch.rpm 150 kB/s | 51 kB 00:00 2024-03-07T10:18:16.491 INFO:teuthology.orchestra.run.smithi194.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 478 kB/s | 279 kB 00:00 2024-03-07T10:18:16.625 INFO:teuthology.orchestra.run.smithi194.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 153 kB/s | 54 kB 00:00 2024-03-07T10:18:16.892 INFO:teuthology.orchestra.run.smithi194.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 157 kB/s | 42 kB 00:00 2024-03-07T10:18:17.242 INFO:teuthology.orchestra.run.smithi194.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 126 kB/s | 44 kB 00:00 2024-03-07T10:18:17.734 INFO:teuthology.orchestra.run.smithi194.stdout:(95/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.4 MB/s | 5.1 MB 00:03 2024-03-07T10:18:17.767 INFO:teuthology.orchestra.run.smithi194.stdout:(96/174): qatlib-23.11.0-1.el9.x86_64.rpm 413 kB/s | 216 kB 00:00 2024-03-07T10:18:18.001 INFO:teuthology.orchestra.run.smithi194.stdout:(97/174): qatlib-service-23.11.0-1.el9.x86_64.r 131 kB/s | 35 kB 00:00 2024-03-07T10:18:18.109 INFO:teuthology.orchestra.run.smithi194.stdout:(98/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 130 kB/s | 44 kB 00:00 2024-03-07T10:18:18.468 INFO:teuthology.orchestra.run.smithi194.stdout:(99/174): uuid-1.6.2-55.el9.x86_64.rpm 162 kB/s | 58 kB 00:00 2024-03-07T10:18:18.660 INFO:teuthology.orchestra.run.smithi194.stdout:(100/174): socat-1.7.4.1-5.el9.x86_64.rpm 463 kB/s | 305 kB 00:00 2024-03-07T10:18:18.894 INFO:teuthology.orchestra.run.smithi194.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 221 kB/s | 94 kB 00:00 2024-03-07T10:18:19.010 INFO:teuthology.orchestra.run.smithi194.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 182 kB/s | 64 kB 00:00 2024-03-07T10:18:19.236 INFO:teuthology.orchestra.run.smithi194.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 132 kB/s | 45 kB 00:00 2024-03-07T10:18:19.369 INFO:teuthology.orchestra.run.smithi194.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 62 kB/s | 22 kB 00:00 2024-03-07T10:18:20.044 INFO:teuthology.orchestra.run.smithi196.stdout: Preparing : 1/1 2024-03-07T10:18:20.111 INFO:teuthology.orchestra.run.smithi194.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 987 kB/s | 863 kB 00:00 2024-03-07T10:18:20.159 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-07T10:18:20.207 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-07T10:18:20.253 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-07T10:18:20.298 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-07T10:18:20.361 INFO:teuthology.orchestra.run.smithi194.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.2 MB/s | 309 kB 00:00 2024-03-07T10:18:20.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-07T10:18:20.412 INFO:teuthology.orchestra.run.smithi194.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 394 kB/s | 19 kB 00:00 2024-03-07T10:18:20.489 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-07T10:18:20.544 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-07T10:18:20.585 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-07T10:18:20.683 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-07T10:18:21.107 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-07T10:18:21.142 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:18:21.300 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:18:21.320 INFO:teuthology.orchestra.run.smithi194.stdout:(108/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.4 MB/s | 16 MB 00:04 2024-03-07T10:18:21.335 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:18:21.457 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:18:21.504 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 12/198 2024-03-07T10:18:21.567 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-07T10:18:21.604 INFO:teuthology.orchestra.run.smithi194.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 245 kB/s | 548 kB 00:02 2024-03-07T10:18:21.638 INFO:teuthology.orchestra.run.smithi194.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 83 kB/s | 26 kB 00:00 2024-03-07T10:18:21.679 INFO:teuthology.orchestra.run.smithi194.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 716 kB/s | 49 kB 00:00 2024-03-07T10:18:21.722 INFO:teuthology.orchestra.run.smithi194.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 828 kB/s | 67 kB 00:00 2024-03-07T10:18:21.847 INFO:teuthology.orchestra.run.smithi194.stdout:(113/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-03-07T10:18:21.853 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-07T10:18:21.874 INFO:teuthology.orchestra.run.smithi194.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 799 kB/s | 151 kB 00:00 2024-03-07T10:18:21.908 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-07T10:18:21.934 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:18:22.076 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:18:22.110 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 17/198 2024-03-07T10:18:22.191 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 17/198 2024-03-07T10:18:22.245 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-07T10:18:22.270 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-07T10:18:22.335 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-07T10:18:22.632 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-07T10:18:22.679 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-07T10:18:22.728 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-07T10:18:22.798 INFO:teuthology.orchestra.run.smithi194.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 47 kB/s | 43 kB 00:00 2024-03-07T10:18:23.084 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-07T10:18:23.124 INFO:teuthology.orchestra.run.smithi194.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 99 kB/s | 32 kB 00:00 2024-03-07T10:18:23.157 INFO:teuthology.orchestra.run.smithi194.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 585 kB/s | 838 kB 00:01 2024-03-07T10:18:23.253 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-07T10:18:23.291 INFO:teuthology.orchestra.run.smithi194.stdout:(118/174): python3-asyncssh-2.13.2-4.el9.noarch 380 kB/s | 548 kB 00:01 2024-03-07T10:18:23.308 INFO:teuthology.orchestra.run.smithi194.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 82 kB/s | 15 kB 00:00 2024-03-07T10:18:23.325 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-07T10:18:23.383 INFO:teuthology.orchestra.run.smithi194.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 765 kB/s | 172 kB 00:00 2024-03-07T10:18:23.542 INFO:teuthology.orchestra.run.smithi194.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-03-07T10:18:23.600 INFO:teuthology.orchestra.run.smithi194.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 163 kB/s | 35 kB 00:00 2024-03-07T10:18:23.692 INFO:teuthology.orchestra.run.smithi194.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 790 kB/s | 303 kB 00:00 2024-03-07T10:18:23.707 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:23.809 INFO:teuthology.orchestra.run.smithi194.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 761 kB/s | 203 kB 00:00 2024-03-07T10:18:23.906 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:24.260 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:24.470 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-07T10:18:24.552 INFO:teuthology.orchestra.run.smithi194.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 14 kB/s | 11 kB 00:00 2024-03-07T10:18:24.592 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-07T10:18:24.636 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-07T10:18:24.685 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-07T10:18:24.709 INFO:teuthology.orchestra.run.smithi194.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 142 kB/s | 144 kB 00:01 2024-03-07T10:18:24.789 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-03-07T10:18:24.832 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-03-07T10:18:24.894 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-03-07T10:18:24.936 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-03-07T10:18:24.960 INFO:teuthology.orchestra.run.smithi194.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 43 kB/s | 18 kB 00:00 2024-03-07T10:18:24.967 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-03-07T10:18:24.977 INFO:teuthology.orchestra.run.smithi194.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 87 kB/s | 23 kB 00:00 2024-03-07T10:18:25.081 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-03-07T10:18:25.155 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-03-07T10:18:25.192 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-03-07T10:18:25.219 INFO:teuthology.orchestra.run.smithi194.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 75 kB/s | 19 kB 00:00 2024-03-07T10:18:25.235 INFO:teuthology.orchestra.run.smithi194.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 76 kB/s | 20 kB 00:00 2024-03-07T10:18:25.254 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-03-07T10:18:25.361 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-03-07T10:18:25.398 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9. 39/198 2024-03-07T10:18:25.452 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el 40/198 2024-03-07T10:18:25.486 INFO:teuthology.orchestra.run.smithi194.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 186 kB/s | 46 kB 00:00 2024-03-07T10:18:25.488 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_6 41/198 2024-03-07T10:18:25.606 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-07T10:18:25.611 INFO:teuthology.orchestra.run.smithi194.stdout:(132/174): python3-grpcio-1.46.7-10.el9.x86_64. 1.0 MB/s | 2.0 MB 00:02 2024-03-07T10:18:25.659 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-07T10:18:25.758 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-07T10:18:25.761 INFO:teuthology.orchestra.run.smithi194.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 287 kB/s | 79 kB 00:00 2024-03-07T10:18:25.778 INFO:teuthology.orchestra.run.smithi194.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 348 kB/s | 58 kB 00:00 2024-03-07T10:18:25.930 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-07T10:18:25.962 INFO:teuthology.orchestra.run.smithi194.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 90 kB/s | 16 kB 00:00 2024-03-07T10:18:25.995 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-07T10:18:26.038 INFO:teuthology.orchestra.run.smithi194.stdout:(136/174): python3-kubernetes-26.1.0-2.el9.noar 1.3 MB/s | 1.0 MB 00:00 2024-03-07T10:18:26.104 INFO:teuthology.orchestra.run.smithi194.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 798 kB/s | 272 kB 00:00 2024-03-07T10:18:26.129 INFO:teuthology.orchestra.run.smithi194.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 542 kB/s | 90 kB 00:00 2024-03-07T10:18:26.154 INFO:teuthology.orchestra.run.smithi194.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 246 kB/s | 28 kB 00:00 2024-03-07T10:18:26.180 INFO:teuthology.orchestra.run.smithi194.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 415 kB/s | 31 kB 00:00 2024-03-07T10:18:26.255 INFO:teuthology.orchestra.run.smithi194.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-07T10:18:26.280 INFO:teuthology.orchestra.run.smithi194.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 599 kB/s | 59 kB 00:00 2024-03-07T10:18:26.306 INFO:teuthology.orchestra.run.smithi194.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 289 kB/s | 36 kB 00:00 2024-03-07T10:18:26.331 INFO:teuthology.orchestra.run.smithi194.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 688 kB/s | 51 kB 00:00 2024-03-07T10:18:26.398 INFO:teuthology.orchestra.run.smithi194.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-03-07T10:18:26.440 INFO:teuthology.orchestra.run.smithi194.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 678 kB/s | 90 kB 00:00 2024-03-07T10:18:26.649 INFO:teuthology.orchestra.run.smithi194.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-03-07T10:18:26.674 INFO:teuthology.orchestra.run.smithi194.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 73 kB/s | 20 kB 00:00 2024-03-07T10:18:26.682 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-07T10:18:26.700 INFO:teuthology.orchestra.run.smithi194.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 744 kB/s | 192 kB 00:00 2024-03-07T10:18:26.800 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-07T10:18:26.932 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-07T10:18:26.993 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-07T10:18:27.007 INFO:teuthology.orchestra.run.smithi194.stdout:(150/174): librbd1-19.0.0-1848.g8b896a9e.el9.x8 10 MB/s | 3.1 MB 00:00 2024-03-07T10:18:27.019 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-07T10:18:27.058 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-07T10:18:27.142 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-07T10:18:27.166 INFO:teuthology.orchestra.run.smithi194.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-03-07T10:18:27.194 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_6 53/198 2024-03-07T10:18:27.242 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-07T10:18:27.625 INFO:teuthology.orchestra.run.smithi194.stdout:(152/174): librados2-19.0.0-1848.g8b896a9e.el9. 3.6 MB/s | 3.4 MB 00:00 2024-03-07T10:18:27.640 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-07T10:18:27.896 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-07T10:18:28.008 INFO:teuthology.orchestra.run.smithi194.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:00 2024-03-07T10:18:28.023 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-07T10:18:28.033 INFO:teuthology.orchestra.run.smithi194.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 104 kB/s | 42 kB 00:00 2024-03-07T10:18:28.082 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-07T10:18:28.125 INFO:teuthology.orchestra.run.smithi194.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 2.1 MB/s | 248 kB 00:00 2024-03-07T10:18:28.176 INFO:teuthology.orchestra.run.smithi194.stdout:(156/174): NetworkManager-libnm-1.46.0-1.el9.x8 1.8 MB/s | 1.8 MB 00:01 2024-03-07T10:18:28.217 INFO:teuthology.orchestra.run.smithi194.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 390 kB/s | 71 kB 00:00 2024-03-07T10:18:28.243 INFO:teuthology.orchestra.run.smithi194.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 313 kB/s | 36 kB 00:00 2024-03-07T10:18:28.285 INFO:teuthology.orchestra.run.smithi194.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.7 MB/s | 192 kB 00:00 2024-03-07T10:18:28.297 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-07T10:18:28.352 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-07T10:18:28.385 INFO:teuthology.orchestra.run.smithi194.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 163 kB/s | 23 kB 00:00 2024-03-07T10:18:28.410 INFO:teuthology.orchestra.run.smithi194.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 869 kB/s | 108 kB 00:00 2024-03-07T10:18:28.431 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-07T10:18:28.435 INFO:teuthology.orchestra.run.smithi194.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.1 MB/s | 256 kB 00:00 2024-03-07T10:18:28.503 INFO:teuthology.orchestra.run.smithi194.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 155 kB 00:00 2024-03-07T10:18:28.524 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-07T10:18:28.536 INFO:teuthology.orchestra.run.smithi194.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-07T10:18:28.560 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-07T10:18:28.561 INFO:teuthology.orchestra.run.smithi194.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 510 kB/s | 64 kB 00:00 2024-03-07T10:18:28.599 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-07T10:18:28.612 INFO:teuthology.orchestra.run.smithi194.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 266 kB/s | 29 kB 00:00 2024-03-07T10:18:28.665 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-07T10:18:28.679 INFO:teuthology.orchestra.run.smithi194.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 8.6 MB/s | 1.2 MB 00:00 2024-03-07T10:18:28.716 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-07T10:18:28.779 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-07T10:18:28.804 INFO:teuthology.orchestra.run.smithi194.stdout:(168/174): util-linux-core-2.37.4-18.el9.x86_64 3.7 MB/s | 465 kB 00:00 2024-03-07T10:18:28.845 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-07T10:18:28.912 INFO:teuthology.orchestra.run.smithi194.stdout:(169/174): util-linux-user-2.37.4-18.el9.x86_64 289 kB/s | 31 kB 00:00 2024-03-07T10:18:29.030 INFO:teuthology.orchestra.run.smithi194.stdout:(170/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-03-07T10:18:29.033 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-07T10:18:29.081 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi194.stdout:(171/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 3.9 MB/s | 2.2 MB 00:00 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi194.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.6 MB/s | 1.1 MB 00:00 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi194.stdout:(173/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.7 MB/s | 2.3 MB 00:00 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-07T10:18:29.402 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-07T10:18:29.405 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-07T10:18:29.441 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-07T10:18:29.475 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-07T10:18:29.580 INFO:teuthology.orchestra.run.smithi194.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 161 kB/s | 74 kB 00:00 2024-03-07T10:18:29.592 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-03-07T10:18:29.593 INFO:teuthology.orchestra.run.smithi194.stdout:Total 6.6 MB/s | 226 MB 00:34 2024-03-07T10:18:29.631 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-07T10:18:29.805 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-07T10:18:29.848 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-07T10:18:29.884 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-07T10:18:29.921 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-03-07T10:18:29.978 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-07T10:18:30.025 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-03-07T10:18:30.068 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-03-07T10:18:30.112 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-03-07T10:18:30.183 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-03-07T10:18:30.258 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-03-07T10:18:30.304 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-03-07T10:18:30.448 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-03-07T10:18:30.506 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-03-07T10:18:30.543 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-03-07T10:18:30.602 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-03-07T10:18:30.748 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-03-07T10:18:30.807 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-03-07T10:18:31.781 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-03-07T10:18:31.833 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-03-07T10:18:31.867 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-03-07T10:18:31.989 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-03-07T10:18:32.045 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-03-07T10:18:32.139 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-03-07T10:18:32.203 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-03-07T10:18:32.429 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-03-07T10:18:32.465 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-03-07T10:18:32.565 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-03-07T10:18:33.353 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-03-07T10:18:33.361 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-03-07T10:18:33.493 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-03-07T10:18:33.747 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-03-07T10:18:33.747 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-03-07T10:18:35.029 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-03-07T10:18:35.114 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-03-07T10:18:35.147 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-03-07T10:18:35.498 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-03-07T10:18:35.525 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 112/198 2024-03-07T10:18:35.645 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 112/198 2024-03-07T10:18:35.673 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 113/198 2024-03-07T10:18:35.726 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-03-07T10:18:36.181 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-03-07T10:18:36.181 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-03-07T10:18:36.227 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-07T10:18:36.262 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 116/198 2024-03-07T10:18:36.361 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 116/198 2024-03-07T10:18:36.388 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 117/198 2024-03-07T10:18:38.959 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:18:38.995 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:18:39.630 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:18:39.682 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 119/198 2024-03-07T10:18:39.831 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 119/198 2024-03-07T10:18:39.832 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-07T10:18:39.832 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-07T10:18:39.832 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:39.874 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 120/198 2024-03-07T10:18:43.676 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-03-07T10:18:43.804 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-07T10:18:43.852 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-07T10:18:43.890 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-07T10:18:43.935 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-07T10:18:44.025 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-07T10:18:44.134 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-07T10:18:44.189 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-07T10:18:44.221 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-07T10:18:44.309 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-07T10:18:44.698 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-07T10:18:44.736 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:18:44.882 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:18:44.929 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:18:45.051 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:18:45.092 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 12/198 2024-03-07T10:18:45.155 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-07T10:18:45.447 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-07T10:18:45.500 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-07T10:18:45.527 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:18:45.673 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:18:45.704 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 17/198 2024-03-07T10:18:45.793 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 17/198 2024-03-07T10:18:45.839 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-07T10:18:45.872 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-07T10:18:45.933 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-07T10:18:46.248 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-07T10:18:46.297 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-07T10:18:46.347 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-07T10:18:46.715 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-07T10:18:46.905 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-07T10:18:47.001 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-07T10:18:47.213 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:47.291 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:47.611 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-07T10:18:47.804 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-07T10:18:47.921 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-07T10:18:47.963 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-07T10:18:48.010 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-07T10:18:48.135 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-03-07T10:18:48.194 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-03-07T10:18:48.266 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-03-07T10:18:48.315 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-03-07T10:18:48.361 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-03-07T10:18:48.482 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-03-07T10:18:48.556 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-03-07T10:18:48.596 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-03-07T10:18:48.653 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-03-07T10:18:48.761 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-03-07T10:18:48.799 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9. 39/198 2024-03-07T10:18:48.865 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el 40/198 2024-03-07T10:18:48.898 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_6 41/198 2024-03-07T10:18:49.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-07T10:18:49.076 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-07T10:18:49.175 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-07T10:18:49.385 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-07T10:18:49.445 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-07T10:18:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-07T10:18:50.245 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-07T10:18:50.367 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-07T10:18:50.451 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-07T10:18:50.479 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-07T10:18:50.528 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-07T10:18:50.617 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-07T10:18:50.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_6 53/198 2024-03-07T10:18:50.730 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-07T10:18:51.152 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-07T10:18:51.388 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-07T10:18:51.473 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-07T10:18:51.569 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-07T10:18:51.790 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-07T10:18:51.843 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-07T10:18:51.922 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-07T10:18:52.022 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-07T10:18:52.060 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-07T10:18:52.107 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-07T10:18:52.182 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-07T10:18:52.224 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-07T10:18:52.287 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-07T10:18:52.352 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-07T10:18:52.373 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 120/198 2024-03-07T10:18:52.373 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /sys 2024-03-07T10:18:52.373 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /proc 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /mnt 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /var/tmp 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /home 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /root 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout:skipping the directory /tmp 2024-03-07T10:18:52.374 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:52.543 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-07T10:18:52.586 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 121/198 2024-03-07T10:18:52.587 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-07T10:18:52.625 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-07T10:18:52.632 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 121/198 2024-03-07T10:18:52.632 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:18:52.632 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-07T10:18:52.632 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:52.702 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-07T10:18:52.842 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-07T10:18:52.891 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-07T10:18:52.937 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-07T10:18:52.974 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-07T10:18:53.007 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-07T10:18:53.194 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-07T10:18:53.376 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-07T10:18:53.419 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-07T10:18:53.483 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-07T10:18:53.520 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-03-07T10:18:53.577 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-07T10:18:53.632 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-03-07T10:18:53.672 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-03-07T10:18:53.718 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-03-07T10:18:53.775 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-03-07T10:18:53.843 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-03-07T10:18:53.891 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-03-07T10:18:54.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-03-07T10:18:54.094 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-03-07T10:18:54.140 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-03-07T10:18:54.201 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-03-07T10:18:54.263 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 122/198 2024-03-07T10:18:54.343 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 122/198 2024-03-07T10:18:54.344 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:18:54.344 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-07T10:18:54.344 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-07T10:18:54.344 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-07T10:18:54.344 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:54.366 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-03-07T10:18:54.428 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-03-07T10:18:54.589 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 123/198 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 123/198 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-07T10:18:54.683 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:55.182 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 124/198 2024-03-07T10:18:55.277 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 124/198 2024-03-07T10:18:55.277 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:18:55.277 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-07T10:18:55.277 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-07T10:18:55.277 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-07T10:18:55.278 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:55.406 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-03-07T10:18:55.407 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-03-07T10:18:55.460 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-03-07T10:18:55.471 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-03-07T10:18:55.502 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-03-07T10:18:55.545 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-03-07T10:18:55.636 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-03-07T10:18:55.705 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-03-07T10:18:55.771 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-03-07T10:18:55.802 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-03-07T10:18:55.827 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-03-07T10:18:55.845 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-03-07T10:18:55.911 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-03-07T10:18:56.012 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-03-07T10:18:56.070 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-03-07T10:18:56.117 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-03-07T10:18:56.197 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-03-07T10:18:56.240 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-03-07T10:18:56.242 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 133/198 2024-03-07T10:18:56.284 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-03-07T10:18:56.316 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-03-07T10:18:56.353 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-03-07T10:18:56.385 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-03-07T10:18:56.992 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 138/198 2024-03-07T10:18:57.031 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 138/198 2024-03-07T10:18:57.032 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-03-07T10:18:57.084 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.e 139/198 2024-03-07T10:18:57.179 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-03-07T10:18:57.196 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e. 140/198 2024-03-07T10:18:57.231 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 141/198 2024-03-07T10:18:57.551 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 141/198 2024-03-07T10:18:57.590 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 142/198 2024-03-07T10:18:58.683 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-03-07T10:18:58.708 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 142/198 2024-03-07T10:18:58.749 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 143/198 2024-03-07T10:18:58.772 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-03-07T10:18:58.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-03-07T10:18:58.892 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 143/198 2024-03-07T10:18:59.064 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el 144/198 2024-03-07T10:18:59.093 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 145/198 2024-03-07T10:18:59.188 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 145/198 2024-03-07T10:18:59.188 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:18:59.189 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-07T10:18:59.189 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-07T10:18:59.189 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-07T10:18:59.189 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:18:59.200 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-03-07T10:18:59.242 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 112/198 2024-03-07T10:18:59.244 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 146/198 2024-03-07T10:18:59.283 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 146/198 2024-03-07T10:18:59.371 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 112/198 2024-03-07T10:18:59.399 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 147/198 2024-03-07T10:18:59.399 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 113/198 2024-03-07T10:18:59.453 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-03-07T10:18:59.956 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-07T10:19:00.012 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 116/198 2024-03-07T10:19:00.103 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 116/198 2024-03-07T10:19:00.131 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 117/198 2024-03-07T10:19:02.700 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:19:02.744 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:19:03.372 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 118/198 2024-03-07T10:19:03.413 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 119/198 2024-03-07T10:19:03.575 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 119/198 2024-03-07T10:19:03.575 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-07T10:19:03.575 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-07T10:19:03.575 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:03.622 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 120/198 2024-03-07T10:19:04.130 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 148/198 2024-03-07T10:19:04.206 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 149/198 2024-03-07T10:19:05.118 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-03-07T10:19:05.151 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-07T10:19:05.221 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:05.277 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1848.g8b896 152/198 2024-03-07T10:19:05.345 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1848.g8b896 152/198 2024-03-07T10:19:05.346 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:05.346 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-07T10:19:05.346 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:05.428 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-07T10:19:05.504 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:05.853 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 154/198 2024-03-07T10:19:05.920 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 154/198 2024-03-07T10:19:05.920 INFO:teuthology.orchestra.run.smithi196.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:05.920 INFO:teuthology.orchestra.run.smithi196.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-07T10:19:05.920 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-07T10:19:05.921 INFO:teuthology.orchestra.run.smithi196.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-07T10:19:05.921 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:05.985 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 155/198 2024-03-07T10:19:06.022 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 156/198 2024-03-07T10:19:06.059 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-03-07T10:19:06.339 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 158/198 2024-03-07T10:19:06.425 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/198 2024-03-07T10:19:06.495 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-07T10:19:06.557 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-07T10:19:06.602 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-07T10:19:06.636 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_ 163/198 2024-03-07T10:19:06.682 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-07T10:19:06.733 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-07T10:19:06.810 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-07T10:19:06.922 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-07T10:19:06.957 INFO:teuthology.orchestra.run.smithi196.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-07T10:19:07.899 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:07.945 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:08.012 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:09.337 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 170/198 2024-03-07T10:19:09.447 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-07T10:19:09.555 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-03-07T10:19:09.594 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-03-07T10:19:09.619 INFO:teuthology.orchestra.run.smithi196.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-03-07T10:19:09.653 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-07T10:19:09.696 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-07T10:19:09.738 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-07T10:19:09.739 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-07T10:19:09.882 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-07T10:19:09.925 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-07T10:19:09.925 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-07T10:19:10.063 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-07T10:19:10.107 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-07T10:19:10.153 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-07T10:19:10.186 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-07T10:19:10.219 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-07T10:19:10.285 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-07T10:19:10.360 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-07T10:19:10.407 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-07T10:19:10.440 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-07T10:19:10.483 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-07T10:19:10.547 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-07T10:19:10.583 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-07T10:19:10.618 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:10.619 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:10.949 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:10.950 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-07T10:19:11.072 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-07T10:19:11.103 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-07T10:19:11.136 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-07T10:19:11.172 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-07T10:19:11.233 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-07T10:19:11.354 INFO:teuthology.orchestra.run.smithi196.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-07T10:19:11.610 INFO:teuthology.orchestra.run.smithi196.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-07T10:19:11.611 INFO:teuthology.orchestra.run.smithi196.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-07T10:19:11.611 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 120/198 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-03-07T10:19:16.056 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-03-07T10:19:16.057 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-03-07T10:19:16.057 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-03-07T10:19:16.057 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:16.257 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 121/198 2024-03-07T10:19:16.309 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 121/198 2024-03-07T10:19:16.310 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:16.310 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-07T10:19:16.310 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 1/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 2/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 3/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 4/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1848.g8b896 5/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 6/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 7/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 8/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 9/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:19:16.538 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 12/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 13/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 14/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_ 15/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 17/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_6 18/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 19/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 20/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el 21/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9. 22/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_6 23/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 24/198 2024-03-07T10:19:16.539 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 25/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 26/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 27/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 28/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 29/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e. 30/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 31/198 2024-03-07T10:19:16.556 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 32/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 33/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el 34/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 35/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.e 36/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 37/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 38/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 39/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-03-07T10:19:16.557 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-03-07T10:19:16.558 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-03-07T10:19:16.559 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-03-07T10:19:16.560 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/198 2024-03-07T10:19:16.561 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-03-07T10:19:16.562 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-03-07T10:19:16.563 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-07T10:19:16.564 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-07T10:19:16.565 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-07T10:19:16.566 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 155/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-07T10:19:16.567 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 157/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 159/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 161/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-03-07T10:19:16.568 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-03-07T10:19:16.569 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-07T10:19:16.570 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-07T10:19:17.914 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 122/198 2024-03-07T10:19:17.998 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 122/198 2024-03-07T10:19:17.998 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:17.998 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-07T10:19:17.998 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-07T10:19:17.998 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-07T10:19:17.999 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:18.260 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 123/198 2024-03-07T10:19:18.329 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 123/198 2024-03-07T10:19:18.330 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:18.330 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-07T10:19:18.330 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-07T10:19:18.330 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-07T10:19:18.330 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:18.836 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 124/198 2024-03-07T10:19:18.905 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 124/198 2024-03-07T10:19:18.905 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:18.905 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-07T10:19:18.905 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-07T10:19:18.906 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-07T10:19:18.906 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:19.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-03-07T10:19:19.097 INFO:teuthology.orchestra.run.smithi196.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-07T10:19:19.097 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:19.097 INFO:teuthology.orchestra.run.smithi196.stdout:Upgraded: 2024-03-07T10:19:19.097 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:19.097 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: acl-2.3.1-4.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.098 INFO:teuthology.orchestra.run.smithi196.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:19.099 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout:Installed: 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: automake-1.16.2-8.el9.noarch 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: bison-3.7.4-5.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.100 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-immutable-object-cache-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.101 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: flex-2.6.4-9.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-07T10:19:19.102 INFO:teuthology.orchestra.run.smithi196.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: jq-1.6-16.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-07T10:19:19.103 INFO:teuthology.orchestra.run.smithi196.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-07T10:19:19.104 INFO:teuthology.orchestra.run.smithi196.stdout: lua-5.4.4-4.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-13.11-1.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-07T10:19:19.105 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-07T10:19:19.106 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-07T10:19:19.107 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-07T10:19:19.108 INFO:teuthology.orchestra.run.smithi196.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-ply-3.11-14.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.109 INFO:teuthology.orchestra.run.smithi196.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-07T10:19:19.110 INFO:teuthology.orchestra.run.smithi196.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.111 INFO:teuthology.orchestra.run.smithi196.stdout: rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: re2-1:20211101-3.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-07T10:19:19.112 INFO:teuthology.orchestra.run.smithi196.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-07T10:19:19.113 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:19.113 INFO:teuthology.orchestra.run.smithi196.stdout:Complete! 2024-03-07T10:19:19.124 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-03-07T10:19:19.207 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-03-07T10:19:19.464 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-03-07T10:19:19.524 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-03-07T10:19:19.616 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-03-07T10:19:19.735 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-03-07T10:19:19.831 DEBUG:teuthology.parallel:result is None 2024-03-07T10:19:19.917 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-03-07T10:19:19.963 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 133/198 2024-03-07T10:19:20.004 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-03-07T10:19:20.036 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-03-07T10:19:20.075 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-03-07T10:19:20.106 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-03-07T10:19:20.802 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 138/198 2024-03-07T10:19:20.851 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 138/198 2024-03-07T10:19:20.905 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.e 139/198 2024-03-07T10:19:21.017 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e. 140/198 2024-03-07T10:19:21.052 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 141/198 2024-03-07T10:19:21.382 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 141/198 2024-03-07T10:19:21.428 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 142/198 2024-03-07T10:19:22.554 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 142/198 2024-03-07T10:19:22.586 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 143/198 2024-03-07T10:19:22.730 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 143/198 2024-03-07T10:19:22.900 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el 144/198 2024-03-07T10:19:22.955 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 145/198 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 145/198 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-07T10:19:23.042 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:23.106 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 146/198 2024-03-07T10:19:23.144 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 146/198 2024-03-07T10:19:23.292 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 147/198 2024-03-07T10:19:28.126 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 148/198 2024-03-07T10:19:28.204 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 149/198 2024-03-07T10:19:29.122 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-03-07T10:19:29.154 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-07T10:19:29.216 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:29.263 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1848.g8b896 152/198 2024-03-07T10:19:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1848.g8b896 152/198 2024-03-07T10:19:29.339 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:29.339 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-07T10:19:29.339 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:29.414 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:29.487 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:29.488 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:29.488 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-07T10:19:29.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-07T10:19:29.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-07T10:19:29.488 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:29.862 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 154/198 2024-03-07T10:19:29.947 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 154/198 2024-03-07T10:19:29.947 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-07T10:19:29.947 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-07T10:19:29.947 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-07T10:19:29.947 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-07T10:19:29.948 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:30.017 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 155/198 2024-03-07T10:19:30.057 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 156/198 2024-03-07T10:19:30.096 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-03-07T10:19:30.393 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 158/198 2024-03-07T10:19:30.467 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 159/198 2024-03-07T10:19:30.531 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-07T10:19:30.597 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-07T10:19:30.685 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-07T10:19:30.722 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_ 163/198 2024-03-07T10:19:30.767 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-07T10:19:30.826 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-07T10:19:30.948 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-07T10:19:31.058 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-07T10:19:31.116 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-07T10:19:32.041 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:32.088 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:32.143 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-07T10:19:33.497 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 170/198 2024-03-07T10:19:33.613 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-07T10:19:33.728 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-03-07T10:19:33.776 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-03-07T10:19:33.802 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-03-07T10:19:33.836 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-07T10:19:33.879 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-07T10:19:33.921 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-07T10:19:33.922 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-07T10:19:34.074 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-07T10:19:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-07T10:19:34.124 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-07T10:19:34.254 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-07T10:19:34.302 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-07T10:19:34.344 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-07T10:19:34.377 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-07T10:19:34.410 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-07T10:19:34.477 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-07T10:19:34.556 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-07T10:19:34.606 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-07T10:19:34.648 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-07T10:19:34.681 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-07T10:19:34.715 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-07T10:19:34.748 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-07T10:19:34.784 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:34.785 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-07T10:19:35.107 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-07T10:19:35.258 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-07T10:19:35.301 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-07T10:19:35.334 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-07T10:19:35.371 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-07T10:19:35.431 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-07T10:19:35.553 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-07T10:19:35.843 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-07T10:19:35.843 INFO:teuthology.orchestra.run.smithi194.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-07T10:19:35.844 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:40.924 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 1/198 2024-03-07T10:19:40.924 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 2/198 2024-03-07T10:19:40.924 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 3/198 2024-03-07T10:19:40.924 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 4/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1848.g8b896 5/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 6/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 7/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 8/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 9/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 10/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 11/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 12/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 13/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 14/198 2024-03-07T10:19:40.925 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_ 15/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 16/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 17/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_6 18/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86 19/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 20/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el 21/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9. 22/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_6 23/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 24/198 2024-03-07T10:19:40.926 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 25/198 2024-03-07T10:19:40.943 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 26/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 27/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 28/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 29/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e. 30/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noa 31/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.n 32/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b8 33/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el 34/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 35/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.e 36/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 37/198 2024-03-07T10:19:40.944 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 38/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 39/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-03-07T10:19:40.945 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-03-07T10:19:40.946 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.11-1.el9.x86_64 71/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 72/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 73/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 74/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-03-07T10:19:40.947 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-03-07T10:19:40.948 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 97/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 98/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 99/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-07T10:19:40.949 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-07T10:19:40.950 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-07T10:19:40.951 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-07T10:19:40.952 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 151/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 153/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 155/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 157/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 159/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 161/198 2024-03-07T10:19:40.953 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-03-07T10:19:40.954 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-03-07T10:19:40.955 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-07T10:19:40.956 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-07T10:19:43.593 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: acl-2.3.1-4.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-07T10:19:43.594 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.595 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.596 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.597 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-shell-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:19.0.0-1848.g8b896a9e.el9.noarch 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-07T10:19:43.598 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: jq-1.6-16.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-07T10:19:43.599 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: lua-5.4.4-4.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-07T10:19:43.600 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.11-1.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-07T10:19:43.601 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-07T10:19:43.602 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-07T10:19:43.603 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-07T10:19:43.604 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-07T10:19:43.605 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.606 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:19.0.0-1848.g8b896a9e.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-3.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-07T10:19:43.607 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-07T10:19:43.608 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:43.608 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-03-07T10:19:44.340 DEBUG:teuthology.parallel:result is None 2024-03-07T10:19:44.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:19:44.565 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-07T10:19:44.634 INFO:teuthology.orchestra.run.smithi194.stdout:19.0.0-1848.g8b896a9e.el9 2024-03-07T10:19:44.634 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1848.g8b896a9e.el9 2024-03-07T10:19:44.634 INFO:teuthology.task.install:The correct ceph version 19.0.0-1848.g8b896a9e is installed. 2024-03-07T10:19:44.636 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:19:44.771 DEBUG:teuthology.orchestra.run.smithi196:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-07T10:19:44.842 INFO:teuthology.orchestra.run.smithi196.stdout:19.0.0-1848.g8b896a9e.el9 2024-03-07T10:19:44.842 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1848.g8b896a9e.el9 2024-03-07T10:19:44.842 INFO:teuthology.task.install:The correct ceph version 19.0.0-1848.g8b896a9e is installed. 2024-03-07T10:19:44.844 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-07T10:19:44.844 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:44.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-07T10:19:44.923 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:44.923 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-07T10:19:45.017 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-07T10:19:45.017 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:45.017 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-03-07T10:19:45.111 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-07T10:19:45.184 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:45.184 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/daemon-helper 2024-03-07T10:19:45.287 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-07T10:19:45.416 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-07T10:19:45.417 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:45.417 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-07T10:19:45.490 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-07T10:19:45.603 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:45.603 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-07T10:19:45.695 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-07T10:19:45.811 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-07T10:19:45.811 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:45.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-03-07T10:19:45.883 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-07T10:19:45.997 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:45.997 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/usr/bin/stdin-killer 2024-03-07T10:19:46.080 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-07T10:19:46.209 INFO:teuthology.run_tasks:Running task ceph... 2024-03-07T10:19:46.296 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-07T10:19:46.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-03-07T10:19:46.302 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 777 /var/log/ceph 2024-03-07T10:19:46.384 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-07T10:19:46.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-07T10:19:46.389 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-07T10:19:46.478 INFO:tasks.ceph:Creating extra log directories... 2024-03-07T10:19:46.479 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-07T10:19:46.483 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-07T10:19:46.579 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-07T10:19:46.579 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-07T10:19:46.579 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-07T10:19:46.579 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:46.580 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-07T10:19:46.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-07T10:19:46.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-07T10:19:46.903 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:46.903 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-07T10:19:46.957 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-07T10:19:47.232 DEBUG:teuthology.orchestra.run.smithi196:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-07T10:19:47.340 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-07T10:19:47.340 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-07T10:19:47.340 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102', 'branch': 'wip-lusov-qdb', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}}', 'email': None, 'first_in_suite': False, 'job_id': '7584102', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-qdb'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-qdb', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 9221, 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'sleep_before_teardown': 0, 'subset': '111/10000', 'suite': 'fs', 'suite_branch': 'wip-lusov-qdb', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcuvnD9W9UEaovtugF5xdq6S//5bnBDPN4f4bV9+zKUMAwXxbuDt7k29czyZhbstjH4xgvLaqj/TXW42flZXHc=', 'smithi196.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb6taPdbTC/BenGE1njNfdBR7s+nctwr0j2vFop1258j4Q543NzF1i+ButPWS8pLoDjH0WMPKvK7cRiSAtwnFI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'Replacing daemon mds'], 'sha1': '8b896a9e145796119f0451201dc4d53ddac97db0', 'cluster': 'ceph'}}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-07_05:46:12', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-07T10:19:47.341 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-07T10:19:47.347 DEBUG:teuthology.orchestra.run.smithi196:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-07T10:19:47.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-03-07T10:19:47.430 DEBUG:teuthology.orchestra.run.smithi196:> sudo install -d -m0777 -- /var/run/ceph 2024-03-07T10:19:47.530 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:47.530 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-03-07T10:19:47.567 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-07T10:19:47.567 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-03-07T10:19:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-07T10:19:47.645 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:47.645 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-07 10:19:36.323789712 +0000 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-07 10:16:27.344974858 +0000 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-07 10:16:27.344974858 +0000 2024-03-07T10:19:47.646 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-07 10:16:27.344974858 +0000 2024-03-07T10:19:47.646 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-07T10:19:47.749 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-07T10:19:47.749 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-07T10:19:47.749 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000350222 s, 1.5 MB/s 2024-03-07T10:19:47.752 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-07T10:19:47.792 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-03-07T10:19:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-07T10:19:47.871 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-07 10:19:36.323789712 +0000 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-07 10:16:27.914963351 +0000 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-07 10:16:27.914963351 +0000 2024-03-07T10:19:47.872 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-07 10:16:27.914963351 +0000 2024-03-07T10:19:47.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-07T10:19:47.994 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-07T10:19:47.994 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-07T10:19:47.994 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000278336 s, 1.8 MB/s 2024-03-07T10:19:47.997 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-07T10:19:48.039 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-03-07T10:19:48.129 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-07 10:19:36.324789692 +0000 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-07 10:16:28.483951864 +0000 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-07 10:16:28.483951864 +0000 2024-03-07T10:19:48.130 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-07 10:16:28.483951864 +0000 2024-03-07T10:19:48.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-07T10:19:48.255 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-07T10:19:48.255 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-07T10:19:48.255 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000323362 s, 1.6 MB/s 2024-03-07T10:19:48.260 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-07T10:19:48.315 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-03-07 10:19:36.325789672 +0000 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-07 10:16:29.053940357 +0000 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-07 10:16:29.053940357 +0000 2024-03-07T10:19:48.364 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-07 10:16:29.053940357 +0000 2024-03-07T10:19:48.365 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-07T10:19:48.446 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-03-07T10:19:48.446 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-03-07T10:19:48.447 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000303952 s, 1.7 MB/s 2024-03-07T10:19:48.451 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-07T10:19:48.504 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:48.504 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:48.504 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/scratch_devs of=/dev/stdout 2024-03-07T10:19:48.562 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-07T10:19:48.563 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_1 2024-03-07T10:19:48.617 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-07T10:19:48.617 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-07 10:19:12.052680198 +0000 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-07 10:16:27.330331062 +0000 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-07 10:16:27.330331062 +0000 2024-03-07T10:19:48.618 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-07 10:16:27.330331062 +0000 2024-03-07T10:19:48.618 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-07T10:19:48.706 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-07T10:19:48.707 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-07T10:19:48.707 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.00032047 s, 1.6 MB/s 2024-03-07T10:19:48.711 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-07T10:19:48.764 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_2 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-07 10:19:12.053680175 +0000 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-07 10:16:28.087314136 +0000 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-07 10:16:28.087314136 +0000 2024-03-07T10:19:48.814 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-07 10:16:28.087314136 +0000 2024-03-07T10:19:48.815 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-07T10:19:48.901 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-07T10:19:48.901 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-07T10:19:48.902 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000343503 s, 1.5 MB/s 2024-03-07T10:19:48.908 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-07T10:19:48.966 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_3 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-07 10:19:12.053680175 +0000 2024-03-07T10:19:49.015 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-07 10:16:28.673301035 +0000 2024-03-07T10:19:49.016 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-07 10:16:28.673301035 +0000 2024-03-07T10:19:49.016 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-07 10:16:28.673301035 +0000 2024-03-07T10:19:49.016 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-07T10:19:49.101 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-07T10:19:49.101 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-07T10:19:49.101 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000350972 s, 1.5 MB/s 2024-03-07T10:19:49.106 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-07T10:19:49.158 DEBUG:teuthology.orchestra.run.smithi196:> stat /dev/vg_nvme/lv_4 2024-03-07T10:19:49.207 INFO:teuthology.orchestra.run.smithi196.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-07T10:19:49.207 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:device_t:s0 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 2024-03-07 10:19:12.055680131 +0000 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-07 10:16:29.246288223 +0000 2024-03-07T10:19:49.208 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-07 10:16:29.246288223 +0000 2024-03-07T10:19:49.209 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-07 10:16:29.246288223 +0000 2024-03-07T10:19:49.209 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-07T10:19:49.297 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records in 2024-03-07T10:19:49.298 INFO:teuthology.orchestra.run.smithi196.stderr:1+0 records out 2024-03-07T10:19:49.298 INFO:teuthology.orchestra.run.smithi196.stderr:512 bytes copied, 0.000342087 s, 1.5 MB/s 2024-03-07T10:19:49.301 DEBUG:teuthology.orchestra.run.smithi196:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-07T10:19:49.357 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:49.357 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-07T10:19:49.358 INFO:tasks.ceph:Generating config... 2024-03-07T10:19:49.359 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-07T10:19:49.359 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-03-07T10:19:49.359 INFO:tasks.ceph:[client] debug client = 20 2024-03-07T10:19:49.359 INFO:tasks.ceph:[client] debug ms = 1 2024-03-07T10:19:49.359 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-07T10:19:49.360 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-07T10:19:49.360 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-07T10:19:49.360 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-07T10:19:49.361 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-07T10:19:49.361 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-07T10:19:49.361 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-07T10:19:49.361 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-07T10:19:49.361 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-07T10:19:49.361 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-07T10:19:49.362 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-07T10:19:49.363 INFO:tasks.ceph:Setting up mon.a... 2024-03-07T10:19:49.363 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-07T10:19:49.500 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.keyring 2024-03-07T10:19:49.509 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-07T10:19:49.638 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T10:19:49.726 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.194'), ('mon.b', '172.21.15.196'), ('mon.c', '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]')] 2024-03-07T10:19:49.727 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.194,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-07T10:19:49.728 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:49.728 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-07T10:19:49.780 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.194 --add b 172.21.15.196 --addv c '[v2:172.21.15.196:3301,v1:172.21.15.196:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:19:49.931 INFO:teuthology.orchestra.run.smithi194.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:monmaptool: generated fsid 4f04f9a7-36ed-4153-a852-b0f479c9f76c 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:setting min_mon_release = quincy 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:epoch 0 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:fsid 4f04f9a7-36ed-4153-a852-b0f479c9f76c 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:last_changed 2024-03-07T10:19:49.929447+0000 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:created 2024-03-07T10:19:49.929447+0000 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:min_mon_release 17 (quincy) 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:election_strategy: 1 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:0: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.a 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:1: [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] mon.b 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:2: [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] mon.c 2024-03-07T10:19:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-07T10:19:49.934 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-07T10:19:49.981 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4f04f9a7-36ed-4153-a852-b0f479c9f76c... 2024-03-07T10:19:49.982 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-07T10:19:49.986 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-03-07T10:19:50.136 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-03-07T10:19:50.137 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-03-07T10:19:50.138 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.194,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 4f04f9a7-36ed-4153-a852-b0f479c9f76c 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.139 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug trim objects = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.140 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-07T10:19:50.141 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: osd blocked scrub grace period = 3600 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 0.95 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: osd max markdown count = 1000 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = bluestore 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-03-07T10:19:50.142 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-03-07T10:19:50.143 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-03-07T10:19:50.144 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: client_shutdown_timeout = 120 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-03-07T10:19:50.145 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal fragment size max = 10000 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal merge size = 5 2024-03-07T10:19:50.146 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal split bits = 3 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: mds bal split size = 100 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-03-07T10:19:50.147 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout:[global] 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: chdir = "" 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: auth supported = cephx 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: filestore xattr use omap = true 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: mon clock drift allowed = 1.000 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.160 INFO:teuthology.orchestra.run.smithi196.stdout: osd crush chooseleaf type = 0 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: auth debug = true 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on old message = true 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on bug = true 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon pg warn max object skew = 0 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: # disable pg_autoscaler by default for new pools 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default size = 2 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow primary affinity = true 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd allow pg remap = true 2024-03-07T10:19:50.161 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on legacy crush tunables = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on crush straw calc version zero = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on no sortbitwise = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on osd down out interval zero = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon warn on too few osds = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon_allow_pool_size_one = true 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: osd default data pool replay window = 5 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon allow pool delete = true 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.162 INFO:teuthology.orchestra.run.smithi196.stdout: mon cluster log file level = debug 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: debug asserts on shutdown = true 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon health detail to clog = false 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: mon host = "172.21.15.194,172.21.15.196,[v2:172.21.15.196:3301,v1:172.21.15.196:6790]" 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: ms die on skipped message = False 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: fsid = 4f04f9a7-36ed-4153-a852-b0f479c9f76c 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout:[osd] 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd journal size = 100 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub load threshold = 5.0 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd scrub max interval = 600 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd mclock profile = high_recovery_ops 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd recover clone overlap = true 2024-03-07T10:19:50.163 INFO:teuthology.orchestra.run.smithi196.stdout: osd recovery max chunk = 1048576 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug shutdown = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug op order = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug verify stray on activate = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug trim objects = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd open classes on start = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug pg log writeout = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd deep scrub update digest min age = 30 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: osd map max advance = 10 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: journal zero on create = true 2024-03-07T10:19:50.164 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: filestore ondisk finisher threads = 3 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: filestore apply finisher threads = 3 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bdev debug aio = true 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: osd debug misdirected ops = true 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bdev async discard = True 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bdev enable discard = True 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore allocator = bitmap 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore block size = 96636764160 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: bluestore fsck on mount = True 2024-03-07T10:19:50.165 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluefs = 1/20 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: debug bluestore = 1/20 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: debug osd = 20 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: debug rocksdb = 4/10 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd backfillfull_ratio = 0.85 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd full ratio = 0.9 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd nearfull ratio = 0.8 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: osd blocked scrub grace period = 3600 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: osd failsafe full ratio = 0.95 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: osd max markdown count = 1000 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: osd objectstore = bluestore 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.166 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr] 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug mgr = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: mgr/telemetry/nag = false 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout:[mon] 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug mon = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug paxos = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: debug auth = 20 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: mon data avail warn = 5 2024-03-07T10:19:50.167 INFO:teuthology.orchestra.run.smithi196.stdout: mon mgr mkfs grace = 240 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min pgs per osd = 4 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd reporter subtree level = osd 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon osd prime pg temp = true 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon reweight min bytes per osd = 10 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: auth mon ticket ttl = 660 # 11m 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: auth service ticket ttl = 240 # 4m 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: # don't complain about insecure global_id in the test suite 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: # 1m isn't quite enough 2024-03-07T10:19:50.168 INFO:teuthology.orchestra.run.smithi196.stdout: mon_down_mkfs_grace = 2m 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: mon_warn_on_filestore_osds = false 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: mon op complaint time = 120 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout:[client] 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: rgw cache enabled = true 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable ops log = true 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: rgw enable usage log = true 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: client mount timeout = 600 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: client_shutdown_timeout = 120 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: debug client = 20 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-07T10:19:50.169 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.a] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.b] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mon.c] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout:[mds] 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds = 20 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: debug mds balancer = 20 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: debug ms = 1 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal fragment size max = 10000 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal merge size = 5 2024-03-07T10:19:50.170 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split bits = 3 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: mds bal split size = 100 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug frag = True 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: mds debug scatterstat = True 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: mds op complaint time = 180 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: mds verify scatter = True 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: osd op complaint time = 180 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: rados mon op timeout = 900 2024-03-07T10:19:50.171 INFO:teuthology.orchestra.run.smithi196.stdout: rados osd op timeout = 900 2024-03-07T10:19:50.203 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-07T10:19:50.203 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-07T10:19:50.351 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-07T10:19:50.351 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:50.351 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-07T10:19:50.400 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:50.400 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-07T10:19:50.494 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:19:50.494 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:50.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-07T10:19:50.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T10:19:50.637 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:19:50.637 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:19:50.732 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:19:50.732 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:50.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-07T10:19:50.732 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-07T10:19:50.890 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:19:50.890 DEBUG:teuthology.orchestra.run.smithi196:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:19:50.985 INFO:tasks.ceph:Setting up mon nodes... 2024-03-07T10:19:50.985 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-07T10:19:50.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-07T10:19:51.167 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-07T10:19:51.177 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-07T10:19:51.378 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-07T10:19:51.389 INFO:tasks.ceph:Setting up mds nodes... 2024-03-07T10:19:51.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-07T10:19:51.554 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-07T10:19:51.563 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-07T10:19:51.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-07T10:19:51.831 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-07T10:19:51.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-07T10:19:51.928 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-07T10:19:52.107 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-07T10:19:52.116 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-07T10:19:52.207 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-07T10:19:52.387 INFO:teuthology.orchestra.run.smithi196.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-07T10:19:52.396 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-07T10:19:52.495 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-07T10:19:52.495 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-07T10:19:52.621 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-07T10:19:52.675 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-07T10:19:52.804 INFO:teuthology.orchestra.run.smithi196.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-07T10:19:52.859 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-07T10:19:52.860 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi196.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-07T10:19:52.860 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-07T10:19:52.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:52.961 INFO:tasks.ceph:role: osd.0 2024-03-07T10:19:52.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:19:52.961 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-07T10:19:53.055 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:19:53.056 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:19:53.572 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-07T10:19:53.578 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-07T10:19:53.578 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-07T10:19:53.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-07T10:19:53.846 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-07T10:19:53.936 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:53.936 INFO:tasks.ceph:role: osd.1 2024-03-07T10:19:53.936 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:19:53.936 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-07T10:19:54.034 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:19:54.034 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:19:54.034 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:19:54.035 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:19:54.512 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-07T10:19:54.519 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-07T10:19:54.519 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-07T10:19:54.651 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-07T10:19:54.745 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-07T10:19:54.837 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:54.838 INFO:tasks.ceph:role: osd.2 2024-03-07T10:19:54.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:19:54.838 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:19:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:19:55.459 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-07T10:19:55.466 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-07T10:19:55.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-07T10:19:55.662 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-07T10:19:55.766 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-07T10:19:55.854 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-07T10:19:55.854 INFO:tasks.ceph:role: osd.3 2024-03-07T10:19:55.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:19:55.854 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-07T10:19:55.950 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:19:55.951 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:19:56.408 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-03-07T10:19:56.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-03-07T10:19:56.414 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-07T10:19:56.576 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-07T10:19:56.676 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:19:56.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.821+0000 7f729ec13640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-07T10:19:56.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.825+0000 7f729ec13640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-07T10:19:56.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.825+0000 7f729ec13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T10:19:56.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.825+0000 7f729ec13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T10:19:56.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.825+0000 7f729ec13640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-07T10:19:56.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:19:56.829+0000 7f729ec13640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-07T10:20:00.024 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-07T10:20:00.122 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.251+0000 7f6835a99640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-07T10:20:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.252+0000 7f6835a99640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-07T10:20:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.252+0000 7f6835a99640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T10:20:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.252+0000 7f6835a99640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T10:20:00.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.252+0000 7f6835a99640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-07T10:20:00.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:00.254+0000 7f6835a99640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-07T10:20:03.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-07T10:20:03.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.664+0000 7fb3c3e12640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-07T10:20:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.665+0000 7fb3c3e12640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-07T10:20:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.665+0000 7fb3c3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T10:20:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.665+0000 7fb3c3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T10:20:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.665+0000 7fb3c3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-07T10:20:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:03.667+0000 7fb3c3e12640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-07T10:20:06.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-07T10:20:06.698 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:06.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.834+0000 7f8bd92d5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-07T10:20:06.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.834+0000 7f8bd92d5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-07T10:20:06.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.834+0000 7f8bd92d5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T10:20:06.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.834+0000 7f8bd92d5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T10:20:06.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.834+0000 7f8bd92d5640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-07T10:20:06.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:06.837+0000 7f8bd92d5640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-07T10:20:10.010 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-07T10:20:10.102 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-07T10:20:10.203 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T10:20:10.204 INFO:tasks.ceph:role: osd.4 2024-03-07T10:20:10.204 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:20:10.204 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:20:10.297 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:20:10.793 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-07T10:20:10.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-07T10:20:10.801 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-07T10:20:10.971 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-07T10:20:11.077 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-07T10:20:11.171 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T10:20:11.171 INFO:tasks.ceph:role: osd.5 2024-03-07T10:20:11.172 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:20:11.172 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-07T10:20:11.269 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:20:11.269 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:20:11.270 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:20:11.751 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-07T10:20:11.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-07T10:20:11.758 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-07T10:20:11.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-07T10:20:11.991 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-07T10:20:12.080 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T10:20:12.080 INFO:tasks.ceph:role: osd.6 2024-03-07T10:20:12.081 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:20:12.081 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-07T10:20:12.178 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:20:12.179 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:20:12.180 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:20:12.691 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-07T10:20:12.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-07T10:20:12.698 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-07T10:20:12.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-07T10:20:12.993 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-07T10:20:13.087 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-07T10:20:13.088 INFO:tasks.ceph:role: osd.7 2024-03-07T10:20:13.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:20:13.088 DEBUG:teuthology.orchestra.run.smithi196:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout: = sunit=0 swidth=0 blks 2024-03-07T10:20:13.181 INFO:teuthology.orchestra.run.smithi196.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-07T10:20:13.182 INFO:teuthology.orchestra.run.smithi196.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-07T10:20:13.182 INFO:teuthology.orchestra.run.smithi196.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-07T10:20:13.182 INFO:teuthology.orchestra.run.smithi196.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-07T10:20:13.642 INFO:teuthology.orchestra.run.smithi196.stdout:Discarding blocks...Done. 2024-03-07T10:20:13.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi196.front.sepia.ceph.com -o noatime 2024-03-07T10:20:13.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-07T10:20:13.818 DEBUG:teuthology.orchestra.run.smithi196:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-07T10:20:13.917 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:14.073 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.071+0000 7f7f71c17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-07T10:20:14.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.073+0000 7f7f71c17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-07T10:20:14.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.073+0000 7f7f71c17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T10:20:14.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.073+0000 7f7f71c17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T10:20:14.075 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.073+0000 7f7f71c17640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-07T10:20:14.086 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:14.085+0000 7f7f71c17640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-07T10:20:17.266 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-07T10:20:17.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:20:17.350 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:20:17.363 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:17.523 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.521+0000 7fbaf278a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-07T10:20:17.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.522+0000 7fbaf278a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-07T10:20:17.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.522+0000 7fbaf278a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T10:20:17.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.522+0000 7fbaf278a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T10:20:17.524 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.522+0000 7fbaf278a640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-07T10:20:17.525 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:17.524+0000 7fbaf278a640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-07T10:20:20.702 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-07T10:20:20.840 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:20.976 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.975+0000 7f2254d93640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-07T10:20:20.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.975+0000 7f2254d93640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-07T10:20:20.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.975+0000 7f2254d93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T10:20:20.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.975+0000 7f2254d93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T10:20:20.977 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.975+0000 7f2254d93640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-07T10:20:20.979 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:20.977+0000 7f2254d93640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-07T10:20:24.168 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-07T10:20:24.264 DEBUG:teuthology.orchestra.run.smithi196:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:24.402 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.400+0000 7f8cb0106640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-07T10:20:24.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.401+0000 7f8cb0106640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-07T10:20:24.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.401+0000 7f8cb0106640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T10:20:24.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.402+0000 7f8cb0106640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T10:20:24.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.402+0000 7f8cb0106640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-07T10:20:24.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:24.403+0000 7f8cb0106640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-07T10:20:27.589 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-07T10:20:27.686 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-07T10:20:27.687 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:27.687 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-07T10:20:27.784 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:27.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-07T10:20:27.877 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:27.877 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-07T10:20:27.971 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:27.971 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-07T10:20:28.062 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:28.062 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-07T10:20:28.199 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:28.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-07T10:20:28.290 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:28.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-07T10:20:28.423 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.423 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-07T10:20:28.527 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.527 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-07T10:20:28.623 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.623 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-07T10:20:28.715 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.715 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-07T10:20:28.809 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.809 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-07T10:20:28.945 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:28.945 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-07T10:20:29.038 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:29.038 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-07T10:20:29.131 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:29.131 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-07T10:20:29.186 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:29.186 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-07T10:20:29.241 INFO:tasks.ceph:Adding keys to all mons... 2024-03-07T10:20:29.242 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-07T10:20:29.248 DEBUG:teuthology.orchestra.run.smithi196:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDHlOllT0v1CRAAr17zSE9EilnhXQQtSWxNJQ== 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDHlOllPs0JIRAAlpSnZ1XssBy1teOKF5EnYA== 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-03-07T10:20:29.336 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDHlOll48mGMRAAfw5beFmNN3ZeOXzzskjFqg== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDMlOll+pcCMRAAdbR+RLt5ssJvy0lENn5l0Q== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDQlOll1ysLDxAADHL2AqAq54li2FxDUfeUWw== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDTlOllfDSpJxAAjFheMCguqqavAaHVfyejEQ== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDWlOllNjLHMRAAFdbtSoU3gwtgVGfNaKs8vA== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDHlOllbyKIFhAAaEF3lxVFgeY0FdlvT0BswA== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDIlOllVHddBhAAG6QbMN9JnNpNUx0fZ/PA+Q== 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-03-07T10:20:29.337 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDIlOll4lATFxAA21ka2QBXof9+CWqdZhWb8g== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDelOllgddPBBAA1MZRPW5hqy2Osq/tgMdXIA== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhlOllEwooHxAAlmmY5JbaEIbyUNz77kZO5g== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDklOllHzouOhAAyIVQkjDu+nUVDEWeSV8qXQ== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDolOllXoD2FxAAry0ZLGk18HwjPRmiK0Bumg== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDIlOllzn8JJRAA/33uCLx6yI00cC0kpKGQVA== 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-03-07T10:20:29.338 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDIlOllMA3bLxAATmx8K8x6l9KbTOuNVEdQNw== 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.y] 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDHlOllT0v1CRAAr17zSE9EilnhXQQtSWxNJQ== 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.a] 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDHlOllPs0JIRAAlpSnZ1XssBy1teOKF5EnYA== 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.c] 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDHlOll48mGMRAAfw5beFmNN3ZeOXzzskjFqg== 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.0] 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDMlOll+pcCMRAAdbR+RLt5ssJvy0lENn5l0Q== 2024-03-07T10:20:29.341 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.1] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDQlOll1ysLDxAADHL2AqAq54li2FxDUfeUWw== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.2] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDTlOllfDSpJxAAjFheMCguqqavAaHVfyejEQ== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.3] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDWlOllNjLHMRAAFdbtSoU3gwtgVGfNaKs8vA== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[mgr.x] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDHlOllbyKIFhAAaEF3lxVFgeY0FdlvT0BswA== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.b] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDIlOllVHddBhAAG6QbMN9JnNpNUx0fZ/PA+Q== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[mds.d] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDIlOll4lATFxAA21ka2QBXof9+CWqdZhWb8g== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.4] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDelOllgddPBBAA1MZRPW5hqy2Osq/tgMdXIA== 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.5] 2024-03-07T10:20:29.342 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDhlOllEwooHxAAlmmY5JbaEIbyUNz77kZO5g== 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.6] 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDklOllHzouOhAAyIVQkjDu+nUVDEWeSV8qXQ== 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout:[osd.7] 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDolOllXoD2FxAAry0ZLGk18HwjPRmiK0Bumg== 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout:[client.0] 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDIlOllzn8JJRAA/33uCLx6yI00cC0kpKGQVA== 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout:[client.1] 2024-03-07T10:20:29.343 INFO:teuthology.orchestra.run.smithi196.stdout: key = AQDIlOllMA3bLxAATmx8K8x6l9KbTOuNVEdQNw== 2024-03-07T10:20:29.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T10:20:29.392 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T10:20:29.530 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:29.535 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:29.682 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:29.687 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:29.824 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:29.830 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:29.968 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:29.973 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.113 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.120 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.264 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.268 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.403 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T10:20:30.410 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-07T10:20:30.552 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:30.557 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:30.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:30.708 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-07T10:20:30.855 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:30.863 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.002 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.007 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.143 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.150 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.296 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-07T10:20:31.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T10:20:31.446 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T10:20:31.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T10:20:31.594 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-07T10:20:31.734 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-07T10:20:31.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-07T10:20:31.823 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T10:20:31.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-07T10:20:32.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-07T10:20:32.159 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T10:20:32.314 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-07T10:20:32.401 DEBUG:teuthology.orchestra.run.smithi196:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-07T10:20:32.493 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-07T10:20:32.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-07T10:20:32.720 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:32.728 DEBUG:teuthology.orchestra.run.smithi196:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-07T10:20:32.782 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-07T10:20:32.783 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-07T10:20:32.783 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-07T10:20:32.788 INFO:tasks.ceph.mon.a:Started 2024-03-07T10:20:32.788 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-07T10:20:32.789 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-07T10:20:32.795 INFO:tasks.ceph.mon.b:Started 2024-03-07T10:20:32.795 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-07T10:20:32.795 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-07T10:20:32.802 INFO:tasks.ceph.mon.c:Started 2024-03-07T10:20:32.802 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-07T10:20:32.802 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-07T10:20:32.802 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-07T10:20:32.807 INFO:tasks.ceph.mgr.y:Started 2024-03-07T10:20:32.807 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-07T10:20:32.807 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-07T10:20:32.811 INFO:tasks.ceph.mgr.x:Started 2024-03-07T10:20:32.812 INFO:tasks.ceph:Setting crush tunables to default 2024-03-07T10:20:32.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd crush tunables default 2024-03-07T10:20:32.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.988+0000 7eff6ee00640 1 Processor -- start 2024-03-07T10:20:32.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.989+0000 7eff6ee00640 1 -- start start 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ee00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff68153760 con 0x7eff680ab340 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6806daf0 con 0x7eff680ab7c0 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6806dd40 con 0x7eff6814d6e0 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42036/0 (socket says 172.21.15.194:42036) 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.990+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 learned_addr learned my addr 172.21.15.194:0/450690434 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:32.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 msgr2=0x7eff6815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 msgr2=0x7eff6815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff6806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-07T10:20:32.993 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff6806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T10:20:32.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T10:20:32.994 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:32.991+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-07T10:20:33.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.192+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.192+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 msgr2=0x7eff6815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-07T10:20:33.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.192+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 msgr2=0x7eff6815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T10:20:33.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.192+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T10:20:33.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.193+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-07T10:20:33.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.194+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.194+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff6806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-07T10:20:33.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.194+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff6806e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-07T10:20:33.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.194+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-07T10:20:33.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.194+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-07T10:20:33.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.244+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 429547170 0 0) 0x7eff68153760 con 0x7eff680ab340 2024-03-07T10:20:33.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.245+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c003520 con 0x7eff680ab340 2024-03-07T10:20:33.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1616134044 0 0) 0x7eff4c003520 con 0x7eff680ab340 2024-03-07T10:20:33.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff6806e820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:20:33.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff6806e820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 msgr2=0x7eff6815ded0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:20:33.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 --2- 172.21.15.194:0/450690434 >> v2:172.21.15.194:3300/0 conn(0x7eff680ab7c0 0x7eff6815ded0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 --> v1:172.21.15.196:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6806e020 con 0x7eff680ab340 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.1 v1:172.21.15.196:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7eff54001670 con 0x7eff680ab340 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 >> v1:172.21.15.196:6789/0 conn(0x7eff680ab340 legacy=0x7eff680a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff4c0039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.250+0000 7eff66a00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff4c004050 0x7eff4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff66a00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4c004d40 0x7eff4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6806daf0 con 0x7eff4c004d40 2024-03-07T10:20:33.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6806dd40 con 0x7eff4c004050 2024-03-07T10:20:33.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff4c00bc00 con 0x7eff6814d6e0 2024-03-07T10:20:33.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4c004d40 0x7eff4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff4c0039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.251+0000 7eff67400640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff4c004050 0x7eff4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.252+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff4c004050 msgr2=0x7eff4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:33.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.252+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff4c004050 0x7eff4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.252+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4c004d40 msgr2=0x7eff4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:33.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.252+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4c004d40 0x7eff4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.252+0000 7eff67e00640 1 -- 172.21.15.194:0/450690434 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c003520 con 0x7eff6814d6e0 2024-03-07T10:20:33.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.253+0000 7eff6ce00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff4c004d40 0x7eff4c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:33.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.255+0000 7eff67e00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff4c0039d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff5800da90 tx=0x7eff4c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af1d1f40858f702 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:33.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.256+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58032070 con 0x7eff6814d6e0 2024-03-07T10:20:33.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.256+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5802c860 con 0x7eff6814d6e0 2024-03-07T10:20:33.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.256+0000 7eff66a00640 1 -- 172.21.15.194:0/450690434 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5800d690 con 0x7eff6814d6e0 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.257+0000 7eff6ee00640 1 -- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 msgr2=0x7eff4c0039d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.257+0000 7eff6ee00640 1 --2- 172.21.15.194:0/450690434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff6814d6e0 0x7eff4c0039d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7eff5800da90 tx=0x7eff4c005830 comp rx=0 tx=0).stop 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.257+0000 7eff6ce00640 1 -- 172.21.15.194:0/450690434 reap_dead start 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.258+0000 7eff6ee00640 1 -- 172.21.15.194:0/450690434 shutdown_connections 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.258+0000 7eff6ee00640 1 -- 172.21.15.194:0/450690434 >> 172.21.15.194:0/450690434 conn(0x7eff6806b860 msgr2=0x7eff680c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:33.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.258+0000 7eff6ee00640 1 -- 172.21.15.194:0/450690434 shutdown_connections 2024-03-07T10:20:33.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.258+0000 7eff6ee00640 1 -- 172.21.15.194:0/450690434 wait complete. 2024-03-07T10:20:33.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.262+0000 7eff6ee00640 1 Processor -- start 2024-03-07T10:20:33.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.263+0000 7eff6ee00640 1 -- start start 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff6814d6e0 0x7eff681ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 0x7eff68145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680aae10 con 0x7eff68145750 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff680c79c0 con 0x7eff6814d6e0 2024-03-07T10:20:33.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ee00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff680a9be0 con 0x7eff68071510 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff67400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff67400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:59792/0 (socket says 172.21.15.194:59792) 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff67400640 1 -- 172.21.15.194:0/78890261 learned_addr learned my addr 172.21.15.194:0/78890261 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff67e00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff6814d6e0 0x7eff681ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.265+0000 7eff6ce00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 0x7eff68145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 -- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff6814d6e0 msgr2=0x7eff681ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff6814d6e0 0x7eff681ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 -- 172.21.15.194:0/78890261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 msgr2=0x7eff68145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:33.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 0x7eff68145bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 -- 172.21.15.194:0/78890261 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff68157a80 con 0x7eff68071510 2024-03-07T10:20:33.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff6ce00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 0x7eff68145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:20:33.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.266+0000 7eff67400640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff5400f7f0 tx=0x7eff5400fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:33.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.269+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff540052e0 con 0x7eff68071510 2024-03-07T10:20:33.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.269+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff54018070 con 0x7eff68071510 2024-03-07T10:20:33.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.269+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5400d910 con 0x7eff68071510 2024-03-07T10:20:33.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.269+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6814b5e0 con 0x7eff68071510 2024-03-07T10:20:33.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.270+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff681577a0 con 0x7eff68071510 2024-03-07T10:20:33.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.270+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7eff5400dab0 con 0x7eff68071510 2024-03-07T10:20:33.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.270+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7eff5401d460 con 0x7eff68071510 2024-03-07T10:20:33.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.271+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff68073150 con 0x7eff68071510 2024-03-07T10:20:33.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.275+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7eff68073150 con 0x7eff68071510 2024-03-07T10:20:33.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.357+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7eff68068170 con 0x7eff68071510 2024-03-07T10:20:33.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.365+0000 7eff5fe00640 1 -- 172.21.15.194:0/78890261 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7eff54003e10 con 0x7eff68071510 2024-03-07T10:20:33.367 INFO:teuthology.orchestra.run.smithi194.stderr:adjusted tunables profile to default 2024-03-07T10:20:33.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 msgr2=0x7eff68154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7eff5400f7f0 tx=0x7eff5400fcb0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 shutdown_connections 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7eff68145750 0x7eff68145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7eff68071510 0x7eff68154a40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 --2- 172.21.15.194:0/78890261 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7eff6814d6e0 0x7eff681ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 >> 172.21.15.194:0/78890261 conn(0x7eff6806b860 msgr2=0x7eff680c4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 shutdown_connections 2024-03-07T10:20:33.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:33.367+0000 7eff6ee00640 1 -- 172.21.15.194:0/78890261 wait complete. 2024-03-07T10:20:33.385 INFO:tasks.ceph:check_enable_crimson: False 2024-03-07T10:20:33.385 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-07T10:20:33.385 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:33.385 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-07T10:20:33.468 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:33.468 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-07T10:20:33.607 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:33.607 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-07T10:20:33.680 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:20:33.680 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-07T10:20:33.805 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:33.805 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-07T10:20:33.861 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:33.860+0000 7fa3b4fbb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-07T10:20:33.894 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:33.894 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-07T10:20:33.931 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:33.929+0000 7fa3b4fbb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-07T10:20:34.015 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:34.015 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-07T10:20:34.141 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:20:34.142 DEBUG:teuthology.orchestra.run.smithi196:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-07T10:20:34.190 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:34.188+0000 7fc29b24c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-07T10:20:34.258 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:34.256+0000 7fc29b24c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-07T10:20:34.265 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new d39fe2af-b684-48af-a9bc-636fe0b35f88 0 2024-03-07T10:20:34.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.490+0000 7f3533800640 1 Processor -- start 2024-03-07T10:20:34.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.490+0000 7f3533800640 1 -- start start 2024-03-07T10:20:34.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.491+0000 7f3533800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 0x7f352c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.491+0000 7f3533800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f352c155e40 0x7f352c1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.491+0000 7f3533800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0ad690 con 0x7f352c152f80 2024-03-07T10:20:34.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.491+0000 7f3533800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0c8f80 con 0x7f352c155e40 2024-03-07T10:20:34.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f3533800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0ad970 con 0x7f352c06d5a0 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f3530e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f352c152f80 0x7f352c06c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37290/0 (socket says 172.21.15.196:37290) 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f3530e00640 1 -- 172.21.15.196:0/2716646632 learned_addr learned my addr 172.21.15.196:0/2716646632 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f352be00640 1 --2- 172.21.15.196:0/2716646632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 0x7f352c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f3531800640 1 --2- 172.21.15.196:0/2716646632 >> v2:172.21.15.194:3300/0 conn(0x7f352c155e40 0x7f352c1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626931844 0 0) 0x7f352c0ad690 con 0x7f352c152f80 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.492+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3514003520 con 0x7f352c152f80 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.493+0000 7f352be00640 1 -- 172.21.15.196:0/2716646632 >> v2:172.21.15.194:3300/0 conn(0x7f352c155e40 msgr2=0x7f352c1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.493+0000 7f352be00640 1 --2- 172.21.15.196:0/2716646632 >> v2:172.21.15.194:3300/0 conn(0x7f352c155e40 0x7f352c1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.493+0000 7f352be00640 1 -- 172.21.15.196:0/2716646632 >> v1:172.21.15.196:6789/0 conn(0x7f352c152f80 legacy=0x7f352c06c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.493+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 <== mon.1 v1:172.21.15.196:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4104306714 0 0) 0x7f3514003520 con 0x7f352c152f80 2024-03-07T10:20:34.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.493+0000 7f352be00640 1 -- 172.21.15.196:0/2716646632 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0c5a00 con 0x7f352c06d5a0 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.494+0000 7f352be00640 1 --2- 172.21.15.196:0/2716646632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 0x7f352c0c6170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f35180097a0 tx=0x7f351802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e51b70e0c4b53f89 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.494+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3518037070 con 0x7f352c06d5a0 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.494+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3518030510 con 0x7f352c06d5a0 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.494+0000 7f352b400640 1 -- 172.21.15.196:0/2716646632 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520001670 con 0x7f352c06d5a0 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 -- 172.21.15.196:0/2716646632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 msgr2=0x7f352c0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 --2- 172.21.15.196:0/2716646632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 0x7f352c0c6170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f35180097a0 tx=0x7f351802b790 comp rx=0 tx=0).stop 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 -- 172.21.15.196:0/2716646632 shutdown_connections 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 --2- 172.21.15.196:0/2716646632 >> v2:172.21.15.194:3300/0 conn(0x7f352c155e40 0x7f352c1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 --2- 172.21.15.196:0/2716646632 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c06d5a0 0x7f352c0c6170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 -- 172.21.15.196:0/2716646632 >> 172.21.15.196:0/2716646632 conn(0x7f352c0acb70 msgr2=0x7f352c0acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 -- 172.21.15.196:0/2716646632 shutdown_connections 2024-03-07T10:20:34.497 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.495+0000 7f3533800640 1 -- 172.21.15.196:0/2716646632 wait complete. 2024-03-07T10:20:34.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.496+0000 7f3533800640 1 Processor -- start 2024-03-07T10:20:34.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 -- start start 2024-03-07T10:20:34.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f352c06d5a0 0x7f352c1ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f352c152f80 0x7f352c14e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c06d080 con 0x7f352c06d5a0 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c153360 con 0x7f352c152f80 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.497+0000 7f3533800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c06d200 con 0x7f352c155e40 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38750/0 (socket says 172.21.15.196:38750) 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 -- 172.21.15.196:0/180254107 learned_addr learned my addr 172.21.15.196:0/180254107 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f352be00640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f352c152f80 0x7f352c14e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3530e00640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f352c06d5a0 0x7f352c1ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 -- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f352c152f80 msgr2=0x7f352c14e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f352c152f80 0x7f352c14e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 -- 172.21.15.196:0/180254107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f352c06d5a0 msgr2=0x7f352c1ebc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f352c06d5a0 0x7f352c1ebc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 -- 172.21.15.196:0/180254107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c159e30 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.498+0000 7f3531800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f352400efc0 tx=0x7f352400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524018020 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524014480 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524014870 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c1550c0 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c155680 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3524005d10 con 0x7f352c155e40 2024-03-07T10:20:34.502 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.499+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f35240133e0 con 0x7f352c155e40 2024-03-07T10:20:34.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.500+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c068880 con 0x7f352c155e40 2024-03-07T10:20:34.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.502+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3524022030 con 0x7f352c155e40 2024-03-07T10:20:34.577 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.575+0000 7fa3b4fbb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-07T10:20:34.582 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.581+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d39fe2af-b684-48af-a9bc-636fe0b35f88", "id": 0} v 0) v1 -- 0x7f352c06d380 con 0x7f352c155e40 2024-03-07T10:20:34.589 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.587+0000 7f3528c00640 1 -- 172.21.15.196:0/180254107 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d39fe2af-b684-48af-a9bc-636fe0b35f88", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3524010040 con 0x7f352c155e40 2024-03-07T10:20:34.589 INFO:teuthology.orchestra.run.smithi196.stdout:0 2024-03-07T10:20:34.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 msgr2=0x7f352c153d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f352400efc0 tx=0x7f352400c490 comp rx=0 tx=0).stop 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 shutdown_connections 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f352c155e40 0x7f352c153d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f352c152f80 0x7f352c14e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 --2- 172.21.15.196:0/180254107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f352c06d5a0 0x7f352c1ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 >> 172.21.15.196:0/180254107 conn(0x7f352c0acb70 msgr2=0x7f352c1562b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 shutdown_connections 2024-03-07T10:20:34.591 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.589+0000 7f3533800640 1 -- 172.21.15.196:0/180254107 wait complete. 2024-03-07T10:20:34.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new cc5c6bdb-f7ee-4ae6-98eb-73408404882e 1 2024-03-07T10:20:34.646 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.644+0000 7fa3b4fbb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-07T10:20:34.699 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.698+0000 7fa3b4fbb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-07T10:20:34.765 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.764+0000 7fa3b4fbb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-07T10:20:34.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.790+0000 7ff5c1600640 1 Processor -- start 2024-03-07T10:20:34.791 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.790+0000 7ff5c1600640 1 -- start start 2024-03-07T10:20:34.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.791+0000 7ff5c1600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff5bc14bd70 0x7ff5bc0aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.791+0000 7ff5c1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc151b90 con 0x7ff5bc0ac0c0 2024-03-07T10:20:34.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.791+0000 7ff5c1600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5bc151e50 con 0x7ff5bc0ac520 2024-03-07T10:20:34.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.791+0000 7ff5c1600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc152a60 con 0x7ff5bc14bd70 2024-03-07T10:20:34.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5c0c00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7ff5bc0ac520 0x7ff5bc155ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37302/0 (socket says 172.21.15.196:37302) 2024-03-07T10:20:34.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5c0c00640 1 -- 172.21.15.196:0/2960432626 learned_addr learned my addr 172.21.15.196:0/2960432626 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-07T10:20:34.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5bbe00640 1 --2- 172.21.15.196:0/2960432626 >> v2:172.21.15.196:3300/0 conn(0x7ff5bc14bd70 0x7ff5bc0aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5baa00640 1 -- 172.21.15.196:0/2960432626 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090760162 0 0) 0x7ff5bc151e50 con 0x7ff5bc0ac520 2024-03-07T10:20:34.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5baa00640 1 -- 172.21.15.196:0/2960432626 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a0003440 con 0x7ff5bc0ac520 2024-03-07T10:20:34.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.792+0000 7ff5bbe00640 1 -- 172.21.15.196:0/2960432626 >> v1:172.21.15.196:6789/0 conn(0x7ff5bc0ac520 legacy=0x7ff5bc155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.793+0000 7ff5bbe00640 1 -- 172.21.15.196:0/2960432626 >> v1:172.21.15.194:6789/0 conn(0x7ff5bc0ac0c0 legacy=0x7ff5bc1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.795 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.793+0000 7ff5bbe00640 1 -- 172.21.15.196:0/2960432626 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc152130 con 0x7ff5bc14bd70 2024-03-07T10:20:34.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5bbe00640 1 --2- 172.21.15.196:0/2960432626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc0aa460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0097a0 tx=0x7ff5ac02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1da9c37072157019 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:34.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5baa00640 1 -- 172.21.15.196:0/2960432626 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac034070 con 0x7ff5bc14bd70 2024-03-07T10:20:34.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5baa00640 1 -- 172.21.15.196:0/2960432626 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac030610 con 0x7ff5bc14bd70 2024-03-07T10:20:34.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5baa00640 1 -- 172.21.15.196:0/2960432626 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0309e0 con 0x7ff5bc14bd70 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5c1600640 1 -- 172.21.15.196:0/2960432626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 msgr2=0x7ff5bc0aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5c1600640 1 --2- 172.21.15.196:0/2960432626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc0aa460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac0097a0 tx=0x7ff5ac02b960 comp rx=0 tx=0).stop 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5c1600640 1 -- 172.21.15.196:0/2960432626 shutdown_connections 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.794+0000 7ff5c1600640 1 --2- 172.21.15.196:0/2960432626 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc0aa460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.795+0000 7ff5c1600640 1 -- 172.21.15.196:0/2960432626 >> 172.21.15.196:0/2960432626 conn(0x7ff5bc06cf00 msgr2=0x7ff5bc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.795+0000 7ff5c1600640 1 -- 172.21.15.196:0/2960432626 shutdown_connections 2024-03-07T10:20:34.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.795+0000 7ff5c1600640 1 -- 172.21.15.196:0/2960432626 wait complete. 2024-03-07T10:20:34.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.796+0000 7ff5c1600640 1 Processor -- start 2024-03-07T10:20:34.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.796+0000 7ff5c1600640 1 -- start start 2024-03-07T10:20:34.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 0x7ff5bc148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:34.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc1526f0 con 0x7ff5bc0ac0c0 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0ac9b0 con 0x7ff5bc14bd70 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc06ee60 con 0x7ff5bc0ac520 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5bb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5bb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38754/0 (socket says 172.21.15.196:38754) 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5bb400640 1 -- 172.21.15.196:0/3666538452 learned_addr learned my addr 172.21.15.196:0/3666538452 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.797+0000 7ff5c0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56180/0 (socket says 172.21.15.196:56180) 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bbe00640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 0x7ff5bc148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 -- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 msgr2=0x7ff5bc1ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 -- 172.21.15.196:0/3666538452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 msgr2=0x7ff5bc148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.801 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 0x7ff5bc148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 -- 172.21.15.196:0/3666538452 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0c5d30 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5c0c00640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bbe00640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 0x7ff5bc148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5bb400640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c3f0 tx=0x7ff5a800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80052d0 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a8005490 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a8007260 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.798+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc1473c0 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.799+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc148580 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.799+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7ff5a8007400 con 0x7ff5bc0ac520 2024-03-07T10:20:34.802 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.799+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7ff5a8003ad0 con 0x7ff5bc0ac520 2024-03-07T10:20:34.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.800+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc06c220 con 0x7ff5bc0ac520 2024-03-07T10:20:34.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.802+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7ff5bc06c220 con 0x7ff5bc0ac520 2024-03-07T10:20:34.819 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.818+0000 7fa3b4fbb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-07T10:20:34.879 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:34.877+0000 7fc29b24c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-07T10:20:34.882 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.881+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cc5c6bdb-f7ee-4ae6-98eb-73408404882e", "id": 1} v 0) v1 -- 0x7ff5bc073480 con 0x7ff5bc0ac520 2024-03-07T10:20:34.888 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.887+0000 7ff5b3e00640 1 -- 172.21.15.196:0/3666538452 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cc5c6bdb-f7ee-4ae6-98eb-73408404882e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff5bc073480 con 0x7ff5bc0ac520 2024-03-07T10:20:34.889 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-03-07T10:20:34.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 msgr2=0x7ff5bc145a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:34.890 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff5a800c3f0 tx=0x7ff5a800c8b0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 shutdown_connections 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5bc14bd70 0x7ff5bc1ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5bc0ac520 0x7ff5bc145a10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 --2- 172.21.15.196:0/3666538452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5bc0ac0c0 0x7ff5bc148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 >> 172.21.15.196:0/3666538452 conn(0x7ff5bc06cf00 msgr2=0x7ff5bc0c13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.888+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 shutdown_connections 2024-03-07T10:20:34.891 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:34.889+0000 7ff5c1600640 1 -- 172.21.15.196:0/3666538452 wait complete. 2024-03-07T10:20:34.905 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new ea857442-96a8-4d54-90a1-676a21f19187 2 2024-03-07T10:20:34.942 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:34.941+0000 7fc29b24c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-07T10:20:34.956 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:34.954+0000 7fa3b4fbb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-07T10:20:34.992 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:34.991+0000 7fc29b24c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-07T10:20:35.041 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.039+0000 7fa3b4fbb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-07T10:20:35.054 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.053+0000 7fc29b24c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-07T10:20:35.097 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.095+0000 7fa3b4fbb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-07T10:20:35.103 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.102+0000 7fc29b24c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-07T10:20:35.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.140+0000 7f6013e00640 1 Processor -- start 2024-03-07T10:20:35.141 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.140+0000 7f6013e00640 1 -- start start 2024-03-07T10:20:35.143 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6013e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f601414f7c0 0x7f6014155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6013e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f60140c8d90 0x7f60140c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6013e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6014155b30 con 0x7f60140c5d50 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6013e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6014155e10 con 0x7f60140c8d90 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6013e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60141560f0 con 0x7f601414f7c0 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.141+0000 7f6012a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f601414f7c0 0x7f6014155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6013400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f60140c5d50 0x7f6014159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37316/0 (socket says 172.21.15.196:37316) 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6012a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f601414f7c0 0x7f6014155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56194/0 (socket says 172.21.15.196:56194) 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6013400640 1 -- 172.21.15.196:0/3881341287 learned_addr learned my addr 172.21.15.196:0/3881341287 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f600be00640 1 --2- 172.21.15.196:0/3881341287 >> v2:172.21.15.194:3300/0 conn(0x7f60140c8d90 0x7f60140c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6012a00640 1 -- 172.21.15.196:0/3881341287 >> v2:172.21.15.194:3300/0 conn(0x7f60140c8d90 msgr2=0x7f60140c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6012a00640 1 --2- 172.21.15.196:0/3881341287 >> v2:172.21.15.194:3300/0 conn(0x7f60140c8d90 0x7f60140c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6012a00640 1 -- 172.21.15.196:0/3881341287 >> v1:172.21.15.196:6789/0 conn(0x7f60140c5d50 legacy=0x7f6014159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.144 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.142+0000 7f6012a00640 1 -- 172.21.15.196:0/3881341287 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60141563d0 con 0x7f601414f7c0 2024-03-07T10:20:35.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.143+0000 7f6012a00640 1 --2- 172.21.15.196:0/3881341287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f601414f7c0 0x7f6014155550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60140722c0 tx=0x7f600402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d3c53323204fede server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.143+0000 7f6012000640 1 -- 172.21.15.196:0/3881341287 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040315a0 con 0x7f601414f7c0 2024-03-07T10:20:35.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.143+0000 7f6012000640 1 -- 172.21.15.196:0/3881341287 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6004037070 con 0x7f601414f7c0 2024-03-07T10:20:35.145 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.143+0000 7f6012000640 1 -- 172.21.15.196:0/3881341287 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6004031960 con 0x7f601414f7c0 2024-03-07T10:20:35.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 -- 172.21.15.196:0/3881341287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f601414f7c0 msgr2=0x7f6014155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 --2- 172.21.15.196:0/3881341287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f601414f7c0 0x7f6014155550 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f60140722c0 tx=0x7f600402b840 comp rx=0 tx=0).stop 2024-03-07T10:20:35.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 -- 172.21.15.196:0/3881341287 shutdown_connections 2024-03-07T10:20:35.146 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 --2- 172.21.15.196:0/3881341287 >> v2:172.21.15.194:3300/0 conn(0x7f60140c8d90 0x7f60140c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 --2- 172.21.15.196:0/3881341287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f601414f7c0 0x7f6014155550 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 -- 172.21.15.196:0/3881341287 >> 172.21.15.196:0/3881341287 conn(0x7f601406b4a0 msgr2=0x7f601406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 -- 172.21.15.196:0/3881341287 shutdown_connections 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.144+0000 7f6013e00640 1 -- 172.21.15.196:0/3881341287 wait complete. 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.146+0000 7f6013e00640 1 Processor -- start 2024-03-07T10:20:35.147 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.146+0000 7f6013e00640 1 -- start start 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 0x7f6014154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f601414f7c0 0x7f6014148270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014159730 con 0x7f601414f7c0 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014072890 con 0x7f60140c8d90 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60141598b0 con 0x7f60140c5d50 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6012a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 0x7f6014154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.149 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56196/0 (socket says 172.21.15.196:56196) 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 -- 172.21.15.196:0/1864010921 learned_addr learned my addr 172.21.15.196:0/1864010921 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6013400640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f601414f7c0 0x7f6014148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 -- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 msgr2=0x7f6014154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 0x7f6014154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 -- 172.21.15.196:0/1864010921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f601414f7c0 msgr2=0x7f6014148270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f601414f7c0 0x7f6014148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f600be00640 1 -- 172.21.15.196:0/1864010921 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60141e1a50 con 0x7f60140c8d90 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.147+0000 7f6012a00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 0x7f6014154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:35.150 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600be00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00d5f0 tx=0x7f5ffc00dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0125f0 con 0x7f60140c8d90 2024-03-07T10:20:35.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ffc019070 con 0x7f60140c8d90 2024-03-07T10:20:35.151 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141df150 con 0x7f60140c8d90 2024-03-07T10:20:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ffc0129d0 con 0x7f60140c8d90 2024-03-07T10:20:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60141ee870 con 0x7f60140c8d90 2024-03-07T10:20:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f5ffc012b70 con 0x7f60140c8d90 2024-03-07T10:20:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.148+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5ffc01e880 con 0x7f60140c8d90 2024-03-07T10:20:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.149+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014075600 con 0x7f60140c8d90 2024-03-07T10:20:35.153 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.152+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5ffc01ead0 con 0x7f60140c8d90 2024-03-07T10:20:35.162 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.161+0000 7fa3b4fbb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-07T10:20:35.221 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.220+0000 7fa3b4fbb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-07T10:20:35.232 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.231+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea857442-96a8-4d54-90a1-676a21f19187", "id": 2} v 0) v1 -- 0x7f6014072590 con 0x7f60140c8d90 2024-03-07T10:20:35.233 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.231+0000 7fc29b24c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-07T10:20:35.240 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.239+0000 7f600aa00640 1 -- 172.21.15.196:0/1864010921 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea857442-96a8-4d54-90a1-676a21f19187", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ffc01e460 con 0x7f60140c8d90 2024-03-07T10:20:35.240 INFO:teuthology.orchestra.run.smithi196.stdout:2 2024-03-07T10:20:35.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.240+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 msgr2=0x7f60141df590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.242 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.240+0000 7f6013e00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00d5f0 tx=0x7f5ffc00dab0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 shutdown_connections 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f601414f7c0 0x7f6014148270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f60140c8d90 0x7f60141df590 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 --2- 172.21.15.196:0/1864010921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f60140c5d50 0x7f6014154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 >> 172.21.15.196:0/1864010921 conn(0x7f601406b4a0 msgr2=0x7f60140c05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 shutdown_connections 2024-03-07T10:20:35.243 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.241+0000 7f6013e00640 1 -- 172.21.15.196:0/1864010921 wait complete. 2024-03-07T10:20:35.260 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 30652334-9476-4e7e-ac3c-7c86613af6a0 3 2024-03-07T10:20:35.314 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.312+0000 7fc29b24c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-07T10:20:35.366 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.365+0000 7fc29b24c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-07T10:20:35.426 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.425+0000 7fc29b24c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-07T10:20:35.481 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.479+0000 7fc29b24c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-07T10:20:35.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.488+0000 7fc7c8800640 1 Processor -- start 2024-03-07T10:20:35.489 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.488+0000 7fc7c8800640 1 -- start start 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c8800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc7c00cb380 0x7fc7c00cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c8800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc7c0155990 0x7fc7c0155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c8800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c0153180 con 0x7fc7c0152da0 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c8800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c00c9620 con 0x7fc7c00cb380 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c8800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c0158f70 con 0x7fc7c0155990 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c5e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc7c0152da0 0x7fc7c00c8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37318/0 (socket says 172.21.15.196:37318) 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c5e00640 1 -- 172.21.15.196:0/1538707827 learned_addr learned my addr 172.21.15.196:0/1538707827 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.489+0000 7fc7c6800640 1 --2- 172.21.15.196:0/1538707827 >> v2:172.21.15.196:3300/0 conn(0x7fc7c0155990 0x7fc7c0155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.491 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c5400640 1 --2- 172.21.15.196:0/1538707827 >> v2:172.21.15.194:3300/0 conn(0x7fc7c00cb380 0x7fc7c00cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c6800640 1 -- 172.21.15.196:0/1538707827 >> v2:172.21.15.194:3300/0 conn(0x7fc7c00cb380 msgr2=0x7fc7c00cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:35.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c6800640 1 --2- 172.21.15.196:0/1538707827 >> v2:172.21.15.194:3300/0 conn(0x7fc7c00cb380 0x7fc7c00cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c6800640 1 -- 172.21.15.196:0/1538707827 >> v1:172.21.15.196:6789/0 conn(0x7fc7c0152da0 legacy=0x7fc7c00c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.492 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c6800640 1 -- 172.21.15.196:0/1538707827 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0159250 con 0x7fc7c0155990 2024-03-07T10:20:35.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.490+0000 7fc7c4a00640 1 -- 172.21.15.196:0/1538707827 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1646594530 0 0) 0x7fc7c0153180 con 0x7fc7c0152da0 2024-03-07T10:20:35.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c6800640 1 --2- 172.21.15.196:0/1538707827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0155990 0x7fc7c0155e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7c006d9f0 tx=0x7fc7bc02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972e7197778fc2e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c4a00640 1 -- 172.21.15.196:0/1538707827 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc039070 con 0x7fc7c0155990 2024-03-07T10:20:35.493 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c4a00640 1 -- 172.21.15.196:0/1538707827 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc02cc70 con 0x7fc7c0155990 2024-03-07T10:20:35.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c4a00640 1 -- 172.21.15.196:0/1538707827 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc034660 con 0x7fc7c0155990 2024-03-07T10:20:35.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c8800640 1 -- 172.21.15.196:0/1538707827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0155990 msgr2=0x7fc7c0155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.492+0000 7fc7c8800640 1 --2- 172.21.15.196:0/1538707827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0155990 0x7fc7c0155e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc7c006d9f0 tx=0x7fc7bc02bec0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 -- 172.21.15.196:0/1538707827 shutdown_connections 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 --2- 172.21.15.196:0/1538707827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0155990 0x7fc7c0155e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 --2- 172.21.15.196:0/1538707827 >> v2:172.21.15.194:3300/0 conn(0x7fc7c00cb380 0x7fc7c00cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 -- 172.21.15.196:0/1538707827 >> 172.21.15.196:0/1538707827 conn(0x7fc7c0066f70 msgr2=0x7fc7c0067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 -- 172.21.15.196:0/1538707827 shutdown_connections 2024-03-07T10:20:35.495 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.493+0000 7fc7c8800640 1 -- 172.21.15.196:0/1538707827 wait complete. 2024-03-07T10:20:35.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.494+0000 7fc7c8800640 1 Processor -- start 2024-03-07T10:20:35.496 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.494+0000 7fc7c8800640 1 -- start start 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7c00cb380 0x7fc7c01580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 0x7fc7c00ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c00be8c0 con 0x7fc7c00cb380 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0159810 con 0x7fc7c0152da0 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.495+0000 7fc7c8800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c0156340 con 0x7fc7c0155990 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 0x7fc7c00ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56226/0 (socket says 172.21.15.196:56226) 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c5400640 1 -- 172.21.15.196:0/2383143208 learned_addr learned my addr 172.21.15.196:0/2383143208 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c5e00640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7c00cb380 0x7fc7c01580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.498 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 -- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 msgr2=0x7fc7c00ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 -- 172.21.15.196:0/2383143208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7c00cb380 msgr2=0x7fc7c01580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7c00cb380 0x7fc7c01580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 -- 172.21.15.196:0/2383143208 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c00ac700 con 0x7fc7c0155990 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c5400640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:35.499 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.496+0000 7fc7c6800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 0x7fc7c00ab5c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc033000 tx=0x7fc7bc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc039050 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc045070 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc009450 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c00c49e0 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c01ebb10 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc7bc03e850 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.497+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc7bc04a460 con 0x7fc7c0155990 2024-03-07T10:20:35.500 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.498+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c0068170 con 0x7fc7c0155990 2024-03-07T10:20:35.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.500+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc7bc02ce20 con 0x7fc7c0155990 2024-03-07T10:20:35.581 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.579+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "30652334-9476-4e7e-ac3c-7c86613af6a0", "id": 3} v 0) v1 -- 0x7fc7c006d5a0 con 0x7fc7c0155990 2024-03-07T10:20:35.590 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.589+0000 7fc7ba000640 1 -- 172.21.15.196:0/2383143208 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30652334-9476-4e7e-ac3c-7c86613af6a0", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc7bc03eb40 con 0x7fc7c0155990 2024-03-07T10:20:35.591 INFO:teuthology.orchestra.run.smithi196.stdout:3 2024-03-07T10:20:35.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.590+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 msgr2=0x7fc7c00ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.592 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.590+0000 7fc7c8800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 0x7fc7c00ab5c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc033000 tx=0x7fc7bc004a40 comp rx=0 tx=0).stop 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 shutdown_connections 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc7c0155990 0x7fc7c00ab5c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc7c0152da0 0x7fc7c00ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 --2- 172.21.15.196:0/2383143208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7c00cb380 0x7fc7c01580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 >> 172.21.15.196:0/2383143208 conn(0x7fc7c0066f70 msgr2=0x7fc7c00c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 shutdown_connections 2024-03-07T10:20:35.593 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.591+0000 7fc7c8800640 1 -- 172.21.15.196:0/2383143208 wait complete. 2024-03-07T10:20:35.607 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 5f6a4990-fd54-42e0-9e35-7c9e76ebc040 4 2024-03-07T10:20:35.708 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.707+0000 7fa3b4fbb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-07T10:20:35.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.792+0000 7fb313e00640 1 Processor -- start 2024-03-07T10:20:35.793 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.792+0000 7fb313e00640 1 -- start start 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.793+0000 7fb313e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.793+0000 7fb313e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb314158dc0 con 0x7fb314152e60 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.793+0000 7fb313e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb314155e30 con 0x7fb3140c5da0 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.793+0000 7fb313e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c8490 con 0x7fb3140ad420 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb30be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb313400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb3140c5da0 0x7fb3141592c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37334/0 (socket says 172.21.15.196:37334) 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb313400640 1 -- 172.21.15.196:0/3344434626 learned_addr learned my addr 172.21.15.196:0/3344434626 (peer_addr_for_me v1:172.21.15.196:0/0) 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb30be00640 1 -- 172.21.15.196:0/3344434626 >> v1:172.21.15.196:6789/0 conn(0x7fb3140c5da0 legacy=0x7fb3141592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.796 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb30be00640 1 -- 172.21.15.196:0/3344434626 >> v1:172.21.15.194:6789/0 conn(0x7fb314152e60 legacy=0x7fb314155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb312000640 1 -- 172.21.15.196:0/3344434626 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879896647 0 0) 0x7fb314155e30 con 0x7fb3140c5da0 2024-03-07T10:20:35.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.794+0000 7fb30be00640 1 -- 172.21.15.196:0/3344434626 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314156110 con 0x7fb3140ad420 2024-03-07T10:20:35.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.796+0000 7fb30be00640 1 --2- 172.21.15.196:0/3344434626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140c5860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009800 tx=0x7fb2fc02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92ed133dc962ac2d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.797 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.796+0000 7fb312000640 1 -- 172.21.15.196:0/3344434626 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc035020 con 0x7fb3140ad420 2024-03-07T10:20:35.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.796+0000 7fb312000640 1 -- 172.21.15.196:0/3344434626 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc031800 con 0x7fb3140ad420 2024-03-07T10:20:35.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.796+0000 7fb312000640 1 -- 172.21.15.196:0/3344434626 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc031bd0 con 0x7fb3140ad420 2024-03-07T10:20:35.798 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 -- 172.21.15.196:0/3344434626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 msgr2=0x7fb3140c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 --2- 172.21.15.196:0/3344434626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140c5860 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc009800 tx=0x7fb2fc02b8a0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 -- 172.21.15.196:0/3344434626 shutdown_connections 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 --2- 172.21.15.196:0/3344434626 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140c5860 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 -- 172.21.15.196:0/3344434626 >> 172.21.15.196:0/3344434626 conn(0x7fb31406b6b0 msgr2=0x7fb3140aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 -- 172.21.15.196:0/3344434626 shutdown_connections 2024-03-07T10:20:35.799 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.797+0000 7fb313e00640 1 -- 172.21.15.196:0/3344434626 wait complete. 2024-03-07T10:20:35.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.798+0000 7fb313e00640 1 Processor -- start 2024-03-07T10:20:35.800 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.798+0000 7fb313e00640 1 -- start start 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3140c5da0 0x7fb3141ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb314152e60 0x7fb3141eeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c9000 con 0x7fb314152e60 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c6910 con 0x7fb3140c5da0 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb313e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140c9180 con 0x7fb3140ad420 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.799+0000 7fb312a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.803 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38798/0 (socket says 172.21.15.196:38798) 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 -- 172.21.15.196:0/1776606588 learned_addr learned my addr 172.21.15.196:0/1776606588 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb30be00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3140c5da0 0x7fb3141ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb313400640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb314152e60 0x7fb3141eeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 -- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3140c5da0 msgr2=0x7fb3141ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3140c5da0 0x7fb3141ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 -- 172.21.15.196:0/1776606588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb314152e60 msgr2=0x7fb3141eeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb314152e60 0x7fb3141eeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 -- 172.21.15.196:0/1776606588 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314155810 con 0x7fb3140ad420 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb312a00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c430 tx=0x7fb30400c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.800+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304017070 con 0x7fb3140ad420 2024-03-07T10:20:35.804 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3040052d0 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304003830 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140aa9c0 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb31414c2a0 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb30401a070 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.801+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb304011590 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.802+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb314075600 con 0x7fb3140ad420 2024-03-07T10:20:35.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.804+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb304021070 con 0x7fb3140ad420 2024-03-07T10:20:35.877 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:35.875+0000 7fa3b4fbb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-07T10:20:35.885 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.883+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5f6a4990-fd54-42e0-9e35-7c9e76ebc040", "id": 4} v 0) v1 -- 0x7fb314155470 con 0x7fb3140ad420 2024-03-07T10:20:35.893 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.892+0000 7fb30aa00640 1 -- 172.21.15.196:0/1776606588 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5f6a4990-fd54-42e0-9e35-7c9e76ebc040", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb304011b30 con 0x7fb3140ad420 2024-03-07T10:20:35.893 INFO:teuthology.orchestra.run.smithi196.stdout:4 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 msgr2=0x7fb3140cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c430 tx=0x7fb30400c8f0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 shutdown_connections 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb314152e60 0x7fb3141eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb3140c5da0 0x7fb3141ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 --2- 172.21.15.196:0/1776606588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb3140ad420 0x7fb3140cb5d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 >> 172.21.15.196:0/1776606588 conn(0x7fb31406b6b0 msgr2=0x7fb314151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 shutdown_connections 2024-03-07T10:20:35.895 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:35.893+0000 7fb313e00640 1 -- 172.21.15.196:0/1776606588 wait complete. 2024-03-07T10:20:35.911 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new e1cfefda-e9fc-4c5c-b062-0267b166630c 5 2024-03-07T10:20:35.927 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:35.925+0000 7fc29b24c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-07T10:20:36.027 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.025+0000 7fa3b4fbb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-07T10:20:36.083 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.081+0000 7fa3b4fbb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-07T10:20:36.086 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.084+0000 7fc29b24c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-07T10:20:36.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.101+0000 7f509fe00640 1 Processor -- start 2024-03-07T10:20:36.103 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.101+0000 7f509fe00640 1 -- start start 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509fe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f50a0152e60 0x7f50a0155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f50a00ad420 0x7f50a00c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509fe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a0155b90 con 0x7f50a00c5da0 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509fe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00c8490 con 0x7f50a00ad420 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509fe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00c6910 con 0x7f50a0152e60 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f50a0152e60 0x7f50a0155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f50a0152e60 0x7f50a0155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56242/0 (socket says 172.21.15.196:56242) 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509f400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f50a00c5da0 0x7f50a01592c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.196:37336/0 (socket says 172.21.15.196:37336) 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 -- 172.21.15.196:0/1498682372 learned_addr learned my addr 172.21.15.196:0/1498682372 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.105 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509e000640 1 --2- 172.21.15.196:0/1498682372 >> v2:172.21.15.194:3300/0 conn(0x7f50a00ad420 0x7f50a00c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 -- 172.21.15.196:0/1498682372 >> v2:172.21.15.194:3300/0 conn(0x7f50a00ad420 msgr2=0x7f50a00c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:36.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 --2- 172.21.15.196:0/1498682372 >> v2:172.21.15.194:3300/0 conn(0x7f50a00ad420 0x7f50a00c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 -- 172.21.15.196:0/1498682372 >> v1:172.21.15.196:6789/0 conn(0x7f50a00c5da0 legacy=0x7f50a01592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.106 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.103+0000 7f509ea00640 1 -- 172.21.15.196:0/1498682372 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a0158dc0 con 0x7f50a0152e60 2024-03-07T10:20:36.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.104+0000 7f509ea00640 1 --2- 172.21.15.196:0/1498682372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a0152e60 0x7f50a0155650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50a00cbfa0 tx=0x7f509002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912b6870ad002278 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509d600640 1 -- 172.21.15.196:0/1498682372 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090035020 con 0x7f50a0152e60 2024-03-07T10:20:36.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509d600640 1 -- 172.21.15.196:0/1498682372 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090031870 con 0x7f50a0152e60 2024-03-07T10:20:36.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509d600640 1 -- 172.21.15.196:0/1498682372 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090031c40 con 0x7f50a0152e60 2024-03-07T10:20:36.107 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 -- 172.21.15.196:0/1498682372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a0152e60 msgr2=0x7f50a0155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 --2- 172.21.15.196:0/1498682372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a0152e60 0x7f50a0155650 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f50a00cbfa0 tx=0x7f509002b910 comp rx=0 tx=0).stop 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 -- 172.21.15.196:0/1498682372 shutdown_connections 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 --2- 172.21.15.196:0/1498682372 >> v2:172.21.15.194:3300/0 conn(0x7f50a00ad420 0x7f50a00c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 --2- 172.21.15.196:0/1498682372 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a0152e60 0x7f50a0155650 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.105+0000 7f509fe00640 1 -- 172.21.15.196:0/1498682372 >> 172.21.15.196:0/1498682372 conn(0x7f50a006b6b0 msgr2=0x7f50a00aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.106+0000 7f509fe00640 1 -- 172.21.15.196:0/1498682372 shutdown_connections 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.106+0000 7f509fe00640 1 -- 172.21.15.196:0/1498682372 wait complete. 2024-03-07T10:20:36.108 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.107+0000 7f509fe00640 1 Processor -- start 2024-03-07T10:20:36.109 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.107+0000 7f509fe00640 1 -- start start 2024-03-07T10:20:36.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a00ad420 0x7f50a0154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a0152e60 0x7f50a01eb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.111 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01563f0 con 0x7f50a0152e60 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a0156110 con 0x7f50a00ad420 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509fe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00c9000 con 0x7f50a00c5da0 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38808/0 (socket says 172.21.15.196:38808) 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509e000640 1 -- 172.21.15.196:0/2497057103 learned_addr learned my addr 172.21.15.196:0/2497057103 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.108+0000 7f509ea00640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a00ad420 0x7f50a0154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509f400640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a0152e60 0x7f50a01eb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 -- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a00ad420 msgr2=0x7f50a0154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a00ad420 0x7f50a0154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 -- 172.21.15.196:0/2497057103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a0152e60 msgr2=0x7f50a01eb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a0152e60 0x7f50a01eb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.112 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 -- 172.21.15.196:0/2497057103 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00aca90 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509e000640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d830 tx=0x7f508c00dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00b6c0 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508c019070 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508c00ba80 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a014c190 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.109+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a01ef350 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.110+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f508c01e460 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.110+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f508c014cd0 con 0x7f50a00c5da0 2024-03-07T10:20:36.113 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.111+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a0075600 con 0x7f50a00c5da0 2024-03-07T10:20:36.114 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.113+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f50a00aca90 con 0x7f50a00c5da0 2024-03-07T10:20:36.193 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.192+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e1cfefda-e9fc-4c5c-b062-0267b166630c", "id": 5} v 0) v1 -- 0x7f50a00c5310 con 0x7f50a00c5da0 2024-03-07T10:20:36.200 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.199+0000 7f5096a00640 1 -- 172.21.15.196:0/2497057103 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e1cfefda-e9fc-4c5c-b062-0267b166630c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f508c014750 con 0x7f50a00c5da0 2024-03-07T10:20:36.201 INFO:teuthology.orchestra.run.smithi196.stdout:5 2024-03-07T10:20:36.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 msgr2=0x7f50a00abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d830 tx=0x7f508c00dcf0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 shutdown_connections 2024-03-07T10:20:36.202 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50a0152e60 0x7f50a01eb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50a00c5da0 0x7f50a00abc80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 --2- 172.21.15.196:0/2497057103 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f50a00ad420 0x7f50a0154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.200+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 >> 172.21.15.196:0/2497057103 conn(0x7f50a006b6b0 msgr2=0x7f50a0150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.201+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 shutdown_connections 2024-03-07T10:20:36.203 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.201+0000 7f509fe00640 1 -- 172.21.15.196:0/2497057103 wait complete. 2024-03-07T10:20:36.218 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.217+0000 7fa3b4fbb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-07T10:20:36.219 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new b3ff1bad-a1a2-4d35-a39f-a401591e80e6 6 2024-03-07T10:20:36.221 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.219+0000 7fc29b24c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-07T10:20:36.274 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.273+0000 7fc29b24c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-07T10:20:36.338 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.336+0000 7fa3b4fbb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-07T10:20:36.400 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.398+0000 7fc29b24c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-07T10:20:36.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.401+0000 7f9596e00640 1 Processor -- start 2024-03-07T10:20:36.403 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.401+0000 7f9596e00640 1 -- start start 2024-03-07T10:20:36.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.402+0000 7f9596e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 0x7f95900a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.404 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.402+0000 7f9596e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.402+0000 7f9596e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95900c3a70 con 0x7f9590156fb0 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.402+0000 7f9596e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95900a6270 con 0x7f9590150aa0 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.402+0000 7f9596e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900c3d50 con 0x7f95900a8620 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38818/0 (socket says 172.21.15.196:38818) 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 -- 172.21.15.196:0/4008565209 learned_addr learned my addr 172.21.15.196:0/4008565209 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.405 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595a00640 1 --2- 172.21.15.196:0/4008565209 >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 0x7f95900a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 -- 172.21.15.196:0/4008565209 >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 msgr2=0x7f95900a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:36.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 --2- 172.21.15.196:0/4008565209 >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 0x7f95900a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 -- 172.21.15.196:0/4008565209 >> v1:172.21.15.196:6789/0 conn(0x7f9590156fb0 legacy=0x7f95901573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:36.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595000640 1 -- 172.21.15.196:0/4008565209 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900c4030 con 0x7f95900a8620 2024-03-07T10:20:36.406 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.403+0000 7f9595a00640 1 --2- 172.21.15.196:0/4008565209 >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 0x7f95900a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:20:36.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.405+0000 7f9595000640 1 --2- 172.21.15.196:0/4008565209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e50 tx=0x7f957c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6db4f4194f7c02 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.405+0000 7f958fe00640 1 -- 172.21.15.196:0/4008565209 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c02ca80 con 0x7f95900a8620 2024-03-07T10:20:36.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.405+0000 7f958fe00640 1 -- 172.21.15.196:0/4008565209 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c02cc20 con 0x7f95900a8620 2024-03-07T10:20:36.407 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.405+0000 7f958fe00640 1 -- 172.21.15.196:0/4008565209 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c0343f0 con 0x7f95900a8620 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 -- 172.21.15.196:0/4008565209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 msgr2=0x7f95900a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 --2- 172.21.15.196:0/4008565209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f957c009e50 tx=0x7f957c02bee0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 -- 172.21.15.196:0/4008565209 shutdown_connections 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 --2- 172.21.15.196:0/4008565209 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f95900a8620 0x7f95900a8a80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 --2- 172.21.15.196:0/4008565209 >> v2:172.21.15.196:3300/0 conn(0x7f9590150aa0 0x7f95900a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 -- 172.21.15.196:0/4008565209 >> 172.21.15.196:0/4008565209 conn(0x7f959006cd60 msgr2=0x7f959006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 -- 172.21.15.196:0/4008565209 shutdown_connections 2024-03-07T10:20:36.408 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.406+0000 7f9596e00640 1 -- 172.21.15.196:0/4008565209 wait complete. 2024-03-07T10:20:36.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.407+0000 7f9596e00640 1 Processor -- start 2024-03-07T10:20:36.409 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 -- start start 2024-03-07T10:20:36.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95900a8620 0x7f95900bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.411 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590150e80 con 0x7f95900a8620 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590156a90 con 0x7f9590156fb0 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.408+0000 7f9596e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9590151000 con 0x7f9590150aa0 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9595000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.196:56264/0 (socket says 172.21.15.196:56264) 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 -- 172.21.15.196:0/1664375129 learned_addr learned my addr 172.21.15.196:0/1664375129 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9595000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38822/0 (socket says 172.21.15.196:38822) 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9595a00640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95900a8620 0x7f95900bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 -- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 msgr2=0x7f95900ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 -- 172.21.15.196:0/1664375129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95900a8620 msgr2=0x7f95900bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.412 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95900a8620 0x7f95900bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 -- 172.21.15.196:0/1664375129 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9590146470 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9595000640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.409+0000 7f9596400640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f958800c3c0 tx=0x7f958800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588017070 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95880052d0 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588003810 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95901ee890 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95900a6020 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f958801a070 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.410+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9588011590 con 0x7f9590156fb0 2024-03-07T10:20:36.413 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.411+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95901ee680 con 0x7f9590156fb0 2024-03-07T10:20:36.415 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.413+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9588021020 con 0x7f9590156fb0 2024-03-07T10:20:36.494 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.492+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b3ff1bad-a1a2-4d35-a39f-a401591e80e6", "id": 6} v 0) v1 -- 0x7f9590075600 con 0x7f9590156fb0 2024-03-07T10:20:36.501 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.500+0000 7f958d600640 1 -- 172.21.15.196:0/1664375129 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3ff1bad-a1a2-4d35-a39f-a401591e80e6", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9588011ae0 con 0x7f9590156fb0 2024-03-07T10:20:36.501 INFO:teuthology.orchestra.run.smithi196.stdout:6 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 msgr2=0x7f95901eb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f958800c3c0 tx=0x7f958800c880 comp rx=0 tx=0).stop 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 shutdown_connections 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9590156fb0 0x7f95901eb110 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9590150aa0 0x7f95900ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 --2- 172.21.15.196:0/1664375129 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95900a8620 0x7f95900bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 >> 172.21.15.196:0/1664375129 conn(0x7f959006cd60 msgr2=0x7f959006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 shutdown_connections 2024-03-07T10:20:36.503 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.501+0000 7f9596e00640 1 -- 172.21.15.196:0/1664375129 wait complete. 2024-03-07T10:20:36.511 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.510+0000 7fc29b24c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-07T10:20:36.519 DEBUG:teuthology.orchestra.run.smithi196:> sudo ceph --cluster ceph osd new 156119d0-ad52-47a5-88e2-86732978a1fd 7 2024-03-07T10:20:36.526 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.524+0000 7fa3b4fbb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-07T10:20:36.579 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.577+0000 7fa3b4fbb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-07T10:20:36.685 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.683+0000 7fc29b24c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-07T10:20:36.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.702+0000 7f2c6a400640 1 Processor -- start 2024-03-07T10:20:36.704 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.702+0000 7f2c6a400640 1 -- start start 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c6a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c6a400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2c640ab7c0 0x7f2c6415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c6a400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c64153760 con 0x7f2c640ab340 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c6a400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6406daf0 con 0x7f2c640ab7c0 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c6a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6406dd40 con 0x7f2c6414d6e0 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c63400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c63e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2c640ab7c0 0x7f2c6415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.706 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c63400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38824/0 (socket says 172.21.15.196:38824) 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.704+0000 7f2c63400640 1 -- 172.21.15.196:0/3693836320 learned_addr learned my addr 172.21.15.196:0/3693836320 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.705+0000 7f2c63400640 1 -- 172.21.15.196:0/3693836320 >> v2:172.21.15.196:3300/0 conn(0x7f2c640ab7c0 msgr2=0x7f2c6415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.705+0000 7f2c63400640 1 --2- 172.21.15.196:0/3693836320 >> v2:172.21.15.196:3300/0 conn(0x7f2c640ab7c0 0x7f2c6415ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.705+0000 7f2c63400640 1 -- 172.21.15.196:0/3693836320 >> v1:172.21.15.194:6789/0 conn(0x7f2c640ab340 legacy=0x7f2c640a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.705+0000 7f2c63400640 1 -- 172.21.15.196:0/3693836320 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6406e020 con 0x7f2c6414d6e0 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c63400640 1 --2- 172.21.15.196:0/3693836320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c6406dc70 tx=0x7f2c5402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc31b9b1d874e0d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.707 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c62000640 1 -- 172.21.15.196:0/3693836320 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c540317c0 con 0x7f2c6414d6e0 2024-03-07T10:20:36.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c62000640 1 -- 172.21.15.196:0/3693836320 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c54037070 con 0x7f2c6414d6e0 2024-03-07T10:20:36.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c62000640 1 -- 172.21.15.196:0/3693836320 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54031b80 con 0x7f2c6414d6e0 2024-03-07T10:20:36.708 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c6a400640 1 -- 172.21.15.196:0/3693836320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 msgr2=0x7f2c6406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.706+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3693836320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2c6406dc70 tx=0x7f2c5402b860 comp rx=0 tx=0).stop 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 -- 172.21.15.196:0/3693836320 shutdown_connections 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3693836320 >> v2:172.21.15.196:3300/0 conn(0x7f2c640ab7c0 0x7f2c6415ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3693836320 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c6414d6e0 0x7f2c6406e820 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 -- 172.21.15.196:0/3693836320 >> 172.21.15.196:0/3693836320 conn(0x7f2c6406b860 msgr2=0x7f2c640c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 -- 172.21.15.196:0/3693836320 shutdown_connections 2024-03-07T10:20:36.709 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.707+0000 7f2c6a400640 1 -- 172.21.15.196:0/3693836320 wait complete. 2024-03-07T10:20:36.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.708+0000 7f2c6a400640 1 Processor -- start 2024-03-07T10:20:36.710 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.708+0000 7f2c6a400640 1 -- start start 2024-03-07T10:20:36.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c640ab7c0 0x7f2c641ec0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c6414d6e0 0x7f2c640c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:36.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640aae10 con 0x7f2c640ab7c0 2024-03-07T10:20:36.711 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640c79c0 con 0x7f2c6414d6e0 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c6a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c640a9be0 con 0x7f2c640ab340 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c63400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c63400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.196:38840/0 (socket says 172.21.15.196:38840) 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c63e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c6414d6e0 0x7f2c640c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.709+0000 7f2c63400640 1 -- 172.21.15.196:0/3097744930 learned_addr learned my addr 172.21.15.196:0/3097744930 (peer_addr_for_me v2:172.21.15.196:0/0) 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c62a00640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c640ab7c0 0x7f2c641ec0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 -- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c6414d6e0 msgr2=0x7f2c640c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c6414d6e0 0x7f2c640c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 -- 172.21.15.196:0/3097744930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c640ab7c0 msgr2=0x7f2c641ec0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c640ab7c0 0x7f2c641ec0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.712 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 -- 172.21.15.196:0/3097744930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64070ba0 con 0x7f2c640ab340 2024-03-07T10:20:36.713 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c63400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402b8a0 tx=0x7f2c540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54032650 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c540327f0 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.710+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54032bc0 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.711+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c64154800 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.711+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c64070e60 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.711+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2c540453f0 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.711+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2c54045d40 con 0x7f2c640ab340 2024-03-07T10:20:36.714 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.712+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c64068170 con 0x7f2c640ab340 2024-03-07T10:20:36.715 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.714+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2c54040070 con 0x7f2c640ab340 2024-03-07T10:20:36.734 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.733+0000 7fc29b24c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-07T10:20:36.763 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:36.761+0000 7fa3b4fbb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-07T10:20:36.794 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.793+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd new", "uuid": "156119d0-ad52-47a5-88e2-86732978a1fd", "id": 7} v 0) v1 -- 0x7f2c640ac550 con 0x7f2c640ab340 2024-03-07T10:20:36.805 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.803+0000 7f2c5b400640 1 -- 172.21.15.196:0/3097744930 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "156119d0-ad52-47a5-88e2-86732978a1fd", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2c540456e0 con 0x7f2c640ab340 2024-03-07T10:20:36.805 INFO:teuthology.orchestra.run.smithi196.stdout:7 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 msgr2=0x7f2c64071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2c5402b8a0 tx=0x7f2c540046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 shutdown_connections 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2c6414d6e0 0x7f2c640c4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2c640ab7c0 0x7f2c641ec0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 --2- 172.21.15.196:0/3097744930 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2c640ab340 0x7f2c64071660 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.804+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 >> 172.21.15.196:0/3097744930 conn(0x7f2c6406b860 msgr2=0x7f2c6414b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:36.806 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.805+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 shutdown_connections 2024-03-07T10:20:36.807 INFO:teuthology.orchestra.run.smithi196.stderr:2024-03-07T10:20:36.805+0000 7f2c6a400640 1 -- 172.21.15.196:0/3097744930 wait complete. 2024-03-07T10:20:36.821 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-07T10:20:36.822 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-07T10:20:36.829 INFO:tasks.ceph.osd.0:Started 2024-03-07T10:20:36.829 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-07T10:20:36.829 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-07T10:20:36.836 INFO:tasks.ceph.osd.1:Started 2024-03-07T10:20:36.836 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-07T10:20:36.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-07T10:20:36.840 INFO:tasks.ceph.osd.2:Started 2024-03-07T10:20:36.841 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-07T10:20:36.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-07T10:20:36.845 INFO:tasks.ceph.osd.3:Started 2024-03-07T10:20:36.846 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-07T10:20:36.846 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-07T10:20:36.868 INFO:tasks.ceph.osd.4:Started 2024-03-07T10:20:36.868 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-07T10:20:36.869 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-07T10:20:36.875 INFO:tasks.ceph.osd.5:Started 2024-03-07T10:20:36.875 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-07T10:20:36.875 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-07T10:20:36.881 INFO:tasks.ceph.osd.6:Started 2024-03-07T10:20:36.881 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-07T10:20:36.881 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-07T10:20:36.887 INFO:tasks.ceph.osd.7:Started 2024-03-07T10:20:36.887 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:36.936 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:36.935+0000 7fc29b24c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-07T10:20:37.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.110+0000 7fc823600640 1 Processor -- start 2024-03-07T10:20:37.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.110+0000 7fc823600640 1 -- start start 2024-03-07T10:20:37.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.111+0000 7fc823600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 0x7fc81c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:37.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc823600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc81c0c8f90 0x7fc81c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:37.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc823600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81c156300 con 0x7fc81c0be720 2024-03-07T10:20:37.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc823600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc81c0cb3c0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc823600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cb980 con 0x7fc81c152e90 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc81be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc81c0be720 0x7fc81c1556b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:45728/0 (socket says 172.21.15.194:45728) 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc81be00640 1 -- 172.21.15.194:0/250253601 learned_addr learned my addr 172.21.15.194:0/250253601 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc821600640 1 --2- 172.21.15.194:0/250253601 >> v2:172.21.15.194:3300/0 conn(0x7fc81c0c8f90 0x7fc81c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc820c00640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 0x7fc81c0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc821600640 1 -- 172.21.15.194:0/250253601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 msgr2=0x7fc81c0c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc821600640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 0x7fc81c0c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc821600640 1 -- 172.21.15.194:0/250253601 >> v1:172.21.15.194:6789/0 conn(0x7fc81c0be720 legacy=0x7fc81c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:37.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc821600640 1 -- 172.21.15.194:0/250253601 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c159750 con 0x7fc81c0c8f90 2024-03-07T10:20:37.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc820c00640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 0x7fc81c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:37.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.112+0000 7fc81b400640 1 -- 172.21.15.194:0/250253601 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120577820 0 0) 0x7fc81c156300 con 0x7fc81c0be720 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc821600640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c0c8f90 0x7fc81c155dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc814009d90 tx=0x7fc81402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=366de305f6f06cdd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc81b400640 1 -- 172.21.15.194:0/250253601 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814039070 con 0x7fc81c0c8f90 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc81b400640 1 -- 172.21.15.194:0/250253601 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81402cb30 con 0x7fc81c0c8f90 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc81b400640 1 -- 172.21.15.194:0/250253601 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc814034440 con 0x7fc81c0c8f90 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 -- 172.21.15.194:0/250253601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c0c8f90 msgr2=0x7fc81c155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c0c8f90 0x7fc81c155dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc814009d90 tx=0x7fc81402bd80 comp rx=0 tx=0).stop 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 -- 172.21.15.194:0/250253601 shutdown_connections 2024-03-07T10:20:37.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c0c8f90 0x7fc81c155dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 --2- 172.21.15.194:0/250253601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c152e90 0x7fc81c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.114+0000 7fc823600640 1 -- 172.21.15.194:0/250253601 >> 172.21.15.194:0/250253601 conn(0x7fc81c066f70 msgr2=0x7fc81c067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.115+0000 7fc823600640 1 -- 172.21.15.194:0/250253601 shutdown_connections 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.115+0000 7fc823600640 1 -- 172.21.15.194:0/250253601 wait complete. 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.116+0000 7fc823600640 1 Processor -- start 2024-03-07T10:20:37.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.116+0000 7fc823600640 1 -- start start 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 0x7fc81c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 0x7fc81c0b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c06d850 con 0x7fc81c152e90 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c0cb610 con 0x7fc81c0be720 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc823600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc81c06d9d0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc821600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc821600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42136/0 (socket says 172.21.15.194:42136) 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc821600640 1 -- 172.21.15.194:0/4276076109 learned_addr learned my addr 172.21.15.194:0/4276076109 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc820c00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 0x7fc81c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:37.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.117+0000 7fc81be00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 0x7fc81c0b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 -- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 msgr2=0x7fc81c154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 0x7fc81c154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 -- 172.21.15.194:0/4276076109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 msgr2=0x7fc81c0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 -- 172.21.15.194:0/4276076109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c1ebd50 con 0x7fc81c0c8f90 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc820c00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 0x7fc81c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc821600640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc81be00640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 0x7fc81c0b0310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc80800c3e0 tx=0x7fc80800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8080074e0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8080047e0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c14c290 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.118+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc808004bd0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.119+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc81c154d60 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.119+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fc808011070 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.119+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fc808004d70 con 0x7fc81c0c8f90 2024-03-07T10:20:37.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.120+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc81c068170 con 0x7fc81c0c8f90 2024-03-07T10:20:37.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.122+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fc80801d3f0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.207+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc81c06d580 con 0x7fc81c0c8f90 2024-03-07T10:20:37.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.208+0000 7fc818c00640 1 -- 172.21.15.194:0/4276076109 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fc80801d5d0 con 0x7fc81c0c8f90 2024-03-07T10:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:37.209 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":10,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:36.795645+0000","last_up_change":"0.000000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 msgr2=0x7fc81c0b0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 0x7fc81c0b0310 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc80800c3e0 tx=0x7fc80800c8a0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 shutdown_connections 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc81c152e90 0x7fc81c0b0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc81c0c8f90 0x7fc81c0b0310 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 --2- 172.21.15.194:0/4276076109 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc81c0be720 0x7fc81c154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 >> 172.21.15.194:0/4276076109 conn(0x7fc81c066f70 msgr2=0x7fc81c0c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 shutdown_connections 2024-03-07T10:20:37.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:37.209+0000 7fc823600640 1 -- 172.21.15.194:0/4276076109 wait complete. 2024-03-07T10:20:37.227 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-07T10:20:37.227 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-07T10:20:37.520 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-03-07T10:20:37.519+0000 7f2d44506640 -1 Falling back to public interface 2024-03-07T10:20:37.542 INFO:tasks.ceph.osd.0.smithi194.stderr:2024-03-07T10:20:37.541+0000 7f698f017640 -1 Falling back to public interface 2024-03-07T10:20:37.555 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-03-07T10:20:37.554+0000 7fcc64ebf640 -1 Falling back to public interface 2024-03-07T10:20:37.560 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-03-07T10:20:37.559+0000 7f0a47624640 -1 Falling back to public interface 2024-03-07T10:20:37.570 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-07T10:20:37.569+0000 7f971000e640 -1 Falling back to public interface 2024-03-07T10:20:37.572 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-07T10:20:37.571+0000 7fd3ce51b640 -1 Falling back to public interface 2024-03-07T10:20:37.586 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-07T10:20:37.585+0000 7f7b5899a640 -1 Falling back to public interface 2024-03-07T10:20:37.587 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-07T10:20:37.586+0000 7fbb2a40f640 -1 Falling back to public interface 2024-03-07T10:20:37.881 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:37.880+0000 7fa3b4fbb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-07T10:20:38.032 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:38.071 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:38.070+0000 7fc29b24c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-07T10:20:38.194 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:38.193+0000 7fa3b4fbb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-07T10:20:38.203 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.201+0000 7fa65b600640 1 Processor -- start 2024-03-07T10:20:38.203 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.201+0000 7fa65b600640 1 -- start start 2024-03-07T10:20:38.208 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.202+0000 7fa65b600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 0x7fa6540c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:38.208 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.202+0000 7fa65b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6540c5ee0 0x7fa6540c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:38.208 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.202+0000 7fa65b600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa654155910 con 0x7fa65406c200 2024-03-07T10:20:38.208 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.202+0000 7fa65b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654155bf0 con 0x7fa6540c5ee0 2024-03-07T10:20:38.208 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.202+0000 7fa65b600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa654155ed0 con 0x7fa654152d20 2024-03-07T10:20:38.209 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa659600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6540c5ee0 0x7fa6540c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:38.209 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa658c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 0x7fa6540c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:38.209 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa653e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fa65406c200 0x7fa6540c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:58430/0 (socket says 172.21.15.194:58430) 2024-03-07T10:20:38.209 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa653e00640 1 -- 172.21.15.194:0/4140226162 learned_addr learned my addr 172.21.15.194:0/4140226162 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:20:38.209 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa653400640 1 -- 172.21.15.194:0/4140226162 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076869060 0 0) 0x7fa654155910 con 0x7fa65406c200 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa653400640 1 -- 172.21.15.194:0/4140226162 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003520 con 0x7fa65406c200 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa659600640 1 -- 172.21.15.194:0/4140226162 >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 msgr2=0x7fa6540c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa659600640 1 --2- 172.21.15.194:0/4140226162 >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 0x7fa6540c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa659600640 1 -- 172.21.15.194:0/4140226162 >> v1:172.21.15.196:6789/0 conn(0x7fa65406c200 legacy=0x7fa6540c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa659600640 1 -- 172.21.15.194:0/4140226162 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6541561b0 con 0x7fa6540c5ee0 2024-03-07T10:20:38.210 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.203+0000 7fa658c00640 1 --2- 172.21.15.194:0/4140226162 >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 0x7fa6540c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:38.211 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa659600640 1 --2- 172.21.15.194:0/4140226162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6540c5ee0 0x7fa6540c96c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009d90 tx=0x7fa64c02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aae752efc665033 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:38.211 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa653400640 1 -- 172.21.15.194:0/4140226162 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c039070 con 0x7fa6540c5ee0 2024-03-07T10:20:38.211 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa653400640 1 -- 172.21.15.194:0/4140226162 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c02cb40 con 0x7fa6540c5ee0 2024-03-07T10:20:38.211 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa653400640 1 -- 172.21.15.194:0/4140226162 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c034440 con 0x7fa6540c5ee0 2024-03-07T10:20:38.211 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 -- 172.21.15.194:0/4140226162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6540c5ee0 msgr2=0x7fa6540c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 --2- 172.21.15.194:0/4140226162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6540c5ee0 0x7fa6540c96c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009d90 tx=0x7fa64c02bd90 comp rx=0 tx=0).stop 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 -- 172.21.15.194:0/4140226162 shutdown_connections 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 --2- 172.21.15.194:0/4140226162 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6540c5ee0 0x7fa6540c96c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 --2- 172.21.15.194:0/4140226162 >> v2:172.21.15.196:3300/0 conn(0x7fa654152d20 0x7fa6540c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.205+0000 7fa65b600640 1 -- 172.21.15.194:0/4140226162 >> 172.21.15.194:0/4140226162 conn(0x7fa6540acfb0 msgr2=0x7fa6540ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:38.212 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.206+0000 7fa65b600640 1 -- 172.21.15.194:0/4140226162 shutdown_connections 2024-03-07T10:20:38.213 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.206+0000 7fa65b600640 1 -- 172.21.15.194:0/4140226162 wait complete. 2024-03-07T10:20:38.218 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.207+0000 7fa65b600640 1 Processor -- start 2024-03-07T10:20:38.218 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.207+0000 7fa65b600640 1 -- start start 2024-03-07T10:20:38.218 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa65406c200 0x7fa65414e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:38.218 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6540c5ee0 0x7fa6541ec590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540cacf0 con 0x7fa654152d20 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa654153100 con 0x7fa65406c200 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa65b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65406bbf0 con 0x7fa6540c5ee0 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa659600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:38.219 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa659600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42146/0 (socket says 172.21.15.194:42146) 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa659600640 1 -- 172.21.15.194:0/2166017891 learned_addr learned my addr 172.21.15.194:0/2166017891 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa653e00640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6540c5ee0 0x7fa6541ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.208+0000 7fa658c00640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa65406c200 0x7fa65414e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 -- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6540c5ee0 msgr2=0x7fa6541ec590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6540c5ee0 0x7fa6541ec590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.220 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 -- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa65406c200 msgr2=0x7fa65414e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa65406c200 0x7fa65414e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 -- 172.21.15.194:0/2166017891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654159bc0 con 0x7fa654152d20 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa659600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009eb0 tx=0x7fa64c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c039050 con 0x7fa654152d20 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c045070 con 0x7fa654152d20 2024-03-07T10:20:38.221 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c03e830 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6540c4080 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.209+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6540c4340 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.210+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fa64c03e9d0 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.210+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa64c03ecc0 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.210+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa654068160 con 0x7fa654152d20 2024-03-07T10:20:38.222 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.213+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fa64c04a460 con 0x7fa654152d20 2024-03-07T10:20:38.256 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:38.254+0000 7fa3b4fbb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-07T10:20:38.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.280+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6540caad0 con 0x7fa654152d20 2024-03-07T10:20:38.282 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.281+0000 7fa650c00640 1 -- 172.21.15.194:0/2166017891 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fa64c04a640 con 0x7fa654152d20 2024-03-07T10:20:38.282 INFO:teuthology.misc.health.smithi194.stdout: 2024-03-07T10:20:38.282 INFO:teuthology.misc.health.smithi194.stdout:{"epoch":10,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:36.795645+0000","last_up_change":"0.000000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 msgr2=0x7fa6541ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009eb0 tx=0x7fa64c004a40 comp rx=0 tx=0).stop 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 shutdown_connections 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa654152d20 0x7fa6541ecad0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6540c5ee0 0x7fa6541ec590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 --2- 172.21.15.194:0/2166017891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa65406c200 0x7fa65414e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 >> 172.21.15.194:0/2166017891 conn(0x7fa6540acfb0 msgr2=0x7fa654151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 shutdown_connections 2024-03-07T10:20:38.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:38.282+0000 7fa65b600640 1 -- 172.21.15.194:0/2166017891 wait complete. 2024-03-07T10:20:38.296 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-07T10:20:38.386 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:38.384+0000 7fa3b4fbb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-07T10:20:38.402 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:38.400+0000 7fc29b24c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-07T10:20:38.467 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:38.465+0000 7fc29b24c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-07T10:20:38.594 INFO:tasks.ceph.mgr.y.smithi194.stderr:2024-03-07T10:20:38.592+0000 7fc29b24c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-07T10:20:39.433 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:39.431+0000 7fa354400640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-07T10:20:39.433 INFO:tasks.ceph.mgr.x.smithi196.stderr:2024-03-07T10:20:39.432+0000 7fa354400640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-07T10:20:41.064 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-03-07T10:20:41.063+0000 7f2d44506640 -1 osd.1 0 log_to_monitors true 2024-03-07T10:20:41.123 INFO:tasks.ceph.osd.0.smithi194.stderr:2024-03-07T10:20:41.121+0000 7f698f017640 -1 osd.0 0 log_to_monitors true 2024-03-07T10:20:41.141 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-07T10:20:41.139+0000 7fd3ce51b640 -1 osd.4 0 log_to_monitors true 2024-03-07T10:20:41.150 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-03-07T10:20:41.149+0000 7f0a47624640 -1 osd.3 0 log_to_monitors true 2024-03-07T10:20:41.152 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-07T10:20:41.150+0000 7f7b5899a640 -1 osd.6 0 log_to_monitors true 2024-03-07T10:20:41.156 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-03-07T10:20:41.154+0000 7fcc64ebf640 -1 osd.2 0 log_to_monitors true 2024-03-07T10:20:41.161 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-07T10:20:41.160+0000 7fbb2a40f640 -1 osd.7 0 log_to_monitors true 2024-03-07T10:20:41.385 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-07T10:20:41.383+0000 7f971000e640 -1 osd.5 0 log_to_monitors true 2024-03-07T10:20:44.721 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-03-07T10:20:44.720+0000 7f0a41600640 -1 osd.3 0 waiting for initial osdmap 2024-03-07T10:20:44.727 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-07T10:20:44.725+0000 7f970ba00640 -1 osd.5 0 waiting for initial osdmap 2024-03-07T10:20:44.732 INFO:tasks.ceph.osd.3.smithi194.stderr:2024-03-07T10:20:44.730+0000 7f0a38000640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.734 INFO:tasks.ceph.osd.5.smithi196.stderr:2024-03-07T10:20:44.733+0000 7f9700600640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.738 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-07T10:20:44.737+0000 7f7b54800640 -1 osd.6 0 waiting for initial osdmap 2024-03-07T10:20:44.747 INFO:tasks.ceph.osd.6.smithi196.stderr:2024-03-07T10:20:44.746+0000 7f7b49400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.758 INFO:tasks.ceph.osd.0.smithi194.stderr:2024-03-07T10:20:44.757+0000 7f698aa00640 -1 osd.0 0 waiting for initial osdmap 2024-03-07T10:20:44.765 INFO:tasks.ceph.osd.0.smithi194.stderr:2024-03-07T10:20:44.763+0000 7f697f600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.768 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-03-07T10:20:44.766+0000 7f2d40400640 -1 osd.1 0 waiting for initial osdmap 2024-03-07T10:20:44.774 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-07T10:20:44.773+0000 7fbb23e00640 -1 osd.7 0 waiting for initial osdmap 2024-03-07T10:20:44.780 INFO:tasks.ceph.osd.1.smithi194.stderr:2024-03-07T10:20:44.778+0000 7f2d35000640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.782 INFO:tasks.ceph.osd.7.smithi196.stderr:2024-03-07T10:20:44.780+0000 7fbb1a800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.804 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-07T10:20:44.803+0000 7fd3c8600640 -1 osd.4 0 waiting for initial osdmap 2024-03-07T10:20:44.809 INFO:tasks.ceph.osd.4.smithi196.stderr:2024-03-07T10:20:44.807+0000 7fd3bf000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:44.834 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-03-07T10:20:44.833+0000 7fcc5f000640 -1 osd.2 0 waiting for initial osdmap 2024-03-07T10:20:44.845 INFO:tasks.ceph.osd.2.smithi194.stderr:2024-03-07T10:20:44.844+0000 7fcc55a00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-07T10:20:45.103 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:45.278 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.276+0000 7f6fa4c00640 1 Processor -- start 2024-03-07T10:20:45.278 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.276+0000 7f6fa4c00640 1 -- start start 2024-03-07T10:20:45.279 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.278+0000 7f6fa4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.279 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.278+0000 7f6fa4c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 0x7f6fa00c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.279 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.278+0000 7f6fa4c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa0155ec0 con 0x7f6fa00c8590 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.278+0000 7f6fa4c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa0158d20 con 0x7f6fa00c74b0 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.278+0000 7f6fa4c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c7e90 con 0x7f6fa0152f60 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 0x7f6fa00c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58410/0 (socket says 172.21.15.194:58410) 2024-03-07T10:20:45.280 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 -- 172.21.15.194:0/2543404152 learned_addr learned my addr 172.21.15.194:0/2543404152 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:45.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 -- 172.21.15.194:0/2543404152 >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 msgr2=0x7f6fa00c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:45.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 --2- 172.21.15.194:0/2543404152 >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 0x7f6fa00c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 -- 172.21.15.194:0/2543404152 >> v1:172.21.15.196:6789/0 conn(0x7f6fa00c8590 legacy=0x7f6fa01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9de00640 1 -- 172.21.15.194:0/2543404152 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa00c8170 con 0x7f6fa0152f60 2024-03-07T10:20:45.281 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.279+0000 7f6f9e800640 1 --2- 172.21.15.194:0/2543404152 >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 0x7f6fa00c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:45.282 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.281+0000 7f6f9de00640 1 --2- 172.21.15.194:0/2543404152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009870 tx=0x7f6f9002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72abb46e02f82faa server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:45.282 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.281+0000 7f6f9d400640 1 -- 172.21.15.194:0/2543404152 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90034070 con 0x7f6fa0152f60 2024-03-07T10:20:45.283 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.281+0000 7f6f9d400640 1 -- 172.21.15.194:0/2543404152 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f90030840 con 0x7f6fa0152f60 2024-03-07T10:20:45.283 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.281+0000 7f6f9d400640 1 -- 172.21.15.194:0/2543404152 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f90030c10 con 0x7f6fa0152f60 2024-03-07T10:20:45.283 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 -- 172.21.15.194:0/2543404152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 msgr2=0x7f6fa01597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.283 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/2543404152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6f90009870 tx=0x7f6f9002b980 comp rx=0 tx=0).stop 2024-03-07T10:20:45.283 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 -- 172.21.15.194:0/2543404152 shutdown_connections 2024-03-07T10:20:45.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/2543404152 >> v2:172.21.15.196:3300/0 conn(0x7f6fa00c74b0 0x7f6fa00c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/2543404152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa0152f60 0x7f6fa01597e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 -- 172.21.15.194:0/2543404152 >> 172.21.15.194:0/2543404152 conn(0x7f6fa00c8ef0 msgr2=0x7f6fa00c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:45.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 -- 172.21.15.194:0/2543404152 shutdown_connections 2024-03-07T10:20:45.284 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.282+0000 7f6fa4c00640 1 -- 172.21.15.194:0/2543404152 wait complete. 2024-03-07T10:20:45.285 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.283+0000 7f6fa4c00640 1 Processor -- start 2024-03-07T10:20:45.285 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 -- start start 2024-03-07T10:20:45.286 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 0x7f6fa01ebf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 0x7f6fa0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c4840 con 0x7f6fa00c8590 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01592c0 con 0x7f6fa0152f60 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.284+0000 7f6fa4c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa00c49c0 con 0x7f6fa00c74b0 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46854/0 (socket says 172.21.15.194:46854) 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 -- 172.21.15.194:0/3076241807 learned_addr learned my addr 172.21.15.194:0/3076241807 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f9e800640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 0x7f6fa0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f9de00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 0x7f6fa01ebf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 -- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 msgr2=0x7f6fa01ebf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 0x7f6fa01ebf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 -- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 msgr2=0x7f6fa0151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 0x7f6fa0151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.287 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 -- 172.21.15.194:0/3076241807 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa01ec490 con 0x7f6fa00c8590 2024-03-07T10:20:45.288 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f9e800640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 0x7f6fa0151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:45.288 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f9de00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 0x7f6fa01ebf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:45.288 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.285+0000 7f6f95400640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c450 tx=0x7f6f8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:45.288 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.286+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f880052d0 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.286+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f88005470 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.286+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa014f520 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.286+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88012870 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.286+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa01eb750 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.287+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fa01eb540 con 0x7f6fa00c8590 2024-03-07T10:20:45.289 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.288+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 4) v1 ==== 89722+0+0 (secure 0 0 0) 0x7f6f88012a10 con 0x7f6fa00c8590 2024-03-07T10:20:45.290 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.289+0000 7f6f96a00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 0x7f6f7c06d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:45.290 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.289+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f6f88088ed0 con 0x7f6fa00c8590 2024-03-07T10:20:45.290 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.289+0000 7f6f9de00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 0x7f6f7c06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:45.291 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.290+0000 7f6f9de00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 0x7f6f7c06d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f90036000 tx=0x7f6f9003b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:45.295 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.294+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6f88058c50 con 0x7f6fa00c8590 2024-03-07T10:20:45.482 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.481+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fa0068160 con 0x7f6fa00c8590 2024-03-07T10:20:45.484 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.482+0000 7f6f96a00640 1 -- 172.21.15.194:0/3076241807 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f6f88058550 con 0x7f6fa00c8590 2024-03-07T10:20:45.484 INFO:teuthology.misc.health.smithi194.stdout: 2024-03-07T10:20:45.485 INFO:teuthology.misc.health.smithi194.stdout:{"epoch":12,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:42.431763+0000","last_up_change":"0.000000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:45.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 msgr2=0x7f6f7c06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 0x7f6f7c06d900 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6f90036000 tx=0x7f6f9003b040 comp rx=0 tx=0).stop 2024-03-07T10:20:45.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 msgr2=0x7f6fa014efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:45.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c450 tx=0x7f6f8800c910 comp rx=0 tx=0).stop 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 shutdown_connections 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6f7c06b440 0x7f6f7c06d900 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6fa0152f60 0x7f6fa0151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6fa00c8590 0x7f6fa014efe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 --2- 172.21.15.194:0/3076241807 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6fa00c74b0 0x7f6fa01ebf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 >> 172.21.15.194:0/3076241807 conn(0x7f6fa00c8ef0 msgr2=0x7f6fa00c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 shutdown_connections 2024-03-07T10:20:45.488 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:45.485+0000 7f6fa4c00640 1 -- 172.21.15.194:0/3076241807 wait complete. 2024-03-07T10:20:45.500 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-07T10:20:47.494 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:20:47.502 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:20:52.307 DEBUG:teuthology.orchestra.run.smithi194:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:52.483 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.481+0000 7f1092e00640 1 Processor -- start 2024-03-07T10:20:52.483 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.481+0000 7f1092e00640 1 -- start start 2024-03-07T10:20:52.484 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f1092e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f108c13e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.484 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f1092e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c13f000 con 0x7f108c0c0540 2024-03-07T10:20:52.484 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f1092e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c06e410 con 0x7f108c13eb90 2024-03-07T10:20:52.484 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f1092e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c06e6f0 con 0x7f108c155780 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f108be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f108c0c0540 0x7f108c06db30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:45174/0 (socket says 172.21.15.194:45174) 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.483+0000 7f108be00640 1 -- 172.21.15.194:0/3836573413 learned_addr learned my addr 172.21.15.194:0/3836573413 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f1083400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f108c13e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142975063 0 0) 0x7f108c13f000 con 0x7f108c0c0540 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1070003520 con 0x7f108c0c0540 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3934865837 0 0) 0x7f1070003520 con 0x7f108c0c0540 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 msgr2=0x7f108c13e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f108c13e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 >> v1:172.21.15.196:6789/0 conn(0x7f108c13eb90 legacy=0x7f108c0c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c06e9d0 con 0x7f108c0c0540 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f107c001670 con 0x7f108c0c0540 2024-03-07T10:20:52.486 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 >> v1:172.21.15.194:6789/0 conn(0x7f108c0c0540 legacy=0x7f108c06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10700039e0 0x7f1070003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f1070004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c06e6f0 con 0x7f1070004d40 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107000bb50 con 0x7f10700039e0 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.484+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107000bd20 con 0x7f108c155780 2024-03-07T10:20:52.487 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1070004d40 0x7f10700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1083400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f1070004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f108be00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10700039e0 0x7f1070003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 -- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 msgr2=0x7f1070004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f1070004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 -- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10700039e0 msgr2=0x7f1070003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10700039e0 0x7f1070003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1090e00640 1 -- 172.21.15.194:0/3836573413 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070003520 con 0x7f1070004d40 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.485+0000 7f1083400640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c155780 0x7f1070004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.486+0000 7f1090e00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1070004d40 0x7f10700051c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1084001e80 tx=0x7f1070005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a55186e481b0f1c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.486+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084001a70 con 0x7f1070004d40 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.486+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084003b70 con 0x7f1070004d40 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.486+0000 7f108b400640 1 -- 172.21.15.194:0/3836573413 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10840050d0 con 0x7f1070004d40 2024-03-07T10:20:52.489 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 -- 172.21.15.194:0/3836573413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1070004d40 msgr2=0x7f10700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 --2- 172.21.15.194:0/3836573413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1070004d40 0x7f10700051c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1084001e80 tx=0x7f1070005830 comp rx=0 tx=0).stop 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1090e00640 1 -- 172.21.15.194:0/3836573413 reap_dead start 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 -- 172.21.15.194:0/3836573413 shutdown_connections 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 -- 172.21.15.194:0/3836573413 >> 172.21.15.194:0/3836573413 conn(0x7f108c0c7500 msgr2=0x7f108c06b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 -- 172.21.15.194:0/3836573413 shutdown_connections 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.487+0000 7f1092e00640 1 -- 172.21.15.194:0/3836573413 wait complete. 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.489+0000 7f1092e00640 1 Processor -- start 2024-03-07T10:20:52.490 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.489+0000 7f1092e00640 1 -- start start 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1070004d40 0x7f108c157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 0x7f108c1575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0c0920 con 0x7f108c1391b0 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c06ef90 con 0x7f1070004d40 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1092e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0c0aa0 con 0x7f108c139fe0 2024-03-07T10:20:52.492 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1090e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1090e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55764/0 (socket says 172.21.15.194:55764) 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.490+0000 7f1090e00640 1 -- 172.21.15.194:0/1214457896 learned_addr learned my addr 172.21.15.194:0/1214457896 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f108be00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1070004d40 0x7f108c157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1083400640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 0x7f108c1575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 -- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 msgr2=0x7f108c1575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 0x7f108c1575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 -- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1070004d40 msgr2=0x7f108c157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1070004d40 0x7f108c157080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 -- 172.21.15.194:0/1214457896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c157b00 con 0x7f108c1391b0 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1083400640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 0x7f108c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:52.493 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1090e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1084001fa0 tx=0x7f10840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084007db0 con 0x7f108c1391b0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084003970 con 0x7f108c1391b0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c1ec240 con 0x7f108c1391b0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108402f6a0 con 0x7f108c1391b0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.491+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c153170 con 0x7f108c1391b0 2024-03-07T10:20:52.494 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.493+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c068160 con 0x7f108c1391b0 2024-03-07T10:20:52.499 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.494+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1084041030 con 0x7f108c1391b0 2024-03-07T10:20:52.499 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.495+0000 7f1088c00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 0x7f106806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.499 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.495+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10840aaef0 con 0x7f108c1391b0 2024-03-07T10:20:52.499 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.496+0000 7f108be00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 0x7f106806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.499 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.497+0000 7f108be00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 0x7f106806d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f107c001eb0 tx=0x7f107c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.502 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.501+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1084033020 con 0x7f108c1391b0 2024-03-07T10:20:52.704 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.702+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f108c13d060 con 0x7f108c1391b0 2024-03-07T10:20:52.706 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.704+0000 7f1088c00640 1 -- 172.21.15.194:0/1214457896 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f108407a020 con 0x7f108c1391b0 2024-03-07T10:20:52.706 INFO:teuthology.misc.health.smithi194.stdout: 2024-03-07T10:20:52.706 INFO:teuthology.misc.health.smithi194.stdout:{"epoch":16,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:48.766884+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 msgr2=0x7f106806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 0x7f106806d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f107c001eb0 tx=0x7f107c009040 comp rx=0 tx=0).stop 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 msgr2=0x7f108c139630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1084001fa0 tx=0x7f10840014a0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 shutdown_connections 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f106806b500 0x7f106806d9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.709 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f108c1391b0 0x7f108c139630 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.710 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f108c139fe0 0x7f108c1575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.710 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 --2- 172.21.15.194:0/1214457896 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1070004d40 0x7f108c157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.710 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 >> 172.21.15.194:0/1214457896 conn(0x7f108c0c7500 msgr2=0x7f108c0c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:52.710 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 shutdown_connections 2024-03-07T10:20:52.710 INFO:teuthology.misc.health.smithi194.stderr:2024-03-07T10:20:52.707+0000 7f1092e00640 1 -- 172.21.15.194:0/1214457896 wait complete. 2024-03-07T10:20:52.724 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-07T10:20:52.724 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-07T10:20:52.724 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-07T10:20:52.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-07T10:20:52.731 INFO:tasks.ceph.mds.a:Started 2024-03-07T10:20:52.731 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-07T10:20:52.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-07T10:20:52.739 INFO:tasks.ceph.mds.c:Started 2024-03-07T10:20:52.740 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-07T10:20:52.740 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-07T10:20:52.747 INFO:tasks.ceph.mds.b:Started 2024-03-07T10:20:52.748 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-07T10:20:52.748 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-07T10:20:52.755 INFO:tasks.ceph.mds.d:Started 2024-03-07T10:20:52.755 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-07T10:20:52.755 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:52.881 INFO:tasks.ceph.mds.a.smithi194.stdout:starting mds.a at 2024-03-07T10:20:52.889 INFO:tasks.ceph.mds.c.smithi194.stdout:starting mds.c at 2024-03-07T10:20:52.910 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-03-07T10:20:52.917 INFO:tasks.ceph.mds.d.smithi196.stdout:starting mds.d at 2024-03-07T10:20:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.934+0000 7f2234e00640 1 Processor -- start 2024-03-07T10:20:52.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.935+0000 7f2234e00640 1 -- start start 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2230152e90 0x7f22300c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22300be720 0x7f22301556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f22300c8f90 0x7f2230155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300cb3c0 con 0x7f2230152e90 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300cb980 con 0x7f22300c8f90 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f2234e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2230159750 con 0x7f22300be720 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2230152e90 0x7f22300c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f22300c8f90 0x7f2230155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2230152e90 0x7f22300c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55782/0 (socket says 172.21.15.194:55782) 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 -- 172.21.15.194:0/3128225606 learned_addr learned my addr 172.21.15.194:0/3128225606 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:52.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222d400640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22300be720 0x7f22301556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 -- 172.21.15.194:0/3128225606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22300be720 msgr2=0x7f22301556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22300be720 0x7f22301556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 -- 172.21.15.194:0/3128225606 >> v2:172.21.15.196:3300/0 conn(0x7f22300c8f90 msgr2=0x7f2230155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 --2- 172.21.15.194:0/3128225606 >> v2:172.21.15.196:3300/0 conn(0x7f22300c8f90 0x7f2230155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.936+0000 7f222de00640 1 -- 172.21.15.194:0/3128225606 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230159a30 con 0x7f2230152e90 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.937+0000 7f222de00640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2230152e90 0x7f22300c5a10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22300c75e0 tx=0x7f222002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f00ea3a2e216eee server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f222ca00640 1 -- 172.21.15.194:0/3128225606 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220038070 con 0x7f2230152e90 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f222ca00640 1 -- 172.21.15.194:0/3128225606 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222002f050 con 0x7f2230152e90 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f222ca00640 1 -- 172.21.15.194:0/3128225606 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220031970 con 0x7f2230152e90 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 -- 172.21.15.194:0/3128225606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2230152e90 msgr2=0x7f22300c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2230152e90 0x7f22300c5a10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f22300c75e0 tx=0x7f222002b7f0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 -- 172.21.15.194:0/3128225606 shutdown_connections 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 --2- 172.21.15.194:0/3128225606 >> v2:172.21.15.196:3300/0 conn(0x7f22300c8f90 0x7f2230155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22300be720 0x7f22301556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 --2- 172.21.15.194:0/3128225606 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2230152e90 0x7f22300c5a10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 -- 172.21.15.194:0/3128225606 >> 172.21.15.194:0/3128225606 conn(0x7f2230066f70 msgr2=0x7f2230067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 -- 172.21.15.194:0/3128225606 shutdown_connections 2024-03-07T10:20:52.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.938+0000 7f2234e00640 1 -- 172.21.15.194:0/3128225606 wait complete. 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.940+0000 7f2234e00640 1 Processor -- start 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.940+0000 7f2234e00640 1 -- start start 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 0x7f2230154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 0x7f22300ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223006d9d0 con 0x7f22300c8f90 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223006d850 con 0x7f22300be720 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f2234e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2230156130 con 0x7f2230152e90 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 0x7f22300ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 0x7f2230154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 0x7f22300ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55786/0 (socket says 172.21.15.194:55786) 2024-03-07T10:20:52.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:45222/0 (socket says 172.21.15.194:45222) 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.941+0000 7f222d400640 1 -- 172.21.15.194:0/4075841886 learned_addr learned my addr 172.21.15.194:0/4075841886 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 -- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 msgr2=0x7f2230150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 -- 172.21.15.194:0/4075841886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 msgr2=0x7f22300ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 0x7f22300ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 -- 172.21.15.194:0/4075841886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300ac920 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222e800640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f222de00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 0x7f2230154e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2220033000 tx=0x7f22200046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220042070 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222003d660 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2230156940 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220038040 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.942+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22301ec0d0 con 0x7f22300be720 2024-03-07T10:20:52.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.943+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2230068170 con 0x7f22300be720 2024-03-07T10:20:52.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.944+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f2220045070 con 0x7f22300be720 2024-03-07T10:20:52.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.945+0000 7f2226000640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 0x7f221006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:52.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.945+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f22200abd50 con 0x7f22300be720 2024-03-07T10:20:52.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.946+0000 7f222d400640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 0x7f221006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:52.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.946+0000 7f222d400640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 0x7f221006d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22300ca5c0 tx=0x7f221c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:52.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:52.951+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f222007a9e0 con 0x7f22300be720 2024-03-07T10:20:53.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.142+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f223006d580 con 0x7f22300be720 2024-03-07T10:20:53.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.144+0000 7f2226000640 1 -- 172.21.15.194:0/4075841886 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f222007ea80 con 0x7f22300be720 2024-03-07T10:20:53.147 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:53.147 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":16,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:48.766884+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:53.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.146+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 msgr2=0x7f221006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.146+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 0x7f221006d990 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f22300ca5c0 tx=0x7f221c009190 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.146+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 msgr2=0x7f2230154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.146+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 0x7f2230154e90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2220033000 tx=0x7f22200046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 shutdown_connections 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f221006b4d0 0x7f221006d990 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2230152e90 0x7f2230150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22300c8f90 0x7f22300ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 --2- 172.21.15.194:0/4075841886 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22300be720 0x7f2230154e90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 >> 172.21.15.194:0/4075841886 conn(0x7f2230066f70 msgr2=0x7f22300c7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 shutdown_connections 2024-03-07T10:20:53.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.147+0000 7f2234e00640 1 -- 172.21.15.194:0/4075841886 wait complete. 2024-03-07T10:20:53.166 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:20:53.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:20:53.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.357+0000 7fde5e000640 1 Processor -- start 2024-03-07T10:20:53.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.357+0000 7fde5e000640 1 -- start start 2024-03-07T10:20:53.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.358+0000 7fde5e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde58153280 0x7fde58156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fde580a5f50 0x7fde580a8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde580c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5e000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580c3160 con 0x7fde58153280 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde580c33d0 con 0x7fde580a5f50 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c36b0 con 0x7fde580a8b60 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde58153280 0x7fde58156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fde58153280 0x7fde58156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55798/0 (socket says 172.21.15.194:55798) 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 -- 172.21.15.194:0/3648198397 learned_addr learned my addr 172.21.15.194:0/3648198397 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 -- 172.21.15.194:0/3648198397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 msgr2=0x7fde580c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 --2- 172.21.15.194:0/3648198397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde580c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 -- 172.21.15.194:0/3648198397 >> v2:172.21.15.196:3300/0 conn(0x7fde580a5f50 msgr2=0x7fde580a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 --2- 172.21.15.194:0/3648198397 >> v2:172.21.15.196:3300/0 conn(0x7fde580a5f50 0x7fde580a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.359+0000 7fde5cc00640 1 -- 172.21.15.194:0/3648198397 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde580c3990 con 0x7fde58153280 2024-03-07T10:20:53.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.360+0000 7fde5cc00640 1 --2- 172.21.15.194:0/3648198397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde58156520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde580c0f50 tx=0x7fde4c02db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c3f800f28f8173 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde57400640 1 -- 172.21.15.194:0/3648198397 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c02f8e0 con 0x7fde58153280 2024-03-07T10:20:53.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde57400640 1 -- 172.21.15.194:0/3648198397 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c02fa80 con 0x7fde58153280 2024-03-07T10:20:53.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde57400640 1 -- 172.21.15.194:0/3648198397 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c02fe50 con 0x7fde58153280 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 -- 172.21.15.194:0/3648198397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 msgr2=0x7fde58156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 --2- 172.21.15.194:0/3648198397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde58156520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fde580c0f50 tx=0x7fde4c02db20 comp rx=0 tx=0).stop 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 -- 172.21.15.194:0/3648198397 shutdown_connections 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 --2- 172.21.15.194:0/3648198397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde580c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 --2- 172.21.15.194:0/3648198397 >> v2:172.21.15.196:3300/0 conn(0x7fde580a5f50 0x7fde580a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 --2- 172.21.15.194:0/3648198397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde58156520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 -- 172.21.15.194:0/3648198397 >> 172.21.15.194:0/3648198397 conn(0x7fde5806cd60 msgr2=0x7fde5806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 -- 172.21.15.194:0/3648198397 shutdown_connections 2024-03-07T10:20:53.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.361+0000 7fde5e000640 1 -- 172.21.15.194:0/3648198397 wait complete. 2024-03-07T10:20:53.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.363+0000 7fde5e000640 1 Processor -- start 2024-03-07T10:20:53.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.363+0000 7fde5e000640 1 -- start start 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde580a5f50 0x7fde581ef4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde581dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde58153660 con 0x7fde58153280 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c3f50 con 0x7fde580a5f50 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde580c1940 con 0x7fde580a8b60 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55814/0 (socket says 172.21.15.194:55814) 2024-03-07T10:20:53.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5d600640 1 -- 172.21.15.194:0/1948522491 learned_addr learned my addr 172.21.15.194:0/1948522491 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.364+0000 7fde5cc00640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde580a5f50 0x7fde581ef4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde57e00640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde581dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 -- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 msgr2=0x7fde581dbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde581dbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 -- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde580a5f50 msgr2=0x7fde581ef4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde580a5f50 0x7fde581ef4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 -- 172.21.15.194:0/1948522491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde581553b0 con 0x7fde58153280 2024-03-07T10:20:53.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5d600640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde5000b9a0 tx=0x7fde5000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50019070 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5000cbc0 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50014440 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde58155690 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.365+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde580aa9a0 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.366+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde581eba40 con 0x7fde58153280 2024-03-07T10:20:53.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.367+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fde5001c070 con 0x7fde58153280 2024-03-07T10:20:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.368+0000 7fde54c00640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 0x7fde3806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.368+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fde50089bd0 con 0x7fde58153280 2024-03-07T10:20:53.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.369+0000 7fde5cc00640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 0x7fde3806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.370+0000 7fde5cc00640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 0x7fde3806d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde4c038000 tx=0x7fde4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.373+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fde50058d90 con 0x7fde58153280 2024-03-07T10:20:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.553+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde58075600 con 0x7fde58153280 2024-03-07T10:20:53.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.554+0000 7fde54c00640 1 -- 172.21.15.194:0/1948522491 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde50058690 con 0x7fde58153280 2024-03-07T10:20:53.556 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:20:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 msgr2=0x7fde3806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 0x7fde3806d9c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde4c038000 tx=0x7fde4c008030 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 msgr2=0x7fde580aa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde5000b9a0 tx=0x7fde5000be60 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 shutdown_connections 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fde3806b500 0x7fde3806d9c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fde58153280 0x7fde580aa460 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fde580a8b60 0x7fde581dbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 --2- 172.21.15.194:0/1948522491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fde580a5f50 0x7fde581ef4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 >> 172.21.15.194:0/1948522491 conn(0x7fde5806cd60 msgr2=0x7fde580c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 shutdown_connections 2024-03-07T10:20:53.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.557+0000 7fde5e000640 1 -- 172.21.15.194:0/1948522491 wait complete. 2024-03-07T10:20:53.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:20:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.779+0000 7ff7e9600640 1 Processor -- start 2024-03-07T10:20:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.779+0000 7ff7e9600640 1 -- start start 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.780+0000 7ff7e9600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff7e406e010 0x7ff7e415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.780+0000 7ff7e9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4153980 con 0x7ff7e4150b70 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.780+0000 7ff7e9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e4153c60 con 0x7ff7e4156c20 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.780+0000 7ff7e9600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e4153f40 con 0x7ff7e406e010 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e2a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff7e4150b70 0x7ff7e40a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:45194/0 (socket says 172.21.15.194:45194) 2024-03-07T10:20:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e2a00640 1 -- 172.21.15.194:0/2104408368 learned_addr learned my addr 172.21.15.194:0/2104408368 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:20:53.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010550505 0 0) 0x7ff7e4153980 con 0x7ff7e4150b70 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7c8003520 con 0x7ff7e4150b70 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e3400640 1 --2- 172.21.15.194:0/2104408368 >> v2:172.21.15.196:3300/0 conn(0x7ff7e406e010 0x7ff7e415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.781+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314203416 0 0) 0x7ff7c8003520 con 0x7ff7e4150b70 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 >> v2:172.21.15.196:3300/0 conn(0x7ff7e406e010 msgr2=0x7ff7e415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 --2- 172.21.15.194:0/2104408368 >> v2:172.21.15.196:3300/0 conn(0x7ff7e406e010 0x7ff7e415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 >> v1:172.21.15.196:6789/0 conn(0x7ff7e4156c20 legacy=0x7ff7e406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4154220 con 0x7ff7e4150b70 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7ff7d4001670 con 0x7ff7e4150b70 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e3400640 1 --2- 172.21.15.194:0/2104408368 >> v2:172.21.15.196:3300/0 conn(0x7ff7e406e010 0x7ff7e415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 >> v1:172.21.15.194:6789/0 conn(0x7ff7e4150b70 legacy=0x7ff7e40a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 0x7ff7c8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7c8004800 0x7ff7c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c80053c0 0x7ff7c800ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4153f40 con 0x7ff7c8003a00 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c2e0 con 0x7ff7c8004800 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7c800c4e0 con 0x7ff7c80053c0 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 0x7ff7c8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7dbe00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7c8004800 0x7ff7c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 -- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c80053c0 msgr2=0x7ff7c800ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c80053c0 0x7ff7c800ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 -- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7c8004800 msgr2=0x7ff7c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7c8004800 0x7ff7c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e2a00640 1 -- 172.21.15.194:0/2104408368 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c8003520 con 0x7ff7c8003a00 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7dbe00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7c8004800 0x7ff7c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.782+0000 7ff7e3400640 1 -- 172.21.15.194:0/2104408368 reap_dead start 2024-03-07T10:20:53.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.783+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 0x7ff7c8003e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c190 tx=0x7ff7c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933a540ee7e25be6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4007c60 con 0x7ff7c8003a00 2024-03-07T10:20:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d4030070 con 0x7ff7c8003a00 2024-03-07T10:20:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e2000640 1 -- 172.21.15.194:0/2104408368 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4005db0 con 0x7ff7c8003a00 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 -- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 msgr2=0x7ff7c8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 0x7ff7c8003e20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c190 tx=0x7ff7c8005830 comp rx=0 tx=0).stop 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 -- 172.21.15.194:0/2104408368 shutdown_connections 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 --2- 172.21.15.194:0/2104408368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7c8003a00 0x7ff7c8003e20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 -- 172.21.15.194:0/2104408368 >> 172.21.15.194:0/2104408368 conn(0x7ff7e406b840 msgr2=0x7ff7e40c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 -- 172.21.15.194:0/2104408368 shutdown_connections 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.784+0000 7ff7e9600640 1 -- 172.21.15.194:0/2104408368 wait complete. 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.786+0000 7ff7e9600640 1 Processor -- start 2024-03-07T10:20:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.786+0000 7ff7e9600640 1 -- start start 2024-03-07T10:20:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 0x7ff7e41eb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7e40c6440 0x7ff7e41ef240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e406e460 con 0x7ff7e40c6a90 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4153630 con 0x7ff7e40c6440 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e4150f50 con 0x7ff7c8003a00 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55820/0 (socket says 172.21.15.194:55820) 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.787+0000 7ff7e3400640 1 -- 172.21.15.194:0/3577166776 learned_addr learned my addr 172.21.15.194:0/3577166776 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7dbe00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7e40c6440 0x7ff7e41ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 0x7ff7e41eb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 -- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 msgr2=0x7ff7e41eb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 0x7ff7e41eb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 -- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7e40c6440 msgr2=0x7ff7e41ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7e40c6440 0x7ff7e41ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 -- 172.21.15.194:0/3577166776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e4154d60 con 0x7ff7e40c6a90 2024-03-07T10:20:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 0x7ff7e41eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e3400640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40aa0f0 tx=0x7ff7dc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc01a070 con 0x7ff7e40c6a90 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc015440 con 0x7ff7e40c6a90 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e41eea80 con 0x7ff7e40c6a90 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc015830 con 0x7ff7e40c6a90 2024-03-07T10:20:53.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.788+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e41eed20 con 0x7ff7e40c6a90 2024-03-07T10:20:53.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.789+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e4068170 con 0x7ff7e40c6a90 2024-03-07T10:20:53.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.790+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff7dc01d070 con 0x7ff7e40c6a90 2024-03-07T10:20:53.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.791+0000 7ff7daa00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 0x7ff7c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:53.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.791+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7dc08a1f0 con 0x7ff7e40c6a90 2024-03-07T10:20:53.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.792+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 0x7ff7c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:53.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.793+0000 7ff7e2a00640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 0x7ff7c006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c160 tx=0x7ff7d4039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:53.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:53.796+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff7dc0593b0 con 0x7ff7e40c6a90 2024-03-07T10:20:54.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.034+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7e406cd20 con 0x7ff7e40c6a90 2024-03-07T10:20:54.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.035+0000 7ff7daa00640 1 -- 172.21.15.194:0/3577166776 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3706 (secure 0 0 0) 0x7ff7dc058cb0 con 0x7ff7e40c6a90 2024-03-07T10:20:54.037 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:54.037 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-03-07T10:20:54.037 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 3 2024-03-07T10:20:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 msgr2=0x7ff7c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 0x7ff7c006d990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c160 tx=0x7ff7d4039040 comp rx=0 tx=0).stop 2024-03-07T10:20:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 msgr2=0x7ff7e40aba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff7e40aa0f0 tx=0x7ff7dc00a340 comp rx=0 tx=0).stop 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 shutdown_connections 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff7c006b4d0 0x7ff7c006d990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7e40c6a90 0x7ff7e40aba90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff7e40c6440 0x7ff7e41ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 --2- 172.21.15.194:0/3577166776 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff7c8003a00 0x7ff7e41eb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 >> 172.21.15.194:0/3577166776 conn(0x7ff7e406b840 msgr2=0x7ff7e414c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:54.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 shutdown_connections 2024-03-07T10:20:54.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.038+0000 7ff7e9600640 1 -- 172.21.15.194:0/3577166776 wait complete. 2024-03-07T10:20:54.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.272+0000 7f026f000640 1 Processor -- start 2024-03-07T10:20:54.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.272+0000 7f026f000640 1 -- start start 2024-03-07T10:20:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.273+0000 7f026f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0268150a90 0x7f02680c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.273+0000 7f026f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02680c4130 0x7f02680c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.273+0000 7f026f000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02680c33b0 con 0x7f02680c2690 2024-03-07T10:20:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.273+0000 7f026f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0268072b50 con 0x7f0268150a90 2024-03-07T10:20:54.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.273+0000 7f026f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268150e70 con 0x7f02680c4130 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0268150a90 0x7f02680c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0268150a90 0x7f02680c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55824/0 (socket says 172.21.15.194:55824) 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 -- 172.21.15.194:0/2339695061 learned_addr learned my addr 172.21.15.194:0/2339695061 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026d200640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02680c4130 0x7f02680c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 -- 172.21.15.194:0/2339695061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02680c4130 msgr2=0x7f02680c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02680c4130 0x7f02680c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 -- 172.21.15.194:0/2339695061 >> v1:172.21.15.196:6789/0 conn(0x7f02680c2690 legacy=0x7f02680c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.274+0000 7f026dc00640 1 -- 172.21.15.194:0/2339695061 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0268072d80 con 0x7f0268150a90 2024-03-07T10:20:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.276+0000 7f026dc00640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0268150a90 0x7f02680c3bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f025c009870 tx=0x7f025c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbbbe88bac544e5a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.276+0000 7f0267e00640 1 -- 172.21.15.194:0/2339695061 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c034070 con 0x7f0268150a90 2024-03-07T10:20:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.276+0000 7f0267e00640 1 -- 172.21.15.194:0/2339695061 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c030840 con 0x7f0268150a90 2024-03-07T10:20:54.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.276+0000 7f0267e00640 1 -- 172.21.15.194:0/2339695061 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c030c10 con 0x7f0268150a90 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 -- 172.21.15.194:0/2339695061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0268150a90 msgr2=0x7f02680c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0268150a90 0x7f02680c3bf0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f025c009870 tx=0x7f025c02b980 comp rx=0 tx=0).stop 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 -- 172.21.15.194:0/2339695061 shutdown_connections 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02680c4130 0x7f02680c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 --2- 172.21.15.194:0/2339695061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0268150a90 0x7f02680c3bf0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 -- 172.21.15.194:0/2339695061 >> 172.21.15.194:0/2339695061 conn(0x7f02680c70f0 msgr2=0x7f02680c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 -- 172.21.15.194:0/2339695061 shutdown_connections 2024-03-07T10:20:54.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.277+0000 7f026f000640 1 -- 172.21.15.194:0/2339695061 wait complete. 2024-03-07T10:20:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.279+0000 7f026f000640 1 Processor -- start 2024-03-07T10:20:54.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.279+0000 7f026f000640 1 -- start start 2024-03-07T10:20:54.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02680c4130 0x7f02681ded00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 0x7f02681df240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268073340 con 0x7f02680c2690 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268071cf0 con 0x7f02680c4130 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02680c2320 con 0x7f0268150a90 2024-03-07T10:20:54.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55834/0 (socket says 172.21.15.194:55834) 2024-03-07T10:20:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026dc00640 1 -- 172.21.15.194:0/4018803033 learned_addr learned my addr 172.21.15.194:0/4018803033 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.280+0000 7f026d200640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02680c4130 0x7f02681ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026e600640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 0x7f02681df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 -- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 msgr2=0x7f02681df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 0x7f02681df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 -- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02680c4130 msgr2=0x7f02681ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02680c4130 0x7f02681ded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 -- 172.21.15.194:0/4018803033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02681df780 con 0x7f02680c2690 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026e600640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 0x7f02681df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026dc00640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c034040 con 0x7f02680c2690 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c039d90 con 0x7f02680c2690 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c043610 con 0x7f02680c2690 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.281+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681eba40 con 0x7f02680c2690 2024-03-07T10:20:54.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.282+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026814ba70 con 0x7f02680c2690 2024-03-07T10:20:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.283+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0268068170 con 0x7f02680c2690 2024-03-07T10:20:54.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.284+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f025c04a060 con 0x7f02680c2690 2024-03-07T10:20:54.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.284+0000 7f0265600640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 0x7f024806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.285+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f025c0abf10 con 0x7f02680c2690 2024-03-07T10:20:54.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.285+0000 7f026d200640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 0x7f024806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.286+0000 7f026d200640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 0x7f024806d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02680a5e70 tx=0x7f0254008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.289+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f025c03e070 con 0x7f02680c2690 2024-03-07T10:20:54.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.485+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02680c69f0 con 0x7f02680c2690 2024-03-07T10:20:54.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.487+0000 7f0265600640 1 -- 172.21.15.194:0/4018803033 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12932 (secure 0 0 0) 0x7f025c02d330 con 0x7f02680c2690 2024-03-07T10:20:54.489 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:54.489 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":16,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:48.766884+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 msgr2=0x7f024806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 0x7f024806d9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f02680a5e70 tx=0x7f0254008040 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 msgr2=0x7f026814afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c0046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 shutdown_connections 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024806b500 0x7f024806d9c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0268150a90 0x7f02681df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02680c4130 0x7f02681ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 --2- 172.21.15.194:0/4018803033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02680c2690 0x7f026814afa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 >> 172.21.15.194:0/4018803033 conn(0x7f02680c70f0 msgr2=0x7f02680c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 shutdown_connections 2024-03-07T10:20:54.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.490+0000 7f026f000640 1 -- 172.21.15.194:0/4018803033 wait complete. 2024-03-07T10:20:54.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:20:54.511 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:20:54.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.721+0000 7fe4e7a00640 1 Processor -- start 2024-03-07T10:20:54.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.721+0000 7fe4e7a00640 1 -- start start 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e7a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe4e014d6e0 0x7fe4e006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e7a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e00ab7c0 0x7fe4e015ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e7a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e0153760 con 0x7fe4e00ab340 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e7a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e006daf0 con 0x7fe4e014d6e0 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e7a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e006dd40 con 0x7fe4e00ab7c0 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.722+0000 7fe4e5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe4e014d6e0 0x7fe4e006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4d7e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe4e00ab340 0x7fe4e00a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:45210/0 (socket says 172.21.15.194:45210) 2024-03-07T10:20:54.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4d7e00640 1 -- 172.21.15.194:0/3744065986 learned_addr learned my addr 172.21.15.194:0/3744065986 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:20:54.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4e5000640 1 -- 172.21.15.194:0/3744065986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e00ab7c0 msgr2=0x7fe4e015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:54.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4e5000640 1 --2- 172.21.15.194:0/3744065986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e00ab7c0 0x7fe4e015ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4e5000640 1 -- 172.21.15.194:0/3744065986 >> v1:172.21.15.194:6789/0 conn(0x7fe4e00ab340 legacy=0x7fe4e00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4e5000640 1 -- 172.21.15.194:0/3744065986 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e006e020 con 0x7fe4e014d6e0 2024-03-07T10:20:54.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.723+0000 7fe4dfe00640 1 -- 172.21.15.194:0/3744065986 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928331850 0 0) 0x7fe4e0153760 con 0x7fe4e00ab340 2024-03-07T10:20:54.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.724+0000 7fe4e5000640 1 --2- 172.21.15.194:0/3744065986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e014d6e0 0x7fe4e006e820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f0089f33cf3a96 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.724+0000 7fe4dfe00640 1 -- 172.21.15.194:0/3744065986 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d00315a0 con 0x7fe4e014d6e0 2024-03-07T10:20:54.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.724+0000 7fe4dfe00640 1 -- 172.21.15.194:0/3744065986 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d0037070 con 0x7fe4e014d6e0 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.724+0000 7fe4dfe00640 1 -- 172.21.15.194:0/3744065986 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0031960 con 0x7fe4e014d6e0 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 -- 172.21.15.194:0/3744065986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e014d6e0 msgr2=0x7fe4e006e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/3744065986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e014d6e0 0x7fe4e006e820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00097a0 tx=0x7fe4d002b840 comp rx=0 tx=0).stop 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 -- 172.21.15.194:0/3744065986 shutdown_connections 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/3744065986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e00ab7c0 0x7fe4e015ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/3744065986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e014d6e0 0x7fe4e006e820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 -- 172.21.15.194:0/3744065986 >> 172.21.15.194:0/3744065986 conn(0x7fe4e006b860 msgr2=0x7fe4e00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 -- 172.21.15.194:0/3744065986 shutdown_connections 2024-03-07T10:20:54.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.725+0000 7fe4e7a00640 1 -- 172.21.15.194:0/3744065986 wait complete. 2024-03-07T10:20:54.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.727+0000 7fe4e7a00640 1 Processor -- start 2024-03-07T10:20:54.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.727+0000 7fe4e7a00640 1 -- start start 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4e00ab7c0 0x7fe4e0071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e014d6e0 0x7fe4e01eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00aae10 con 0x7fe4e00ab340 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c79c0 con 0x7fe4e00ab7c0 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e7a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00a9be0 con 0x7fe4e014d6e0 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55844/0 (socket says 172.21.15.194:55844) 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 -- 172.21.15.194:0/1344651588 learned_addr learned my addr 172.21.15.194:0/1344651588 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 -- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e014d6e0 msgr2=0x7fe4e01eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e014d6e0 0x7fe4e01eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 -- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4e00ab7c0 msgr2=0x7fe4e0071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4e00ab7c0 0x7fe4e0071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.728+0000 7fe4e5000640 1 -- 172.21.15.194:0/1344651588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e014aac0 con 0x7fe4e00ab340 2024-03-07T10:20:54.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4e5000640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0034040 tx=0x7fe4d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0004030 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d00041f0 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e01ef660 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0032640 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.729+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e014b310 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.730+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e006ed10 con 0x7fe4e00ab340 2024-03-07T10:20:54.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.731+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe4d00327e0 con 0x7fe4e00ab340 2024-03-07T10:20:54.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.732+0000 7fe4dd600640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:54.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.732+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe4d002f030 con 0x7fe4e00ab340 2024-03-07T10:20:54.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.732+0000 7fe4d7e00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:54.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.733+0000 7fe4d7e00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8005880 tx=0x7fe4c8007950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:54.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.736+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe4d0041070 con 0x7fe4e00ab340 2024-03-07T10:20:54.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.930+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4e0068170 con 0x7fe4e00ab340 2024-03-07T10:20:54.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.931+0000 7fe4dd600640 1 -- 172.21.15.194:0/1344651588 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4d007b350 con 0x7fe4e00ab340 2024-03-07T10:20:54.932 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 msgr2=0x7fe4bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8005880 tx=0x7fe4c8007950 comp rx=0 tx=0).stop 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 msgr2=0x7fe4e0152810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0034040 tx=0x7fe4d00046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 shutdown_connections 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe4bc06b4d0 0x7fe4bc06d990 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe4e014d6e0 0x7fe4e01eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe4e00ab7c0 0x7fe4e0071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 --2- 172.21.15.194:0/1344651588 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4e00ab340 0x7fe4e0152810 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:54.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 >> 172.21.15.194:0/1344651588 conn(0x7fe4e006b860 msgr2=0x7fe4e00c4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:54.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.933+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 shutdown_connections 2024-03-07T10:20:54.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:54.934+0000 7fe4e7a00640 1 -- 172.21.15.194:0/1344651588 wait complete. 2024-03-07T10:20:54.953 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-07T10:20:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.162+0000 7fad1be00640 1 Processor -- start 2024-03-07T10:20:55.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.163+0000 7fad1be00640 1 -- start start 2024-03-07T10:20:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.164+0000 7fad1be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.164+0000 7fad1be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fad140c8f90 0x7fad14155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.164+0000 7fad1be00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad14156300 con 0x7fad140be720 2024-03-07T10:20:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.164+0000 7fad1be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad140cb3c0 con 0x7fad140c8f90 2024-03-07T10:20:55.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.164+0000 7fad1be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad140cb980 con 0x7fad14152e90 2024-03-07T10:20:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:45302/0 (socket says 172.21.15.194:45302) 2024-03-07T10:20:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 -- 172.21.15.194:0/1239142703 learned_addr learned my addr 172.21.15.194:0/1239142703 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:55.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19e00640 1 --2- 172.21.15.194:0/1239142703 >> v2:172.21.15.196:3300/0 conn(0x7fad140c8f90 0x7fad14155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 -- 172.21.15.194:0/1239142703 >> v2:172.21.15.196:3300/0 conn(0x7fad140c8f90 msgr2=0x7fad14155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 --2- 172.21.15.194:0/1239142703 >> v2:172.21.15.196:3300/0 conn(0x7fad140c8f90 0x7fad14155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 -- 172.21.15.194:0/1239142703 >> v1:172.21.15.196:6789/0 conn(0x7fad140be720 legacy=0x7fad141556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.165+0000 7fad19400640 1 -- 172.21.15.194:0/1239142703 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad14159750 con 0x7fad14152e90 2024-03-07T10:20:55.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.167+0000 7fad19400640 1 --2- 172.21.15.194:0/1239142703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfef4ac88e739d3c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.167+0000 7fad13e00640 1 -- 172.21.15.194:0/1239142703 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad080317c0 con 0x7fad14152e90 2024-03-07T10:20:55.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.167+0000 7fad13e00640 1 -- 172.21.15.194:0/1239142703 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08037070 con 0x7fad14152e90 2024-03-07T10:20:55.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.167+0000 7fad13e00640 1 -- 172.21.15.194:0/1239142703 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08031b80 con 0x7fad14152e90 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 -- 172.21.15.194:0/1239142703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 msgr2=0x7fad140c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 --2- 172.21.15.194:0/1239142703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fad08009870 tx=0x7fad0802b860 comp rx=0 tx=0).stop 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 -- 172.21.15.194:0/1239142703 shutdown_connections 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 --2- 172.21.15.194:0/1239142703 >> v2:172.21.15.196:3300/0 conn(0x7fad140c8f90 0x7fad14155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 --2- 172.21.15.194:0/1239142703 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad14152e90 0x7fad140c5a10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 -- 172.21.15.194:0/1239142703 >> 172.21.15.194:0/1239142703 conn(0x7fad14066f70 msgr2=0x7fad14067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 -- 172.21.15.194:0/1239142703 shutdown_connections 2024-03-07T10:20:55.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.168+0000 7fad1be00640 1 -- 172.21.15.194:0/1239142703 wait complete. 2024-03-07T10:20:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.169+0000 7fad1be00640 1 Processor -- start 2024-03-07T10:20:55.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 -- start start 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad140be720 0x7fad14155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 0x7fad141e0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1406d850 con 0x7fad14152e90 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad140cb610 con 0x7fad140be720 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.170+0000 7fad1be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1406d9d0 con 0x7fad140c8f90 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55856/0 (socket says 172.21.15.194:55856) 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 -- 172.21.15.194:0/3891900590 learned_addr learned my addr 172.21.15.194:0/3891900590 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:55.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19400640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad140be720 0x7fad14155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad18a00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 0x7fad141e0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 -- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 msgr2=0x7fad141e0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 0x7fad141e0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 -- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad140be720 msgr2=0x7fad14155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad140be720 0x7fad14155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad19e00640 1 -- 172.21.15.194:0/3891900590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad141eb5c0 con 0x7fad14152e90 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.171+0000 7fad18a00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 0x7fad141e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:55.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad19e00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009d30 tx=0x7fad0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c018020 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c014480 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c014870 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad14153a40 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.172+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad141ebb40 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.173+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad14068170 con 0x7fad14152e90 2024-03-07T10:20:55.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.174+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fad0c005d10 con 0x7fad14152e90 2024-03-07T10:20:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.175+0000 7fad11600640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 0x7facf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.175+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fad0c08a8f0 con 0x7fad14152e90 2024-03-07T10:20:55.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.175+0000 7fad19400640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 0x7facf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.176+0000 7fad19400640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 0x7facf406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad08036000 tx=0x7fad0803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.179+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fad0c022070 con 0x7fad14152e90 2024-03-07T10:20:55.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.378+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad140c8100 con 0x7fad14152e90 2024-03-07T10:20:55.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.379+0000 7fad11600640 1 -- 172.21.15.194:0/3891900590 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad0c010040 con 0x7fad14152e90 2024-03-07T10:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:55.380 INFO:teuthology.orchestra.run.smithi194.stdout:[ 2024-03-07T10:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-03-07T10:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "poolnum": 1, 2024-03-07T10:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: "poolname": ".mgr" 2024-03-07T10:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-03-07T10:20:55.381 INFO:teuthology.orchestra.run.smithi194.stdout:] 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 msgr2=0x7facf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 0x7facf406d990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fad08036000 tx=0x7fad0803d040 comp rx=0 tx=0).stop 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 msgr2=0x7fad1414f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009d30 tx=0x7fad0c00c490 comp rx=0 tx=0).stop 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 shutdown_connections 2024-03-07T10:20:55.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7facf406b4d0 0x7facf406d990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fad14152e90 0x7fad1414f840 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fad140c8f90 0x7fad141e0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 --2- 172.21.15.194:0/3891900590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fad140be720 0x7fad14155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.381+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 >> 172.21.15.194:0/3891900590 conn(0x7fad14066f70 msgr2=0x7fad140c5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.382+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 shutdown_connections 2024-03-07T10:20:55.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.382+0000 7fad1be00640 1 -- 172.21.15.194:0/3891900590 wait complete. 2024-03-07T10:20:55.401 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-03-07T10:20:55.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.600+0000 7f8b09a00640 1 Processor -- start 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.601+0000 7f8b09a00640 1 -- start start 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.602+0000 7f8b09a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0414fa60 0x7f8b041524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.602+0000 7f8b09a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b040c1e20 0x7f8b041539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.602+0000 7f8b09a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b040c16e0 con 0x7f8b04153ee0 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.602+0000 7f8b09a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0406d8d0 con 0x7f8b040c1e20 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.602+0000 7f8b09a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0406c9e0 con 0x7f8b0414fa60 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b040c1e20 0x7f8b041539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b040c1e20 0x7f8b041539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55862/0 (socket says 172.21.15.194:55862) 2024-03-07T10:20:55.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 -- 172.21.15.194:0/752716783 learned_addr learned my addr 172.21.15.194:0/752716783 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:55.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8b02a00640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0414fa60 0x7f8b041524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 -- 172.21.15.194:0/752716783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0414fa60 msgr2=0x7f8b041524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:55.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0414fa60 0x7f8b041524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 -- 172.21.15.194:0/752716783 >> v1:172.21.15.196:6789/0 conn(0x7f8b04153ee0 legacy=0x7f8b0406dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:55.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.603+0000 7f8afa000640 1 -- 172.21.15.194:0/752716783 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0406ccc0 con 0x7f8b040c1e20 2024-03-07T10:20:55.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.604+0000 7f8afa000640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b041539a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009870 tx=0x7f8aec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b003f3eae714ba0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.604+0000 7f8b02000640 1 -- 172.21.15.194:0/752716783 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0317c0 con 0x7f8b040c1e20 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.604+0000 7f8b02000640 1 -- 172.21.15.194:0/752716783 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec037070 con 0x7f8b040c1e20 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b02000640 1 -- 172.21.15.194:0/752716783 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec031b80 con 0x7f8b040c1e20 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 -- 172.21.15.194:0/752716783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 msgr2=0x7f8b041539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b041539a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009870 tx=0x7f8aec02b860 comp rx=0 tx=0).stop 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 -- 172.21.15.194:0/752716783 shutdown_connections 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b041539a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 --2- 172.21.15.194:0/752716783 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b0414fa60 0x7f8b041524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 -- 172.21.15.194:0/752716783 >> 172.21.15.194:0/752716783 conn(0x7f8b040c6fc0 msgr2=0x7f8b040c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 -- 172.21.15.194:0/752716783 shutdown_connections 2024-03-07T10:20:55.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.605+0000 7f8b09a00640 1 -- 172.21.15.194:0/752716783 wait complete. 2024-03-07T10:20:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.607+0000 7f8b09a00640 1 Processor -- start 2024-03-07T10:20:55.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.607+0000 7f8b09a00640 1 -- start start 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b0414fa60 0x7f8b04152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b04153ee0 0x7f8b041eb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0406d560 con 0x7f8b040c1e20 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0406d280 con 0x7f8b0414fa60 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b09a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0414fe40 con 0x7f8b04153ee0 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b02a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55874/0 (socket says 172.21.15.194:55874) 2024-03-07T10:20:55.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b02a00640 1 -- 172.21.15.194:0/1208727550 learned_addr learned my addr 172.21.15.194:0/1208727550 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8afa000640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b0414fa60 0x7f8b04152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.608+0000 7f8b03400640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b04153ee0 0x7f8b041eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 -- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b04153ee0 msgr2=0x7f8b041eb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b04153ee0 0x7f8b041eb500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 -- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b0414fa60 msgr2=0x7f8b04152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b0414fa60 0x7f8b04152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 -- 172.21.15.194:0/1208727550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0414bb60 con 0x7f8b040c1e20 2024-03-07T10:20:55.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b02a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8af400d830 tx=0x7f8af400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400b6c0 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af4019070 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b041ebdd0 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af400ba80 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.609+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b04152340 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.611+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b041ec1d0 con 0x7f8b040c1e20 2024-03-07T10:20:55.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.611+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f8af401e460 con 0x7f8b040c1e20 2024-03-07T10:20:55.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.612+0000 7f8afb400640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 0x7f8ae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:55.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.612+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8af408a560 con 0x7f8b040c1e20 2024-03-07T10:20:55.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.613+0000 7f8afa000640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 0x7f8ae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:55.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.614+0000 7f8afa000640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 0x7f8ae006d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8aec036000 tx=0x7f8aec03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:55.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.617+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8af4059730 con 0x7f8b040c1e20 2024-03-07T10:20:55.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:55.814+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8b041ebfa0 con 0x7f8b040c1e20 2024-03-07T10:20:56.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.109+0000 7f8afb400640 1 -- 172.21.15.194:0/1208727550 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v17) v1 ==== 128+0+0 (secure 0 0 0) 0x7f8af4059030 con 0x7f8b040c1e20 2024-03-07T10:20:56.111 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'a_metadata' created 2024-03-07T10:20:56.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 msgr2=0x7f8ae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 0x7f8ae006d990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8aec036000 tx=0x7f8aec03d040 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 msgr2=0x7f8b0414b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8af400d830 tx=0x7f8af400dcf0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 shutdown_connections 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8ae006b4d0 0x7f8ae006d990 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8aec036000 tx=0x7f8aec03d040 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8b04153ee0 0x7f8b041eb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8b0414fa60 0x7f8b04152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 --2- 172.21.15.194:0/1208727550 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b040c1e20 0x7f8b0414b620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.112+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 >> 172.21.15.194:0/1208727550 conn(0x7f8b040c6fc0 msgr2=0x7f8b040c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.113+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 shutdown_connections 2024-03-07T10:20:56.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.113+0000 7f8b09a00640 1 -- 172.21.15.194:0/1208727550 wait complete. 2024-03-07T10:20:56.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-07T10:20:56.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.343+0000 7fd61b000640 1 Processor -- start 2024-03-07T10:20:56.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.343+0000 7fd61b000640 1 -- start start 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.344+0000 7fd61b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd61406e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.344+0000 7fd61b000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd61406dc90 0x7fd6140c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.344+0000 7fd61b000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd614071a30 con 0x7fd614072f10 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.344+0000 7fd61b000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61406daf0 con 0x7fd61406dc90 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.344+0000 7fd61b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61406ec30 con 0x7fd614157360 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd61406dc90 0x7fd6140c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd61406dc90 0x7fd6140c19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55880/0 (socket says 172.21.15.194:55880) 2024-03-07T10:20:56.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 -- 172.21.15.194:0/3969517338 learned_addr learned my addr 172.21.15.194:0/3969517338 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd613e00640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd61406e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 -- 172.21.15.194:0/3969517338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 msgr2=0x7fd61406e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd61406e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 -- 172.21.15.194:0/3969517338 >> v1:172.21.15.196:6789/0 conn(0x7fd614072f10 legacy=0x7fd614159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:56.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd60b400640 1 -- 172.21.15.194:0/3969517338 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614071750 con 0x7fd61406dc90 2024-03-07T10:20:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.345+0000 7fd613e00640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd61406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.346+0000 7fd60b400640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd61406dc90 0x7fd6140c19c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7685fd4a535a18db server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.347+0000 7fd613400640 1 -- 172.21.15.194:0/3969517338 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0317c0 con 0x7fd61406dc90 2024-03-07T10:20:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.347+0000 7fd613400640 1 -- 172.21.15.194:0/3969517338 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc037070 con 0x7fd61406dc90 2024-03-07T10:20:56.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.347+0000 7fd613400640 1 -- 172.21.15.194:0/3969517338 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031b80 con 0x7fd61406dc90 2024-03-07T10:20:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.347+0000 7fd61b000640 1 -- 172.21.15.194:0/3969517338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd61406dc90 msgr2=0x7fd6140c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.347+0000 7fd61b000640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd61406dc90 0x7fd6140c19c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b860 comp rx=0 tx=0).stop 2024-03-07T10:20:56.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 -- 172.21.15.194:0/3969517338 shutdown_connections 2024-03-07T10:20:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd61406dc90 0x7fd6140c19c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 --2- 172.21.15.194:0/3969517338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd61406e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 -- 172.21.15.194:0/3969517338 >> 172.21.15.194:0/3969517338 conn(0x7fd61406b860 msgr2=0x7fd6140c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 -- 172.21.15.194:0/3969517338 shutdown_connections 2024-03-07T10:20:56.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.348+0000 7fd61b000640 1 -- 172.21.15.194:0/3969517338 wait complete. 2024-03-07T10:20:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.350+0000 7fd61b000640 1 Processor -- start 2024-03-07T10:20:56.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.350+0000 7fd61b000640 1 -- start start 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd61406dc90 0x7fd6140ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd614158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd614070db0 con 0x7fd614072f10 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6140c1f00 con 0x7fd61406dc90 2024-03-07T10:20:56.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd61b000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd614070f30 con 0x7fd614157360 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd60b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd60b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55884/0 (socket says 172.21.15.194:55884) 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.351+0000 7fd60b400640 1 -- 172.21.15.194:0/636937879 learned_addr learned my addr 172.21.15.194:0/636937879 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd613e00640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd61406dc90 0x7fd6140ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd619000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd614158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 -- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 msgr2=0x7fd614158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd614158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 -- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd61406dc90 msgr2=0x7fd6140ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd61406dc90 0x7fd6140ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:56.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 -- 172.21.15.194:0/636937879 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614159d00 con 0x7fd614072f10 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.352+0000 7fd60b400640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.353+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc032860 con 0x7fd614072f10 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.353+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc032a00 con 0x7fd614072f10 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.353+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc032df0 con 0x7fd614072f10 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.353+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd614154340 con 0x7fd614072f10 2024-03-07T10:20:56.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.353+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6141f2ac0 con 0x7fd614072f10 2024-03-07T10:20:56.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.354+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6141f28b0 con 0x7fd614072f10 2024-03-07T10:20:56.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.355+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd5fc04c060 con 0x7fd614072f10 2024-03-07T10:20:56.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.356+0000 7fd610c00640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 0x7fd5f006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:56.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.356+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5222+0+0 (secure 0 0 0) 0x7fd5fc0ab980 con 0x7fd614072f10 2024-03-07T10:20:56.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.357+0000 7fd613e00640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 0x7fd5f006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:56.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.358+0000 7fd613e00640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 0x7fd5f006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a950 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:56.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.361+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd5fc040070 con 0x7fd614072f10 2024-03-07T10:20:56.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:56.558+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd614071360 con 0x7fd614072f10 2024-03-07T10:20:57.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.123+0000 7fd610c00640 1 -- 172.21.15.194:0/636937879 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v18) v1 ==== 160+0+0 (secure 0 0 0) 0x7fd5fc07a940 con 0x7fd614072f10 2024-03-07T10:20:57.125 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'a_data' created 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 msgr2=0x7fd5f006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 0x7fd5f006d990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a950 tx=0x7fd604008040 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 msgr2=0x7fd6141ef340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc0046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 shutdown_connections 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd5f006b4d0 0x7fd5f006d990 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd60400a950 tx=0x7fd604008040 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd614157360 0x7fd614158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd614072f10 0x7fd6141ef340 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc0046c0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 --2- 172.21.15.194:0/636937879 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd61406dc90 0x7fd6140ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.130+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 >> 172.21.15.194:0/636937879 conn(0x7fd61406b860 msgr2=0x7fd6140c4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:57.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.131+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 shutdown_connections 2024-03-07T10:20:57.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.132+0000 7fd61b000640 1 -- 172.21.15.194:0/636937879 wait complete. 2024-03-07T10:20:57.166 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-03-07T10:20:57.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.347+0000 7ff285800640 1 Processor -- start 2024-03-07T10:20:57.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.347+0000 7ff285800640 1 -- start start 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff285800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff280152da0 0x7ff2800c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff285800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 0x7ff2800cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff285800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff280153180 con 0x7ff280155990 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff285800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff280158f70 con 0x7ff280152da0 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff285800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff280159250 con 0x7ff2800cb380 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff27ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff280152da0 0x7ff2800c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff27ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff280152da0 0x7ff2800c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55896/0 (socket says 172.21.15.194:55896) 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff27ea00640 1 -- 172.21.15.194:0/2643950195 learned_addr learned my addr 172.21.15.194:0/2643950195 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.349+0000 7ff27e000640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 0x7ff2800cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.350+0000 7ff27ea00640 1 -- 172.21.15.194:0/2643950195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 msgr2=0x7ff2800cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.350+0000 7ff27ea00640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 0x7ff2800cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.350+0000 7ff27ea00640 1 -- 172.21.15.194:0/2643950195 >> v1:172.21.15.196:6789/0 conn(0x7ff280155990 legacy=0x7ff280155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.350+0000 7ff27ea00640 1 -- 172.21.15.194:0/2643950195 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff280159530 con 0x7ff280152da0 2024-03-07T10:20:57.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.350+0000 7ff27e000640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 0x7ff2800cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:57.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.351+0000 7ff27ea00640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff2800c8f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b3aae564654739 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:57.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.351+0000 7ff27d600640 1 -- 172.21.15.194:0/2643950195 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270035020 con 0x7ff280152da0 2024-03-07T10:20:57.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.351+0000 7ff27d600640 1 -- 172.21.15.194:0/2643950195 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff270031640 con 0x7ff280152da0 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.351+0000 7ff27d600640 1 -- 172.21.15.194:0/2643950195 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27002d040 con 0x7ff280152da0 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 -- 172.21.15.194:0/2643950195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 msgr2=0x7ff2800c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff2800c8f10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff270009870 tx=0x7ff27002b8f0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 -- 172.21.15.194:0/2643950195 shutdown_connections 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff2800cb380 0x7ff2800cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 --2- 172.21.15.194:0/2643950195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff2800c8f10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 -- 172.21.15.194:0/2643950195 >> 172.21.15.194:0/2643950195 conn(0x7ff280066f70 msgr2=0x7ff280067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:57.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 -- 172.21.15.194:0/2643950195 shutdown_connections 2024-03-07T10:20:57.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.352+0000 7ff285800640 1 -- 172.21.15.194:0/2643950195 wait complete. 2024-03-07T10:20:57.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.353+0000 7ff285800640 1 Processor -- start 2024-03-07T10:20:57.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 -- start start 2024-03-07T10:20:57.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 0x7ff2800bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff280155990 0x7ff2800c1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff280156530 con 0x7ff280152da0 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800be8c0 con 0x7ff2800cb380 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.354+0000 7ff285800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2800c2460 con 0x7ff280155990 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55906/0 (socket says 172.21.15.194:55906) 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 -- 172.21.15.194:0/3541066079 learned_addr learned my addr 172.21.15.194:0/3541066079 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27ea00640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 0x7ff2800bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 -- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff280155990 msgr2=0x7ff2800c1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:57.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27f400640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff280155990 0x7ff2800c1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff280155990 0x7ff2800c1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 -- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 msgr2=0x7ff2800bf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 0x7ff2800bf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27e000640 1 -- 172.21.15.194:0/3541066079 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800c2180 con 0x7ff280152da0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.355+0000 7ff27ea00640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 0x7ff2800bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff27e000640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c820 tx=0x7ff26800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268015070 con 0x7ff280152da0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff268007a30 con 0x7ff280152da0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff268007e00 con 0x7ff280152da0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2801ebcc0 con 0x7ff280152da0 2024-03-07T10:20:57.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.356+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2800bfaf0 con 0x7ff280152da0 2024-03-07T10:20:57.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.357+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2800626f0 con 0x7ff280152da0 2024-03-07T10:20:57.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.359+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff268018070 con 0x7ff280152da0 2024-03-07T10:20:57.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.359+0000 7ff276a00640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 0x7ff25c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:57.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.359+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5599+0+0 (secure 0 0 0) 0x7ff26808a630 con 0x7ff280152da0 2024-03-07T10:20:57.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.360+0000 7ff27ea00640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 0x7ff25c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:57.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.361+0000 7ff27ea00640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 0x7ff25c06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff270036000 tx=0x7ff270008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:57.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.363+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff2800626f0 con 0x7ff280152da0 2024-03-07T10:20:57.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:57.591+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) v1 -- 0x7ff280068170 con 0x7ff280152da0 2024-03-07T10:20:58.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.146+0000 7ff276a00640 1 -- 172.21.15.194:0/3541066079 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 157+0+0 (secure 0 0 0) 0x7ff268059500 con 0x7ff280152da0 2024-03-07T10:20:58.152 INFO:teuthology.orchestra.run.smithi194.stderr:new fs with metadata pool 2 and data pool 3 2024-03-07T10:20:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 msgr2=0x7ff25c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 0x7ff25c06d990 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff270036000 tx=0x7ff270008030 comp rx=0 tx=0).stop 2024-03-07T10:20:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 msgr2=0x7ff280148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff26800c820 tx=0x7ff26800cc20 comp rx=0 tx=0).stop 2024-03-07T10:20:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 shutdown_connections 2024-03-07T10:20:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff25c06b4d0 0x7ff25c06d990 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff280155990 0x7ff2800c1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff280152da0 0x7ff280148050 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 --2- 172.21.15.194:0/3541066079 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2800cb380 0x7ff2800bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.157+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 >> 172.21.15.194:0/3541066079 conn(0x7ff280066f70 msgr2=0x7ff2800ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:58.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.158+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 shutdown_connections 2024-03-07T10:20:58.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.158+0000 7ff285800640 1 -- 172.21.15.194:0/3541066079 wait complete. 2024-03-07T10:20:58.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.360+0000 7fbe4dc00640 1 Processor -- start 2024-03-07T10:20:58.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.360+0000 7fbe4dc00640 1 -- start start 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe4dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe48154100 0x7fbe48155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe4dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe481568e0 con 0x7fbe48148f40 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe4dc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4806d6d0 con 0x7fbe480c19c0 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe4dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe48073240 con 0x7fbe48154100 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe3e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe48154100 0x7fbe48155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe3e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe48154100 0x7fbe48155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55910/0 (socket says 172.21.15.194:55910) 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe46a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbe48148f40 0x7fbe481539f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:45222/0 (socket says 172.21.15.194:45222) 2024-03-07T10:20:58.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.361+0000 7fbe3e000640 1 -- 172.21.15.194:0/3843269016 learned_addr learned my addr 172.21.15.194:0/3843269016 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.362+0000 7fbe3e000640 1 -- 172.21.15.194:0/3843269016 >> v1:172.21.15.196:6789/0 conn(0x7fbe480c19c0 legacy=0x7fbe48156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.362+0000 7fbe3e000640 1 -- 172.21.15.194:0/3843269016 >> v1:172.21.15.194:6789/0 conn(0x7fbe48148f40 legacy=0x7fbe481539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.362+0000 7fbe3e000640 1 -- 172.21.15.194:0/3843269016 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4806d9b0 con 0x7fbe48154100 2024-03-07T10:20:58.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.362+0000 7fbe46000640 1 -- 172.21.15.194:0/3843269016 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882031900 0 0) 0x7fbe481568e0 con 0x7fbe48148f40 2024-03-07T10:20:58.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.363+0000 7fbe3e000640 1 --2- 172.21.15.194:0/3843269016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe48154100 0x7fbe48155af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000bb10 tx=0x7fbe3002e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c8be11254d61c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.363+0000 7fbe46000640 1 -- 172.21.15.194:0/3843269016 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3003b070 con 0x7fbe48154100 2024-03-07T10:20:58.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.363+0000 7fbe46000640 1 -- 172.21.15.194:0/3843269016 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe30036440 con 0x7fbe48154100 2024-03-07T10:20:58.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.363+0000 7fbe46000640 1 -- 172.21.15.194:0/3843269016 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30036810 con 0x7fbe48154100 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 -- 172.21.15.194:0/3843269016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe48154100 msgr2=0x7fbe48155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/3843269016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe48154100 0x7fbe48155af0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000bb10 tx=0x7fbe3002e0d0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 -- 172.21.15.194:0/3843269016 shutdown_connections 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/3843269016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe48154100 0x7fbe48155af0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 -- 172.21.15.194:0/3843269016 >> 172.21.15.194:0/3843269016 conn(0x7fbe4806b840 msgr2=0x7fbe480c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 -- 172.21.15.194:0/3843269016 shutdown_connections 2024-03-07T10:20:58.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.364+0000 7fbe4dc00640 1 -- 172.21.15.194:0/3843269016 wait complete. 2024-03-07T10:20:58.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.365+0000 7fbe4dc00640 1 Processor -- start 2024-03-07T10:20:58.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.366+0000 7fbe4dc00640 1 -- start start 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.366+0000 7fbe4dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.366+0000 7fbe4dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe48148f40 0x7fbe48145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.366+0000 7fbe4dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe48154100 0x7fbe481458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe4dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48149320 con 0x7fbe480c19c0 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe4dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4806e000 con 0x7fbe48148f40 2024-03-07T10:20:58.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe4dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4806e490 con 0x7fbe48154100 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55916/0 (socket says 172.21.15.194:55916) 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 -- 172.21.15.194:0/1681025471 learned_addr learned my addr 172.21.15.194:0/1681025471 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 -- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe48154100 msgr2=0x7fbe481458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe3e000640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe48148f40 0x7fbe48145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe48154100 0x7fbe481458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 -- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe48148f40 msgr2=0x7fbe48145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe48148f40 0x7fbe48145390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 -- 172.21.15.194:0/1681025471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48145e10 con 0x7fbe480c19c0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe46a00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c460 tx=0x7fbe3800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.367+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38018070 con 0x7fbe480c19c0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.368+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38007500 con 0x7fbe480c19c0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.368+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe480c5e80 con 0x7fbe480c19c0 2024-03-07T10:20:58.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.368+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38004a20 con 0x7fbe480c19c0 2024-03-07T10:20:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.368+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe480c6440 con 0x7fbe480c19c0 2024-03-07T10:20:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.369+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe48068170 con 0x7fbe480c19c0 2024-03-07T10:20:58.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.370+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbe3801b070 con 0x7fbe480c19c0 2024-03-07T10:20:58.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.371+0000 7fbe3f400640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 0x7fbe2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.371+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fbe380894c0 con 0x7fbe480c19c0 2024-03-07T10:20:58.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.371+0000 7fbe3e000640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 0x7fbe2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.372+0000 7fbe3e000640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 0x7fbe2406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe30038000 tx=0x7fbe30032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.375+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbe38058340 con 0x7fbe480c19c0 2024-03-07T10:20:58.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.558+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe480c2030 con 0x7fbe480c19c0 2024-03-07T10:20:58.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.560+0000 7fbe3f400640 1 -- 172.21.15.194:0/1681025471 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fbe38057c40 con 0x7fbe480c19c0 2024-03-07T10:20:58.562 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:58.563 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":19,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:57.592659+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 msgr2=0x7fbe2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 0x7fbe2406d990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe30038000 tx=0x7fbe30032000 comp rx=0 tx=0).stop 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 msgr2=0x7fbe48155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c460 tx=0x7fbe3800c920 comp rx=0 tx=0).stop 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 shutdown_connections 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe2406b4d0 0x7fbe2406d990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe48154100 0x7fbe481458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe48148f40 0x7fbe48145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 --2- 172.21.15.194:0/1681025471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe480c19c0 0x7fbe48155850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 >> 172.21.15.194:0/1681025471 conn(0x7fbe4806b840 msgr2=0x7fbe481538b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 shutdown_connections 2024-03-07T10:20:58.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.563+0000 7fbe4dc00640 1 -- 172.21.15.194:0/1681025471 wait complete. 2024-03-07T10:20:58.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:20:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.786+0000 7fc5bca00640 1 Processor -- start 2024-03-07T10:20:58.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.786+0000 7fc5bca00640 1 -- start start 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.787+0000 7fc5bca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b8150a90 0x7fc5b80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.787+0000 7fc5bca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5b80c4130 0x7fc5b80c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.787+0000 7fc5bca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b80c33b0 con 0x7fc5b80c2690 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.787+0000 7fc5bca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b8072b50 con 0x7fc5b80c4130 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.787+0000 7fc5bca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8150e70 con 0x7fc5b8150a90 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5b80c4130 0x7fc5b80c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc5b80c4130 0x7fc5b80c16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55930/0 (socket says 172.21.15.194:55930) 2024-03-07T10:20:58.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 -- 172.21.15.194:0/2991571419 learned_addr learned my addr 172.21.15.194:0/2991571419 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5b7400640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b8150a90 0x7fc5b80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 -- 172.21.15.194:0/2991571419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b8150a90 msgr2=0x7fc5b80c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b8150a90 0x7fc5b80c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 -- 172.21.15.194:0/2991571419 >> v1:172.21.15.194:6789/0 conn(0x7fc5b80c2690 legacy=0x7fc5b80c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.788+0000 7fc5afe00640 1 -- 172.21.15.194:0/2991571419 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8072d80 con 0x7fc5b80c4130 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.789+0000 7fc5afe00640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b80c16d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009870 tx=0x7fc5a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6569c6207132925 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.789+0000 7fc5b6a00640 1 -- 172.21.15.194:0/2991571419 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0034070 con 0x7fc5b80c4130 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.789+0000 7fc5b6a00640 1 -- 172.21.15.194:0/2991571419 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0030840 con 0x7fc5b80c4130 2024-03-07T10:20:58.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.789+0000 7fc5b6a00640 1 -- 172.21.15.194:0/2991571419 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0030c10 con 0x7fc5b80c4130 2024-03-07T10:20:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 -- 172.21.15.194:0/2991571419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 msgr2=0x7fc5b80c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b80c16d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0009870 tx=0x7fc5a002b980 comp rx=0 tx=0).stop 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 -- 172.21.15.194:0/2991571419 shutdown_connections 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b80c16d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 --2- 172.21.15.194:0/2991571419 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b8150a90 0x7fc5b80c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 -- 172.21.15.194:0/2991571419 >> 172.21.15.194:0/2991571419 conn(0x7fc5b80c70f0 msgr2=0x7fc5b80c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 -- 172.21.15.194:0/2991571419 shutdown_connections 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.790+0000 7fc5bca00640 1 -- 172.21.15.194:0/2991571419 wait complete. 2024-03-07T10:20:58.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.792+0000 7fc5bca00640 1 Processor -- start 2024-03-07T10:20:58.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.792+0000 7fc5bca00640 1 -- start start 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b80c2690 0x7fc5b814f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5b8150a90 0x7fc5b8147440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8073340 con 0x7fc5b80c4130 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b8071cf0 con 0x7fc5b8150a90 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5bca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b80c2320 con 0x7fc5b80c2690 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:55944/0 (socket says 172.21.15.194:55944) 2024-03-07T10:20:58.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 -- 172.21.15.194:0/1789417803 learned_addr learned my addr 172.21.15.194:0/1789417803 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5b7400640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b80c2690 0x7fc5b814f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5b7e00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5b8150a90 0x7fc5b8147440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 -- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b80c2690 msgr2=0x7fc5b814f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b80c2690 0x7fc5b814f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 -- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5b8150a90 msgr2=0x7fc5b8147440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5b8150a90 0x7fc5b8147440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.793+0000 7fc5afe00640 1 -- 172.21.15.194:0/1789417803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b806d710 con 0x7fc5b80c4130 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5afe00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000c00 tx=0x7fc5a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0048070 con 0x7fc5b80c4130 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a0030640 con 0x7fc5b80c4130 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a0034040 con 0x7fc5b80c4130 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b814eef0 con 0x7fc5b80c4130 2024-03-07T10:20:58.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.794+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b814d2a0 con 0x7fc5b80c4130 2024-03-07T10:20:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.795+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b814f0c0 con 0x7fc5b80c4130 2024-03-07T10:20:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.796+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc5a0037070 con 0x7fc5b80c4130 2024-03-07T10:20:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.797+0000 7fc5af400640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 0x7fc59406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:58.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.797+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fc5a00abff0 con 0x7fc5b80c4130 2024-03-07T10:20:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.797+0000 7fc5b7400640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 0x7fc59406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:58.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.798+0000 7fc5b7400640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 0x7fc59406d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8006fd0 tx=0x7fc5a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:58.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.802+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc5b814f0c0 con 0x7fc5b80c4130 2024-03-07T10:20:58.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.997+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5b8068170 con 0x7fc5b80c4130 2024-03-07T10:20:59.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:58.999+0000 7fc5af400640 1 -- 172.21.15.194:0/1789417803 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16646 (secure 0 0 0) 0x7fc5a007afb0 con 0x7fc5b80c4130 2024-03-07T10:20:59.001 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:20:59.001 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":19,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:57.592659+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 msgr2=0x7fc59406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 0x7fc59406d9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8006fd0 tx=0x7fc5a8008040 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 msgr2=0x7fc5b81ee440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc5a0000c00 tx=0x7fc5a0004730 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 shutdown_connections 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc59406b500 0x7fc59406d9c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc5b8150a90 0x7fc5b8147440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5b80c4130 0x7fc5b81ee440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 --2- 172.21.15.194:0/1789417803 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc5b80c2690 0x7fc5b814f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.002+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 >> 172.21.15.194:0/1789417803 conn(0x7fc5b80c70f0 msgr2=0x7fc5b80a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:59.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.003+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 shutdown_connections 2024-03-07T10:20:59.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.003+0000 7fc5bca00640 1 -- 172.21.15.194:0/1789417803 wait complete. 2024-03-07T10:20:59.022 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-03-07T10:20:59.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.238+0000 7ff1b1800640 1 Processor -- start 2024-03-07T10:20:59.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.238+0000 7ff1b1800640 1 -- start start 2024-03-07T10:20:59.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1b1800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac155cc0 0x7ff1ac1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1b1800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1ac072f90 0x7ff1ac153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1b1800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac0c7cb0 con 0x7ff1ac06e360 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1b1800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac06d630 con 0x7ff1ac072f90 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1b1800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac06d880 con 0x7ff1ac155cc0 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.239+0000 7ff1a2000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1ac072f90 0x7ff1ac153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff1ac072f90 0x7ff1ac153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37010/0 (socket says 172.21.15.194:37010) 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 -- 172.21.15.194:0/1483619757 learned_addr learned my addr 172.21.15.194:0/1483619757 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1aaa00640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac155cc0 0x7ff1ac1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 -- 172.21.15.194:0/1483619757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac155cc0 msgr2=0x7ff1ac1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:20:59.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac155cc0 0x7ff1ac1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 -- 172.21.15.194:0/1483619757 >> v1:172.21.15.196:6789/0 conn(0x7ff1ac06e360 legacy=0x7ff1ac148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.240+0000 7ff1a2000640 1 -- 172.21.15.194:0/1483619757 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac06db60 con 0x7ff1ac072f90 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.241+0000 7ff1a2000640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac072f90 0x7ff1ac153950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff194009870 tx=0x7ff19402db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a43baeba03ad6c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.241+0000 7ff1aa000640 1 -- 172.21.15.194:0/1483619757 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19402f8c0 con 0x7ff1ac072f90 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.241+0000 7ff1aa000640 1 -- 172.21.15.194:0/1483619757 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19402fa60 con 0x7ff1ac072f90 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.241+0000 7ff1aa000640 1 -- 172.21.15.194:0/1483619757 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19402fe30 con 0x7ff1ac072f90 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 -- 172.21.15.194:0/1483619757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac072f90 msgr2=0x7ff1ac153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac072f90 0x7ff1ac153950 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff194009870 tx=0x7ff19402db00 comp rx=0 tx=0).stop 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 -- 172.21.15.194:0/1483619757 shutdown_connections 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac072f90 0x7ff1ac153950 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 --2- 172.21.15.194:0/1483619757 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac155cc0 0x7ff1ac1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 -- 172.21.15.194:0/1483619757 >> 172.21.15.194:0/1483619757 conn(0x7ff1ac06b860 msgr2=0x7ff1ac0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 -- 172.21.15.194:0/1483619757 shutdown_connections 2024-03-07T10:20:59.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.242+0000 7ff1b1800640 1 -- 172.21.15.194:0/1483619757 wait complete. 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.244+0000 7ff1b1800640 1 Processor -- start 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.244+0000 7ff1b1800640 1 -- start start 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 0x7ff1ac0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac0c6630 0x7ff1ac14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0c7a90 con 0x7ff1ac06e360 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0c7910 con 0x7ff1ac155cc0 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1b1800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1565e0 con 0x7ff1ac0c6630 2024-03-07T10:20:59.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37020/0 (socket says 172.21.15.194:37020) 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 -- 172.21.15.194:0/2654474346 learned_addr learned my addr 172.21.15.194:0/2654474346 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1a2000640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 0x7ff1ac0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1ab400640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac0c6630 0x7ff1ac14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 -- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac0c6630 msgr2=0x7ff1ac14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac0c6630 0x7ff1ac14d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 -- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 msgr2=0x7ff1ac0c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.245+0000 7ff1aaa00640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 0x7ff1ac0c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1aaa00640 1 -- 172.21.15.194:0/2654474346 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0c4d10 con 0x7ff1ac06e360 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1a2000640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 0x7ff1ac0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:20:59.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1aaa00640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007f20 tx=0x7ff19c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c014620 con 0x7ff1ac06e360 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c019070 con 0x7ff1ac06e360 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac0c4ff0 con 0x7ff1ac06e360 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c014a00 con 0x7ff1ac06e360 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.246+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac0c55b0 con 0x7ff1ac06e360 2024-03-07T10:20:59.249 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.248+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac068170 con 0x7ff1ac06e360 2024-03-07T10:20:59.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.248+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff19c014ba0 con 0x7ff1ac06e360 2024-03-07T10:20:59.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.249+0000 7ff1a3400640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 0x7ff18806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:20:59.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.249+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7ff19c08ab70 con 0x7ff1ac06e360 2024-03-07T10:20:59.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.250+0000 7ff1a2000640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 0x7ff18806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:20:59.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.251+0000 7ff1a2000640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 0x7ff18806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff194038000 tx=0x7ff194008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:20:59.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.254+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff19c059970 con 0x7ff1ac06e360 2024-03-07T10:20:59.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:20:59.489+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff1ac0c1480 con 0x7ff1ac06e360 2024-03-07T10:21:00.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.171+0000 7ff1a3400640 1 -- 172.21.15.194:0/2654474346 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 113+0+0 (secure 0 0 0) 0x7ff19c059270 con 0x7ff1ac06e360 2024-03-07T10:21:00.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 msgr2=0x7ff18806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 0x7ff18806d990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff194038000 tx=0x7ff194008030 comp rx=0 tx=0).stop 2024-03-07T10:21:00.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 msgr2=0x7ff1ac14eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff19c007f20 tx=0x7ff19c00e570 comp rx=0 tx=0).stop 2024-03-07T10:21:00.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 shutdown_connections 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff18806b4d0 0x7ff18806d990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff1ac0c6630 0x7ff1ac14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1ac155cc0 0x7ff1ac0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 --2- 172.21.15.194:0/2654474346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1ac06e360 0x7ff1ac14eca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 >> 172.21.15.194:0/2654474346 conn(0x7ff1ac06b860 msgr2=0x7ff1ac0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 shutdown_connections 2024-03-07T10:21:00.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.175+0000 7ff1b1800640 1 -- 172.21.15.194:0/2654474346 wait complete. 2024-03-07T10:21:00.196 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-03-07T10:21:00.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-03-07T10:21:00.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.400+0000 7fbd6ac00640 1 Processor -- start 2024-03-07T10:21:00.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.400+0000 7fbd6ac00640 1 -- start start 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.401+0000 7fbd6ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd64072f90 0x7fbd64153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd6ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd6406e360 0x7fbd64153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd6ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640c7cb0 con 0x7fbd64155cc0 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd6ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd641567b0 con 0x7fbd6406e360 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd6ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6406d630 con 0x7fbd64072f90 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd68c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd6406e360 0x7fbd64153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd63e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbd64155cc0 0x7fbd641560a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47426/0 (socket says 172.21.15.194:47426) 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd63e00640 1 -- 172.21.15.194:0/1798258836 learned_addr learned my addr 172.21.15.194:0/1798258836 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd63400640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd64072f90 0x7fbd64153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd68c00640 1 -- 172.21.15.194:0/1798258836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd64072f90 msgr2=0x7fbd64153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd68c00640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd64072f90 0x7fbd64153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd68c00640 1 -- 172.21.15.194:0/1798258836 >> v1:172.21.15.194:6789/0 conn(0x7fbd64155cc0 legacy=0x7fbd641560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd68c00640 1 -- 172.21.15.194:0/1798258836 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6406d880 con 0x7fbd6406e360 2024-03-07T10:21:00.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.402+0000 7fbd62a00640 1 -- 172.21.15.194:0/1798258836 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435412533 0 0) 0x7fbd640c7cb0 con 0x7fbd64155cc0 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.403+0000 7fbd68c00640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd6406e360 0x7fbd64153e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009d90 tx=0x7fbd5c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11e272e20c7a6c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.404+0000 7fbd62a00640 1 -- 172.21.15.194:0/1798258836 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c039070 con 0x7fbd6406e360 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.404+0000 7fbd62a00640 1 -- 172.21.15.194:0/1798258836 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c02cbc0 con 0x7fbd6406e360 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.404+0000 7fbd62a00640 1 -- 172.21.15.194:0/1798258836 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c034440 con 0x7fbd6406e360 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.404+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1798258836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd6406e360 msgr2=0x7fbd64153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.404+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd6406e360 0x7fbd64153e90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c009d90 tx=0x7fbd5c02be10 comp rx=0 tx=0).stop 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1798258836 shutdown_connections 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd6406e360 0x7fbd64153e90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1798258836 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd64072f90 0x7fbd64153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1798258836 >> 172.21.15.194:0/1798258836 conn(0x7fbd6406b860 msgr2=0x7fbd640c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:00.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1798258836 shutdown_connections 2024-03-07T10:21:00.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.405+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1798258836 wait complete. 2024-03-07T10:21:00.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.406+0000 7fbd6ac00640 1 Processor -- start 2024-03-07T10:21:00.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.406+0000 7fbd6ac00640 1 -- start start 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd6406e360 0x7fbd64152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd64155cc0 0x7fbd641dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640c7910 con 0x7fbd640c6120 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6406de40 con 0x7fbd64155cc0 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd6ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd640c7a90 con 0x7fbd6406e360 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.407+0000 7fbd68c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37052/0 (socket says 172.21.15.194:37052) 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 -- 172.21.15.194:0/1405817470 learned_addr learned my addr 172.21.15.194:0/1405817470 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd63e00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd6406e360 0x7fbd64152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 -- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd6406e360 msgr2=0x7fbd64152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd6406e360 0x7fbd64152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd63400640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd64155cc0 0x7fbd641dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 -- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd64155cc0 msgr2=0x7fbd641dff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd64155cc0 0x7fbd641dff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 -- 172.21.15.194:0/1405817470 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640c6930 con 0x7fbd640c6120 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd68c00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c037040 tx=0x7fbd5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c044020 con 0x7fbd640c6120 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c03a040 con 0x7fbd640c6120 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd640c6c10 con 0x7fbd640c6120 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.408+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c039050 con 0x7fbd640c6120 2024-03-07T10:21:00.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.409+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd641525f0 con 0x7fbd640c6120 2024-03-07T10:21:00.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.410+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd64068170 con 0x7fbd640c6120 2024-03-07T10:21:00.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.411+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbd5c003bb0 con 0x7fbd640c6120 2024-03-07T10:21:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.411+0000 7fbd5be00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.412+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fbd5c0ac850 con 0x7fbd640c6120 2024-03-07T10:21:00.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.412+0000 7fbd63e00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:00.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.413+0000 7fbd63e00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 0x7fbd4006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd54000f60 tx=0x7fbd54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:00.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.416+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd5c04e060 con 0x7fbd640c6120 2024-03-07T10:21:00.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:00.648+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbd6414fd80 con 0x7fbd640c6120 2024-03-07T10:21:01.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.183+0000 7fbd5be00640 1 -- 172.21.15.194:0/1405817470 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7fbd5c07b6d0 con 0x7fbd640c6120 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 msgr2=0x7fbd4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 0x7fbd4006d990 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbd54000f60 tx=0x7fbd54009040 comp rx=0 tx=0).stop 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 msgr2=0x7fbd641ee830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c037040 tx=0x7fbd5c004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 shutdown_connections 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd4006b4d0 0x7fbd4006d990 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd640c6120 0x7fbd641ee830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd64155cc0 0x7fbd641dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 --2- 172.21.15.194:0/1405817470 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd6406e360 0x7fbd64152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.189+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 >> 172.21.15.194:0/1405817470 conn(0x7fbd6406b860 msgr2=0x7fbd640c2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.190+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 shutdown_connections 2024-03-07T10:21:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.190+0000 7fbd6ac00640 1 -- 172.21.15.194:0/1405817470 wait complete. 2024-03-07T10:21:01.214 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-03-07T10:21:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.423+0000 7f6aa0600640 1 Processor -- start 2024-03-07T10:21:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.423+0000 7f6aa0600640 1 -- start start 2024-03-07T10:21:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.424+0000 7f6aa0600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 0x7f6a98153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6aa0600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6a9806e360 0x7f6a98153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6aa0600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a980c7cb0 con 0x7f6a98155cc0 2024-03-07T10:21:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6aa0600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a981567b0 con 0x7f6a9806e360 2024-03-07T10:21:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6aa0600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9806d630 con 0x7f6a98072f90 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6a9dc00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f6a98155cc0 0x7f6a981560a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:44432/0 (socket says 172.21.15.194:44432) 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6a9dc00640 1 -- 172.21.15.194:0/1052462200 learned_addr learned my addr 172.21.15.194:0/1052462200 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6a9d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 0x7f6a98153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.425+0000 7f6a9e600640 1 --2- 172.21.15.194:0/1052462200 >> v2:172.21.15.196:3300/0 conn(0x7f6a9806e360 0x7f6a98153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.426+0000 7f6a9d200640 1 -- 172.21.15.194:0/1052462200 >> v2:172.21.15.196:3300/0 conn(0x7f6a9806e360 msgr2=0x7f6a98153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.426+0000 7f6a9d200640 1 --2- 172.21.15.194:0/1052462200 >> v2:172.21.15.196:3300/0 conn(0x7f6a9806e360 0x7f6a98153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.426+0000 7f6a9d200640 1 -- 172.21.15.194:0/1052462200 >> v1:172.21.15.196:6789/0 conn(0x7f6a98155cc0 legacy=0x7f6a981560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.426+0000 7f6a9d200640 1 -- 172.21.15.194:0/1052462200 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9806d880 con 0x7f6a98072f90 2024-03-07T10:21:01.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.427+0000 7f6a9d200640 1 --2- 172.21.15.194:0/1052462200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 0x7f6a98153950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0097a0 tx=0x7f6a8c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e859736ef0a21f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:01.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.428+0000 7f6a97e00640 1 -- 172.21.15.194:0/1052462200 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c031780 con 0x7f6a98072f90 2024-03-07T10:21:01.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.428+0000 7f6a97e00640 1 -- 172.21.15.194:0/1052462200 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c037070 con 0x7f6a98072f90 2024-03-07T10:21:01.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.428+0000 7f6a97e00640 1 -- 172.21.15.194:0/1052462200 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c031b40 con 0x7f6a98072f90 2024-03-07T10:21:01.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 -- 172.21.15.194:0/1052462200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 msgr2=0x7f6a98153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 --2- 172.21.15.194:0/1052462200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 0x7f6a98153950 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c0097a0 tx=0x7f6a8c02b820 comp rx=0 tx=0).stop 2024-03-07T10:21:01.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 -- 172.21.15.194:0/1052462200 shutdown_connections 2024-03-07T10:21:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 --2- 172.21.15.194:0/1052462200 >> v2:172.21.15.196:3300/0 conn(0x7f6a9806e360 0x7f6a98153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 --2- 172.21.15.194:0/1052462200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98072f90 0x7f6a98153950 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 -- 172.21.15.194:0/1052462200 >> 172.21.15.194:0/1052462200 conn(0x7f6a9806b860 msgr2=0x7f6a980c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 -- 172.21.15.194:0/1052462200 shutdown_connections 2024-03-07T10:21:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.429+0000 7f6aa0600640 1 -- 172.21.15.194:0/1052462200 wait complete. 2024-03-07T10:21:01.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.431+0000 7f6aa0600640 1 Processor -- start 2024-03-07T10:21:01.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.431+0000 7f6aa0600640 1 -- start start 2024-03-07T10:21:01.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98155cc0 0x7f6a981dc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 0x7f6a981ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980c7910 con 0x7f6a9806e360 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9806de40 con 0x7f6a98145d30 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6aa0600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a980c7a90 con 0x7f6a98155cc0 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37056/0 (socket says 172.21.15.194:37056) 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 -- 172.21.15.194:0/2519084827 learned_addr learned my addr 172.21.15.194:0/2519084827 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:01.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9d200640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98155cc0 0x7f6a981dc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9e600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 0x7f6a981ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 -- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98155cc0 msgr2=0x7f6a981dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98155cc0 0x7f6a981dc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 -- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 msgr2=0x7f6a981ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 0x7f6a981ddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9dc00640 1 -- 172.21.15.194:0/2519084827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98145b40 con 0x7f6a9806e360 2024-03-07T10:21:01.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.432+0000 7f6a9e600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 0x7f6a981ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:01.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6a9dc00640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c4e0 tx=0x7f6a8800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:01.437 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88017070 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a88005ce0 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88007270 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a981dcad0 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.433+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a981dd090 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.434+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a980c3430 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.435+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6a8801a070 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.436+0000 7f6a95600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 0x7f6a7c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.436+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f6a88089320 con 0x7f6a9806e360 2024-03-07T10:21:01.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.437+0000 7f6a9d200640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 0x7f6a7c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:01.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.438+0000 7f6a9d200640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 0x7f6a7c06d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c036000 tx=0x7f6a8c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:01.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.440+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6a980c3430 con 0x7f6a9806e360 2024-03-07T10:21:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:01.659+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f6a980c2ef0 con 0x7f6a9806e360 2024-03-07T10:21:02.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.195+0000 7f6a95600640 1 -- 172.21.15.194:0/2519084827 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v9) v1 ==== 110+0+0 (secure 0 0 0) 0x7f6a88057bf0 con 0x7f6a9806e360 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 msgr2=0x7f6a7c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 0x7f6a7c06d9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c036000 tx=0x7f6a8c03d040 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 msgr2=0x7f6a98145600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800c4e0 tx=0x7f6a8800c9a0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 shutdown_connections 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6a7c06b500 0x7f6a7c06d9c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a98145d30 0x7f6a981ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a98155cc0 0x7f6a981dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 --2- 172.21.15.194:0/2519084827 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a9806e360 0x7f6a98145600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 >> 172.21.15.194:0/2519084827 conn(0x7f6a9806b860 msgr2=0x7f6a98147c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:02.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 shutdown_connections 2024-03-07T10:21:02.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.199+0000 7f6aa0600640 1 -- 172.21.15.194:0/2519084827 wait complete. 2024-03-07T10:21:02.222 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-03-07T10:21:02.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:02.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.427+0000 7f0c04400640 1 Processor -- start 2024-03-07T10:21:02.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.428+0000 7f0c04400640 1 -- start start 2024-03-07T10:21:02.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.429+0000 7f0c04400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0bfc150b70 0x7f0bfc0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.429+0000 7f0c04400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0bfc156c20 0x7f0bfc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.429+0000 7f0c04400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc153980 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.429+0000 7f0c04400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc06e550 con 0x7f0bfc156c20 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.429+0000 7f0c04400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc153c60 con 0x7f0bfc150b70 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0bfc156c20 0x7f0bfc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c02400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0bfc0a9a10 0x7f0bfc06de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47432/0 (socket says 172.21.15.194:47432) 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0bfc156c20 0x7f0bfc06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37070/0 (socket says 172.21.15.194:37070) 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c02400640 1 -- 172.21.15.194:0/1231396651 learned_addr learned my addr 172.21.15.194:0/1231396651 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01a00640 1 --2- 172.21.15.194:0/1231396651 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc150b70 0x7f0bfc0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 -- 172.21.15.194:0/1231396651 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc150b70 msgr2=0x7f0bfc0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 --2- 172.21.15.194:0/1231396651 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc150b70 0x7f0bfc0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 -- 172.21.15.194:0/1231396651 >> v1:172.21.15.194:6789/0 conn(0x7f0bfc0a9a10 legacy=0x7f0bfc06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0c01000640 1 -- 172.21.15.194:0/1231396651 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc153f40 con 0x7f0bfc156c20 2024-03-07T10:21:02.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.430+0000 7f0bfbe00640 1 -- 172.21.15.194:0/1231396651 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158178318 0 0) 0x7f0bfc153980 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.431+0000 7f0c01000640 1 --2- 172.21.15.194:0/1231396651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc156c20 0x7f0bfc06d900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc073240 tx=0x7f0be802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3da749006cecb6c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.431+0000 7f0bfbe00640 1 -- 172.21.15.194:0/1231396651 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be80315a0 con 0x7f0bfc156c20 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.431+0000 7f0bfbe00640 1 -- 172.21.15.194:0/1231396651 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be8037070 con 0x7f0bfc156c20 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.431+0000 7f0bfbe00640 1 -- 172.21.15.194:0/1231396651 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8031960 con 0x7f0bfc156c20 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 -- 172.21.15.194:0/1231396651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc156c20 msgr2=0x7f0bfc06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 --2- 172.21.15.194:0/1231396651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc156c20 0x7f0bfc06d900 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc073240 tx=0x7f0be802b840 comp rx=0 tx=0).stop 2024-03-07T10:21:02.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 -- 172.21.15.194:0/1231396651 shutdown_connections 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 --2- 172.21.15.194:0/1231396651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc156c20 0x7f0bfc06d900 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 --2- 172.21.15.194:0/1231396651 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc150b70 0x7f0bfc0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 -- 172.21.15.194:0/1231396651 >> 172.21.15.194:0/1231396651 conn(0x7f0bfc06b840 msgr2=0x7f0bfc0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 -- 172.21.15.194:0/1231396651 shutdown_connections 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.432+0000 7f0c04400640 1 -- 172.21.15.194:0/1231396651 wait complete. 2024-03-07T10:21:02.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.434+0000 7f0c04400640 1 Processor -- start 2024-03-07T10:21:02.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.434+0000 7f0c04400640 1 -- start start 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 0x7f0bfc1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc156c20 0x7f0bfc154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc153630 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0c7a30 con 0x7f0bfc156c20 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c04400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0ac460 con 0x7f0bfc150b70 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37082/0 (socket says 172.21.15.194:37082) 2024-03-07T10:21:02.438 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 -- 172.21.15.194:0/1817485446 learned_addr learned my addr 172.21.15.194:0/1817485446 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01000640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 0x7f0bfc1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 -- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 msgr2=0x7f0bfc1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c02400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc156c20 0x7f0bfc154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 0x7f0bfc1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 -- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc156c20 msgr2=0x7f0bfc154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc156c20 0x7f0bfc154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01a00640 1 -- 172.21.15.194:0/1817485446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc1e94d0 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.435+0000 7f0c01000640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 0x7f0bfc1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0c01a00640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d800 tx=0x7f0bf000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000b6c0 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf0019070 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf000ba80 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc1e97b0 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.436+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc1e9d70 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.437+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc068170 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.438+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0bf000bc20 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.439+0000 7f0bf9600640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 0x7f0bdc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.439+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f0bf008a6c0 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.439+0000 7f0c01000640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 0x7f0bdc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.441 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.440+0000 7f0c01000640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 0x7f0bdc06d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036000 tx=0x7f0be8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.443+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0bf001c360 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.678+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bfc0c5070 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.679+0000 7f0bf9600640 1 -- 172.21.15.194:0/1817485446 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4979 (secure 0 0 0) 0x7f0bf0059540 con 0x7f0bfc0a9a10 2024-03-07T10:21:02.681 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:02.681 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1}]} 2024-03-07T10:21:02.682 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 9 2024-03-07T10:21:02.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 msgr2=0x7f0bdc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 0x7f0bdc06d9c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0be8036000 tx=0x7f0be8008030 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 msgr2=0x7f0bfc149200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bf000d800 tx=0x7f0bf000dcc0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 shutdown_connections 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b500 0x7f0bdc06d9c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc156c20 0x7f0bfc154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc150b70 0x7f0bfc1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 --2- 172.21.15.194:0/1817485446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc0a9a10 0x7f0bfc149200 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 >> 172.21.15.194:0/1817485446 conn(0x7f0bfc06b840 msgr2=0x7f0bfc0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 shutdown_connections 2024-03-07T10:21:02.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.682+0000 7f0c04400640 1 -- 172.21.15.194:0/1817485446 wait complete. 2024-03-07T10:21:02.701 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:02.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.892+0000 7fa950000640 1 Processor -- start 2024-03-07T10:21:02.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.892+0000 7fa950000640 1 -- start start 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa950000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9480c12a0 0x7fa9480c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa950000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa948071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa950000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa948155a00 con 0x7fa948152dc0 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa950000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa948156610 con 0x7fa9480c12a0 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa950000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa948155ce0 con 0x7fa9480c0930 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa94cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9480c12a0 0x7fa9480c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa94d600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa948152dc0 0x7fa948159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47438/0 (socket says 172.21.15.194:47438) 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.894+0000 7fa94d600640 1 -- 172.21.15.194:0/2002669348 learned_addr learned my addr 172.21.15.194:0/2002669348 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:02.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.895+0000 7fa94e000640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa948071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.895+0000 7fa94cc00640 1 -- 172.21.15.194:0/2002669348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 msgr2=0x7fa948071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.895+0000 7fa94cc00640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa948071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.895+0000 7fa94cc00640 1 -- 172.21.15.194:0/2002669348 >> v1:172.21.15.194:6789/0 conn(0x7fa948152dc0 legacy=0x7fa948159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.895+0000 7fa94cc00640 1 -- 172.21.15.194:0/2002669348 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa948155fc0 con 0x7fa9480c12a0 2024-03-07T10:21:02.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa94cc00640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9480c12a0 0x7fa9480c03f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097a0 tx=0x7fa93402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b5438a73f7c897 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa947e00640 1 -- 172.21.15.194:0/2002669348 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934039070 con 0x7fa9480c12a0 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa947e00640 1 -- 172.21.15.194:0/2002669348 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9340316f0 con 0x7fa9480c12a0 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa947e00640 1 -- 172.21.15.194:0/2002669348 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934031ac0 con 0x7fa9480c12a0 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa950000640 1 -- 172.21.15.194:0/2002669348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9480c12a0 msgr2=0x7fa9480c03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.896+0000 7fa950000640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9480c12a0 0x7fa9480c03f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa9340097a0 tx=0x7fa93402b790 comp rx=0 tx=0).stop 2024-03-07T10:21:02.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 -- 172.21.15.194:0/2002669348 shutdown_connections 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa948071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 --2- 172.21.15.194:0/2002669348 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9480c12a0 0x7fa9480c03f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 -- 172.21.15.194:0/2002669348 >> 172.21.15.194:0/2002669348 conn(0x7fa94806b840 msgr2=0x7fa9480c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 -- 172.21.15.194:0/2002669348 shutdown_connections 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.897+0000 7fa950000640 1 -- 172.21.15.194:0/2002669348 wait complete. 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.898+0000 7fa950000640 1 Processor -- start 2024-03-07T10:21:02.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.898+0000 7fa950000640 1 -- start start 2024-03-07T10:21:02.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa9480a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9480c12a0 0x7fa94814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa948153320 con 0x7fa948152dc0 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9481531a0 con 0x7fa9480c12a0 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa950000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9480720d0 con 0x7fa9480c0930 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa94e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa94e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37094/0 (socket says 172.21.15.194:37094) 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.899+0000 7fa94e000640 1 -- 172.21.15.194:0/3557134590 learned_addr learned my addr 172.21.15.194:0/3557134590 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94d600640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa9480a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 -- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 msgr2=0x7fa9480a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa9480a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 -- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9480c12a0 msgr2=0x7fa94814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:02.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9480c12a0 0x7fa94814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 -- 172.21.15.194:0/3557134590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9481eba90 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa94e000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa940007e70 tx=0x7fa94000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940014620 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa940019070 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9481ebd30 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa940014a20 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.900+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9481eea00 con 0x7fa948152dc0 2024-03-07T10:21:02.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.902+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9480c29d0 con 0x7fa948152dc0 2024-03-07T10:21:02.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.902+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa940014bc0 con 0x7fa948152dc0 2024-03-07T10:21:02.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.903+0000 7fa945600640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 0x7fa92806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:02.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.903+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fa94008aaa0 con 0x7fa948152dc0 2024-03-07T10:21:02.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.904+0000 7fa94d600640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 0x7fa92806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:02.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.905+0000 7fa94d600640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 0x7fa92806d9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa93c000f60 tx=0x7fa93c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:02.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:02.907+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa940059930 con 0x7fa948152dc0 2024-03-07T10:21:03.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.089+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9481501b0 con 0x7fa948152dc0 2024-03-07T10:21:03.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.092+0000 7fa945600640 1 -- 172.21.15.194:0/3557134590 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fa940059230 con 0x7fa948152dc0 2024-03-07T10:21:03.093 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:03.094 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:59.117060+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:03.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.094+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 msgr2=0x7fa92806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.094+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 0x7fa92806d9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa93c000f60 tx=0x7fa93c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:03.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.094+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 msgr2=0x7fa9480aa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.094+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa940007e70 tx=0x7fa94000e4b0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 shutdown_connections 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa92806b500 0x7fa92806d9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa948152dc0 0x7fa9480aa4d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9480c12a0 0x7fa94814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 --2- 172.21.15.194:0/3557134590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9480c0930 0x7fa9480a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 >> 172.21.15.194:0/3557134590 conn(0x7fa94806b840 msgr2=0x7fa9481534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 shutdown_connections 2024-03-07T10:21:03.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.095+0000 7fa950000640 1 -- 172.21.15.194:0/3557134590 wait complete. 2024-03-07T10:21:03.115 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-07T10:21:03.115 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:03.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.320+0000 7f336be00640 1 Processor -- start 2024-03-07T10:21:03.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.320+0000 7f336be00640 1 -- start start 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.321+0000 7f336be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f336406e010 0x7f336415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.321+0000 7f336be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3364153980 con 0x7f3364156c20 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.321+0000 7f336be00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3364153c60 con 0x7f3364150b70 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.321+0000 7f336be00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3364153f40 con 0x7f336406e010 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3368a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3364156c20 0x7f336406d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47448/0 (socket says 172.21.15.194:47448) 2024-03-07T10:21:03.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3368a00640 1 -- 172.21.15.194:0/742685229 learned_addr learned my addr 172.21.15.194:0/742685229 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758366417 0 0) 0x7f3364153980 con 0x7f3364156c20 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3348003520 con 0x7f3364156c20 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3369e00640 1 --2- 172.21.15.194:0/742685229 >> v2:172.21.15.196:3300/0 conn(0x7f336406e010 0x7f336415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 448415427 0 0) 0x7f3348003520 con 0x7f3364156c20 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 >> v2:172.21.15.196:3300/0 conn(0x7f336406e010 msgr2=0x7f336415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 --2- 172.21.15.194:0/742685229 >> v2:172.21.15.196:3300/0 conn(0x7f336406e010 0x7f336415efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 >> v1:172.21.15.196:6789/0 conn(0x7f3364150b70 legacy=0x7f33640a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364154220 con 0x7f3364156c20 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f33500019f0 con 0x7f3364156c20 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.322+0000 7f3369e00640 1 --2- 172.21.15.194:0/742685229 >> v2:172.21.15.196:3300/0 conn(0x7f336406e010 0x7f336415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 >> v1:172.21.15.194:6789/0 conn(0x7f3364156c20 legacy=0x7f336406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f3348003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3348004800 0x7f3348004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33480052e0 0x7f334800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364153f40 con 0x7f3348003a00 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334800c200 con 0x7f3348004800 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334800c400 con 0x7f33480052e0 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f3348003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3368a00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3348004800 0x7f3348004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 -- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33480052e0 msgr2=0x7f334800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f33480052e0 0x7f334800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 -- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3348004800 msgr2=0x7f3348004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:03.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3348004800 0x7f3348004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369400640 1 -- 172.21.15.194:0/742685229 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348003520 con 0x7f3348003a00 2024-03-07T10:21:03.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3369e00640 1 -- 172.21.15.194:0/742685229 reap_dead start 2024-03-07T10:21:03.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.323+0000 7f3368a00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3348004800 0x7f3348004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.324+0000 7f3369400640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f3348003e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f335c001750 tx=0x7f3348005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf5e27a9bfbed22 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.324+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c001370 con 0x7f3348003a00 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0052d0 con 0x7f3348003a00 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f3363e00640 1 -- 172.21.15.194:0/742685229 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c003830 con 0x7f3348003a00 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 -- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 msgr2=0x7f3348003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f3348003e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f335c001750 tx=0x7f3348005830 comp rx=0 tx=0).stop 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 -- 172.21.15.194:0/742685229 shutdown_connections 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 --2- 172.21.15.194:0/742685229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f3348003e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 -- 172.21.15.194:0/742685229 >> 172.21.15.194:0/742685229 conn(0x7f336406b840 msgr2=0x7f33640c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:03.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 -- 172.21.15.194:0/742685229 shutdown_connections 2024-03-07T10:21:03.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.325+0000 7f336be00640 1 -- 172.21.15.194:0/742685229 wait complete. 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.327+0000 7f336be00640 1 Processor -- start 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.327+0000 7f336be00640 1 -- start start 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 0x7f33640c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3364145390 0x7f3364145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336406e460 con 0x7f3348003a00 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364153630 con 0x7f3364145e30 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f336be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3364150f50 con 0x7f3364145390 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37124/0 (socket says 172.21.15.194:37124) 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 -- 172.21.15.194:0/3132748674 learned_addr learned my addr 172.21.15.194:0/3132748674 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:03.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3368a00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 0x7f33640c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 -- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3364145390 msgr2=0x7f3364145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3364145390 0x7f3364145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 -- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 msgr2=0x7f33640c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 0x7f33640c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3369400640 1 -- 172.21.15.194:0/3132748674 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33641530c0 con 0x7f3348003a00 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.328+0000 7f3368a00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 0x7f33640c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f3369400640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f335c001870 tx=0x7f335c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c041070 con 0x7f3348003a00 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c005480 con 0x7f3348003a00 2024-03-07T10:21:03.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33641533a0 con 0x7f3348003a00 2024-03-07T10:21:03.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c007a30 con 0x7f3348003a00 2024-03-07T10:21:03.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.329+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3364071830 con 0x7f3348003a00 2024-03-07T10:21:03.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.330+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3364068170 con 0x7f3348003a00 2024-03-07T10:21:03.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.331+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f335c044070 con 0x7f3348003a00 2024-03-07T10:21:03.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.332+0000 7f3361600640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 0x7f334406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.333+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f335c0abe20 con 0x7f3348003a00 2024-03-07T10:21:03.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.333+0000 7f3368a00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 0x7f334406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.334+0000 7f3368a00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 0x7f334406d9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3350001b60 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.337+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f335c07ad30 con 0x7f3348003a00 2024-03-07T10:21:03.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.532+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3364146380 con 0x7f334406b500 2024-03-07T10:21:03.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.570+0000 7f3361600640 1 -- 172.21.15.194:0/3132748674 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251948 (secure 0 0 0) 0x7f3364146380 con 0x7f334406b500 2024-03-07T10:21:03.575 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:03.577 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:03.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 msgr2=0x7f334406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 0x7f334406d9c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3350001b60 tx=0x7f3350009040 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 msgr2=0x7f33641ebb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f335c001870 tx=0x7f335c001120 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 shutdown_connections 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f334406b500 0x7f334406d9c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3364145390 0x7f3364145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3364145e30 0x7f33640c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 --2- 172.21.15.194:0/3132748674 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003a00 0x7f33641ebb70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 >> 172.21.15.194:0/3132748674 conn(0x7f336406b840 msgr2=0x7f336414df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 shutdown_connections 2024-03-07T10:21:03.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.576+0000 7f336be00640 1 -- 172.21.15.194:0/3132748674 wait complete. 2024-03-07T10:21:03.596 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-07T10:21:02.411311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218988,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755732,"statfs":{"total":773094113280,"available":772869869568,"internally_reserved":0,"allocated":2891776,"data_stored":1752388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002303"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160564+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:20:59.160564+0000","last_peered":"2024-03-07T10:20:59.160564+0000","last_clean":"2024-03-07T10:20:59.160564+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:20:59.160564+0000","last_undegraded":"2024-03-07T10:20:59.160564+0000","last_fullsized":"2024-03-07T10:20:59.160564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154601+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:20:59.154601+0000","last_peered":"2024-03-07T10:20:59.154601+0000","last_clean":"2024-03-07T10:20:59.154601+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:20:59.154601+0000","last_undegraded":"2024-03-07T10:20:59.154601+0000","last_fullsized":"2024-03-07T10:20:59.154601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155951+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:20:59.155951+0000","last_peered":"2024-03-07T10:20:59.155951+0000","last_clean":"2024-03-07T10:20:59.155951+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:20:59.155951+0000","last_undegraded":"2024-03-07T10:20:59.155951+0000","last_fullsized":"2024-03-07T10:20:59.155951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161469+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:20:59.161469+0000","last_peered":"2024-03-07T10:20:59.161469+0000","last_clean":"2024-03-07T10:20:59.161469+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:20:59.161469+0000","last_undegraded":"2024-03-07T10:20:59.161469+0000","last_fullsized":"2024-03-07T10:20:59.161469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160556+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:20:59.160556+0000","last_peered":"2024-03-07T10:20:59.160556+0000","last_clean":"2024-03-07T10:20:59.160556+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:20:59.160556+0000","last_undegraded":"2024-03-07T10:20:59.160556+0000","last_fullsized":"2024-03-07T10:20:59.160556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160744+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:20:59.160744+0000","last_peered":"2024-03-07T10:20:59.160744+0000","last_clean":"2024-03-07T10:20:59.160744+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:20:59.160744+0000","last_undegraded":"2024-03-07T10:20:59.160744+0000","last_fullsized":"2024-03-07T10:20:59.160744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159549+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:20:59.159549+0000","last_peered":"2024-03-07T10:20:59.159549+0000","last_clean":"2024-03-07T10:20:59.159549+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:20:59.159549+0000","last_undegraded":"2024-03-07T10:20:59.159549+0000","last_fullsized":"2024-03-07T10:20:59.159549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126769+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:20:59.126769+0000","last_peered":"2024-03-07T10:20:59.126769+0000","last_clean":"2024-03-07T10:20:59.126769+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:20:59.126769+0000","last_undegraded":"2024-03-07T10:20:59.126769+0000","last_fullsized":"2024-03-07T10:20:59.126769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160811+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:20:59.160811+0000","last_peered":"2024-03-07T10:20:59.160811+0000","last_clean":"2024-03-07T10:20:59.160811+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:20:59.160811+0000","last_undegraded":"2024-03-07T10:20:59.160811+0000","last_fullsized":"2024-03-07T10:20:59.160811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158899+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:20:59.158899+0000","last_peered":"2024-03-07T10:20:59.158899+0000","last_clean":"2024-03-07T10:20:59.158899+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:20:59.158899+0000","last_undegraded":"2024-03-07T10:20:59.158899+0000","last_fullsized":"2024-03-07T10:20:59.158899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157735+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:20:59.157735+0000","last_peered":"2024-03-07T10:20:59.157735+0000","last_clean":"2024-03-07T10:20:59.157735+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:20:59.157735+0000","last_undegraded":"2024-03-07T10:20:59.157735+0000","last_fullsized":"2024-03-07T10:20:59.157735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128008+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:20:59.128008+0000","last_peered":"2024-03-07T10:20:59.128008+0000","last_clean":"2024-03-07T10:20:59.128008+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:20:59.128008+0000","last_undegraded":"2024-03-07T10:20:59.128008+0000","last_fullsized":"2024-03-07T10:20:59.128008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127342+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:20:59.127342+0000","last_peered":"2024-03-07T10:20:59.127342+0000","last_clean":"2024-03-07T10:20:59.127342+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:20:59.127342+0000","last_undegraded":"2024-03-07T10:20:59.127342+0000","last_fullsized":"2024-03-07T10:20:59.127342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155774+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:20:59.155774+0000","last_peered":"2024-03-07T10:20:59.155774+0000","last_clean":"2024-03-07T10:20:59.155774+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:20:59.155774+0000","last_undegraded":"2024-03-07T10:20:59.155774+0000","last_fullsized":"2024-03-07T10:20:59.155774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154619+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:20:59.154619+0000","last_peered":"2024-03-07T10:20:59.154619+0000","last_clean":"2024-03-07T10:20:59.154619+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:20:59.154619+0000","last_undegraded":"2024-03-07T10:20:59.154619+0000","last_fullsized":"2024-03-07T10:20:59.154619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156709+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:20:59.156709+0000","last_peered":"2024-03-07T10:20:59.156709+0000","last_clean":"2024-03-07T10:20:59.156709+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:20:59.156709+0000","last_undegraded":"2024-03-07T10:20:59.156709+0000","last_fullsized":"2024-03-07T10:20:59.156709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.163642+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:20:59.163642+0000","last_peered":"2024-03-07T10:20:59.163642+0000","last_clean":"2024-03-07T10:20:59.163642+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:20:59.163642+0000","last_undegraded":"2024-03-07T10:20:59.163642+0000","last_fullsized":"2024-03-07T10:20:59.163642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128999+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:20:59.128999+0000","last_peered":"2024-03-07T10:20:59.128999+0000","last_clean":"2024-03-07T10:20:59.128999+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:20:59.128999+0000","last_undegraded":"2024-03-07T10:20:59.128999+0000","last_fullsized":"2024-03-07T10:20:59.128999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158847+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:20:59.158847+0000","last_peered":"2024-03-07T10:20:59.158847+0000","last_clean":"2024-03-07T10:20:59.158847+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:20:59.158847+0000","last_undegraded":"2024-03-07T10:20:59.158847+0000","last_fullsized":"2024-03-07T10:20:59.158847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158156+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:20:59.158156+0000","last_peered":"2024-03-07T10:20:59.158156+0000","last_clean":"2024-03-07T10:20:59.158156+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:20:59.158156+0000","last_undegraded":"2024-03-07T10:20:59.158156+0000","last_fullsized":"2024-03-07T10:20:59.158156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156259+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:20:59.156259+0000","last_peered":"2024-03-07T10:20:59.156259+0000","last_clean":"2024-03-07T10:20:59.156259+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:20:59.156259+0000","last_undegraded":"2024-03-07T10:20:59.156259+0000","last_fullsized":"2024-03-07T10:20:59.156259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161101+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:20:59.161101+0000","last_peered":"2024-03-07T10:20:59.161101+0000","last_clean":"2024-03-07T10:20:59.161101+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:20:59.161101+0000","last_undegraded":"2024-03-07T10:20:59.161101+0000","last_fullsized":"2024-03-07T10:20:59.161101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127221+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:20:59.127221+0000","last_peered":"2024-03-07T10:20:59.127221+0000","last_clean":"2024-03-07T10:20:59.127221+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:20:59.127221+0000","last_undegraded":"2024-03-07T10:20:59.127221+0000","last_fullsized":"2024-03-07T10:20:59.127221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160026+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:20:59.160026+0000","last_peered":"2024-03-07T10:20:59.160026+0000","last_clean":"2024-03-07T10:20:59.160026+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:20:59.160026+0000","last_undegraded":"2024-03-07T10:20:59.160026+0000","last_fullsized":"2024-03-07T10:20:59.160026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127443+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:20:59.127443+0000","last_peered":"2024-03-07T10:20:59.127443+0000","last_clean":"2024-03-07T10:20:59.127443+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:20:59.127443+0000","last_undegraded":"2024-03-07T10:20:59.127443+0000","last_fullsized":"2024-03-07T10:20:59.127443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159296+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:20:59.159296+0000","last_peered":"2024-03-07T10:20:59.159296+0000","last_clean":"2024-03-07T10:20:59.159296+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:20:59.159296+0000","last_undegraded":"2024-03-07T10:20:59.159296+0000","last_fullsized":"2024-03-07T10:20:59.159296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154172+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:20:59.154172+0000","last_peered":"2024-03-07T10:20:59.154172+0000","last_clean":"2024-03-07T10:20:59.154172+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:20:59.154172+0000","last_undegraded":"2024-03-07T10:20:59.154172+0000","last_fullsized":"2024-03-07T10:20:59.154172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128300+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:20:59.128300+0000","last_peered":"2024-03-07T10:20:59.128300+0000","last_clean":"2024-03-07T10:20:59.128300+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:20:59.128300+0000","last_undegraded":"2024-03-07T10:20:59.128300+0000","last_fullsized":"2024-03-07T10:20:59.128300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156283+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:20:59.156283+0000","last_peered":"2024-03-07T10:20:59.156283+0000","last_clean":"2024-03-07T10:20:59.156283+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:20:59.156283+0000","last_undegraded":"2024-03-07T10:20:59.156283+0000","last_fullsized":"2024-03-07T10:20:59.156283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161484+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:20:59.161484+0000","last_peered":"2024-03-07T10:20:59.161484+0000","last_clean":"2024-03-07T10:20:59.161484+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:20:59.161484+0000","last_undegraded":"2024-03-07T10:20:59.161484+0000","last_fullsized":"2024-03-07T10:20:59.161484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128082+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:20:59.128082+0000","last_peered":"2024-03-07T10:20:59.128082+0000","last_clean":"2024-03-07T10:20:59.128082+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:20:59.128082+0000","last_undegraded":"2024-03-07T10:20:59.128082+0000","last_fullsized":"2024-03-07T10:20:59.128082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155642+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:20:59.155642+0000","last_peered":"2024-03-07T10:20:59.155642+0000","last_clean":"2024-03-07T10:20:59.155642+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:20:59.155642+0000","last_undegraded":"2024-03-07T10:20:59.155642+0000","last_fullsized":"2024-03-07T10:20:59.155642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127129+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:20:59.127129+0000","last_peered":"2024-03-07T10:20:59.127129+0000","last_clean":"2024-03-07T10:20:59.127129+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:20:59.127129+0000","last_undegraded":"2024-03-07T10:20:59.127129+0000","last_fullsized":"2024-03-07T10:20:59.127129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127612+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:20:59.127612+0000","last_peered":"2024-03-07T10:20:59.127612+0000","last_clean":"2024-03-07T10:20:59.127612+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:20:59.127612+0000","last_undegraded":"2024-03-07T10:20:59.127612+0000","last_fullsized":"2024-03-07T10:20:59.127612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156586+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:20:59.156586+0000","last_peered":"2024-03-07T10:20:59.156586+0000","last_clean":"2024-03-07T10:20:59.156586+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:20:59.156586+0000","last_undegraded":"2024-03-07T10:20:59.156586+0000","last_fullsized":"2024-03-07T10:20:59.156586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157607+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:20:59.157607+0000","last_peered":"2024-03-07T10:20:59.157607+0000","last_clean":"2024-03-07T10:20:59.157607+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:20:59.157607+0000","last_undegraded":"2024-03-07T10:20:59.157607+0000","last_fullsized":"2024-03-07T10:20:59.157607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127293+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:20:59.127293+0000","last_peered":"2024-03-07T10:20:59.127293+0000","last_clean":"2024-03-07T10:20:59.127293+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:20:59.127293+0000","last_undegraded":"2024-03-07T10:20:59.127293+0000","last_fullsized":"2024-03-07T10:20:59.127293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127062+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:20:59.127062+0000","last_peered":"2024-03-07T10:20:59.127062+0000","last_clean":"2024-03-07T10:20:59.127062+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:20:59.127062+0000","last_undegraded":"2024-03-07T10:20:59.127062+0000","last_fullsized":"2024-03-07T10:20:59.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159708+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:20:59.159708+0000","last_peered":"2024-03-07T10:20:59.159708+0000","last_clean":"2024-03-07T10:20:59.159708+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:20:59.159708+0000","last_undegraded":"2024-03-07T10:20:59.159708+0000","last_fullsized":"2024-03-07T10:20:59.159708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155083+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:20:59.155083+0000","last_peered":"2024-03-07T10:20:59.155083+0000","last_clean":"2024-03-07T10:20:59.155083+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:20:59.155083+0000","last_undegraded":"2024-03-07T10:20:59.155083+0000","last_fullsized":"2024-03-07T10:20:59.155083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156418+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:20:59.156418+0000","last_peered":"2024-03-07T10:20:59.156418+0000","last_clean":"2024-03-07T10:20:59.156418+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:20:59.156418+0000","last_undegraded":"2024-03-07T10:20:59.156418+0000","last_fullsized":"2024-03-07T10:20:59.156418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162999+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:20:59.162999+0000","last_peered":"2024-03-07T10:20:59.162999+0000","last_clean":"2024-03-07T10:20:59.162999+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:20:59.162999+0000","last_undegraded":"2024-03-07T10:20:59.162999+0000","last_fullsized":"2024-03-07T10:20:59.162999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162981+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:20:59.162981+0000","last_peered":"2024-03-07T10:20:59.162981+0000","last_clean":"2024-03-07T10:20:59.162981+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:20:59.162981+0000","last_undegraded":"2024-03-07T10:20:59.162981+0000","last_fullsized":"2024-03-07T10:20:59.162981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156375+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:20:59.156375+0000","last_peered":"2024-03-07T10:20:59.156375+0000","last_clean":"2024-03-07T10:20:59.156375+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:20:59.156375+0000","last_undegraded":"2024-03-07T10:20:59.156375+0000","last_fullsized":"2024-03-07T10:20:59.156375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154219+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:20:59.154219+0000","last_peered":"2024-03-07T10:20:59.154219+0000","last_clean":"2024-03-07T10:20:59.154219+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:20:59.154219+0000","last_undegraded":"2024-03-07T10:20:59.154219+0000","last_fullsized":"2024-03-07T10:20:59.154219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128063+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:20:59.128063+0000","last_peered":"2024-03-07T10:20:59.128063+0000","last_clean":"2024-03-07T10:20:59.128063+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:20:59.128063+0000","last_undegraded":"2024-03-07T10:20:59.128063+0000","last_fullsized":"2024-03-07T10:20:59.128063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158087+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:20:59.158087+0000","last_peered":"2024-03-07T10:20:59.158087+0000","last_clean":"2024-03-07T10:20:59.158087+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:20:59.158087+0000","last_undegraded":"2024-03-07T10:20:59.158087+0000","last_fullsized":"2024-03-07T10:20:59.158087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157998+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:20:59.157998+0000","last_peered":"2024-03-07T10:20:59.157998+0000","last_clean":"2024-03-07T10:20:59.157998+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:20:59.157998+0000","last_undegraded":"2024-03-07T10:20:59.157998+0000","last_fullsized":"2024-03-07T10:20:59.157998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156386+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:20:59.156386+0000","last_peered":"2024-03-07T10:20:59.156386+0000","last_clean":"2024-03-07T10:20:59.156386+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:20:59.156386+0000","last_undegraded":"2024-03-07T10:20:59.156386+0000","last_fullsized":"2024-03-07T10:20:59.156386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156134+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:20:59.156134+0000","last_peered":"2024-03-07T10:20:59.156134+0000","last_clean":"2024-03-07T10:20:59.156134+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:20:59.156134+0000","last_undegraded":"2024-03-07T10:20:59.156134+0000","last_fullsized":"2024-03-07T10:20:59.156134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161624+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:20:59.161624+0000","last_peered":"2024-03-07T10:20:59.161624+0000","last_clean":"2024-03-07T10:20:59.161624+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:20:59.161624+0000","last_undegraded":"2024-03-07T10:20:59.161624+0000","last_fullsized":"2024-03-07T10:20:59.161624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160807+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:20:59.160807+0000","last_peered":"2024-03-07T10:20:59.160807+0000","last_clean":"2024-03-07T10:20:59.160807+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:20:59.160807+0000","last_undegraded":"2024-03-07T10:20:59.160807+0000","last_fullsized":"2024-03-07T10:20:59.160807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155880+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:20:59.155880+0000","last_peered":"2024-03-07T10:20:59.155880+0000","last_clean":"2024-03-07T10:20:59.155880+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:20:59.155880+0000","last_undegraded":"2024-03-07T10:20:59.155880+0000","last_fullsized":"2024-03-07T10:20:59.155880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155610+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:20:59.155610+0000","last_peered":"2024-03-07T10:20:59.155610+0000","last_clean":"2024-03-07T10:20:59.155610+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:20:59.155610+0000","last_undegraded":"2024-03-07T10:20:59.155610+0000","last_fullsized":"2024-03-07T10:20:59.155610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126868+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:20:59.126868+0000","last_peered":"2024-03-07T10:20:59.126868+0000","last_clean":"2024-03-07T10:20:59.126868+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:20:59.126868+0000","last_undegraded":"2024-03-07T10:20:59.126868+0000","last_fullsized":"2024-03-07T10:20:59.126868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159818+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:20:59.159818+0000","last_peered":"2024-03-07T10:20:59.159818+0000","last_clean":"2024-03-07T10:20:59.159818+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:20:59.159818+0000","last_undegraded":"2024-03-07T10:20:59.159818+0000","last_fullsized":"2024-03-07T10:20:59.159818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128163+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:20:59.128163+0000","last_peered":"2024-03-07T10:20:59.128163+0000","last_clean":"2024-03-07T10:20:59.128163+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:20:59.128163+0000","last_undegraded":"2024-03-07T10:20:59.128163+0000","last_fullsized":"2024-03-07T10:20:59.128163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159690+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:20:59.159690+0000","last_peered":"2024-03-07T10:20:59.159690+0000","last_clean":"2024-03-07T10:20:59.159690+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:20:59.159690+0000","last_undegraded":"2024-03-07T10:20:59.159690+0000","last_fullsized":"2024-03-07T10:20:59.159690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.129075+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:20:59.129075+0000","last_peered":"2024-03-07T10:20:59.129075+0000","last_clean":"2024-03-07T10:20:59.129075+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:20:59.129075+0000","last_undegraded":"2024-03-07T10:20:59.129075+0000","last_fullsized":"2024-03-07T10:20:59.129075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161057+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:20:59.161057+0000","last_peered":"2024-03-07T10:20:59.161057+0000","last_clean":"2024-03-07T10:20:59.161057+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:20:59.161057+0000","last_undegraded":"2024-03-07T10:20:59.161057+0000","last_fullsized":"2024-03-07T10:20:59.161057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154269+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:20:59.154269+0000","last_peered":"2024-03-07T10:20:59.154269+0000","last_clean":"2024-03-07T10:20:59.154269+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:20:59.154269+0000","last_undegraded":"2024-03-07T10:20:59.154269+0000","last_fullsized":"2024-03-07T10:20:59.154269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161902+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:20:59.161902+0000","last_peered":"2024-03-07T10:20:59.161902+0000","last_clean":"2024-03-07T10:20:59.161902+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:20:59.161902+0000","last_undegraded":"2024-03-07T10:20:59.161902+0000","last_fullsized":"2024-03-07T10:20:59.161902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128700+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:20:59.128700+0000","last_peered":"2024-03-07T10:20:59.128700+0000","last_clean":"2024-03-07T10:20:59.128700+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:20:59.128700+0000","last_undegraded":"2024-03-07T10:20:59.128700+0000","last_fullsized":"2024-03-07T10:20:59.128700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158328+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:20:59.158328+0000","last_peered":"2024-03-07T10:20:59.158328+0000","last_clean":"2024-03-07T10:20:59.158328+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:20:59.158328+0000","last_undegraded":"2024-03-07T10:20:59.158328+0000","last_fullsized":"2024-03-07T10:20:59.158328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160651+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:20:59.160651+0000","last_peered":"2024-03-07T10:20:59.160651+0000","last_clean":"2024-03-07T10:20:59.160651+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:20:59.160651+0000","last_undegraded":"2024-03-07T10:20:59.160651+0000","last_fullsized":"2024-03-07T10:20:59.160651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160618+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:20:59.160618+0000","last_peered":"2024-03-07T10:20:59.160618+0000","last_clean":"2024-03-07T10:20:59.160618+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:20:59.160618+0000","last_undegraded":"2024-03-07T10:20:59.160618+0000","last_fullsized":"2024-03-07T10:20:59.160618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127396+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:20:59.127396+0000","last_peered":"2024-03-07T10:20:59.127396+0000","last_clean":"2024-03-07T10:20:59.127396+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:20:59.127396+0000","last_undegraded":"2024-03-07T10:20:59.127396+0000","last_fullsized":"2024-03-07T10:20:59.127396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160346+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:20:59.160346+0000","last_peered":"2024-03-07T10:20:59.160346+0000","last_clean":"2024-03-07T10:20:59.160346+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:20:59.160346+0000","last_undegraded":"2024-03-07T10:20:59.160346+0000","last_fullsized":"2024-03-07T10:20:59.160346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155688+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:20:59.155688+0000","last_peered":"2024-03-07T10:20:59.155688+0000","last_clean":"2024-03-07T10:20:59.155688+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:20:59.155688+0000","last_undegraded":"2024-03-07T10:20:59.155688+0000","last_fullsized":"2024-03-07T10:20:59.155688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128217+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:20:59.128217+0000","last_peered":"2024-03-07T10:20:59.128217+0000","last_clean":"2024-03-07T10:20:59.128217+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:20:59.128217+0000","last_undegraded":"2024-03-07T10:20:59.128217+0000","last_fullsized":"2024-03-07T10:20:59.128217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155001+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:20:59.155001+0000","last_peered":"2024-03-07T10:20:59.155001+0000","last_clean":"2024-03-07T10:20:59.155001+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:20:59.155001+0000","last_undegraded":"2024-03-07T10:20:59.155001+0000","last_fullsized":"2024-03-07T10:20:59.155001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161860+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:20:59.161860+0000","last_peered":"2024-03-07T10:20:59.161860+0000","last_clean":"2024-03-07T10:20:59.161860+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:20:59.161860+0000","last_undegraded":"2024-03-07T10:20:59.161860+0000","last_fullsized":"2024-03-07T10:20:59.161860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128125+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:20:59.128125+0000","last_peered":"2024-03-07T10:20:59.128125+0000","last_clean":"2024-03-07T10:20:59.128125+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:20:59.128125+0000","last_undegraded":"2024-03-07T10:20:59.128125+0000","last_fullsized":"2024-03-07T10:20:59.128125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154411+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:20:59.154411+0000","last_peered":"2024-03-07T10:20:59.154411+0000","last_clean":"2024-03-07T10:20:59.154411+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:20:59.154411+0000","last_undegraded":"2024-03-07T10:20:59.154411+0000","last_fullsized":"2024-03-07T10:20:59.154411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162358+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:20:59.162358+0000","last_peered":"2024-03-07T10:20:59.162358+0000","last_clean":"2024-03-07T10:20:59.162358+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:20:59.162358+0000","last_undegraded":"2024-03-07T10:20:59.162358+0000","last_fullsized":"2024-03-07T10:20:59.162358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158957+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:20:59.158957+0000","last_peered":"2024-03-07T10:20:59.158957+0000","last_clean":"2024-03-07T10:20:59.158957+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:20:59.158957+0000","last_undegraded":"2024-03-07T10:20:59.158957+0000","last_fullsized":"2024-03-07T10:20:59.158957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154278+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:20:59.154278+0000","last_peered":"2024-03-07T10:20:59.154278+0000","last_clean":"2024-03-07T10:20:59.154278+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:20:59.154278+0000","last_undegraded":"2024-03-07T10:20:59.154278+0000","last_fullsized":"2024-03-07T10:20:59.154278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155431+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:20:59.155431+0000","last_peered":"2024-03-07T10:20:59.155431+0000","last_clean":"2024-03-07T10:20:59.155431+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:20:59.155431+0000","last_undegraded":"2024-03-07T10:20:59.155431+0000","last_fullsized":"2024-03-07T10:20:59.155431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128112+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:20:59.128112+0000","last_peered":"2024-03-07T10:20:59.128112+0000","last_clean":"2024-03-07T10:20:59.128112+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:20:59.128112+0000","last_undegraded":"2024-03-07T10:20:59.128112+0000","last_fullsized":"2024-03-07T10:20:59.128112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156657+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:20:59.156657+0000","last_peered":"2024-03-07T10:20:59.156657+0000","last_clean":"2024-03-07T10:20:59.156657+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:20:59.156657+0000","last_undegraded":"2024-03-07T10:20:59.156657+0000","last_fullsized":"2024-03-07T10:20:59.156657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155877+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:20:59.155877+0000","last_peered":"2024-03-07T10:20:59.155877+0000","last_clean":"2024-03-07T10:20:59.155877+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:20:59.155877+0000","last_undegraded":"2024-03-07T10:20:59.155877+0000","last_fullsized":"2024-03-07T10:20:59.155877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160329+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:20:59.160329+0000","last_peered":"2024-03-07T10:20:59.160329+0000","last_clean":"2024-03-07T10:20:59.160329+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:20:59.160329+0000","last_undegraded":"2024-03-07T10:20:59.160329+0000","last_fullsized":"2024-03-07T10:20:59.160329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127175+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:20:59.127175+0000","last_peered":"2024-03-07T10:20:59.127175+0000","last_clean":"2024-03-07T10:20:59.127175+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:20:59.127175+0000","last_undegraded":"2024-03-07T10:20:59.127175+0000","last_fullsized":"2024-03-07T10:20:59.127175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154704+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:20:59.154704+0000","last_peered":"2024-03-07T10:20:59.154704+0000","last_clean":"2024-03-07T10:20:59.154704+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:20:59.154704+0000","last_undegraded":"2024-03-07T10:20:59.154704+0000","last_fullsized":"2024-03-07T10:20:59.154704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126993+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:20:59.126993+0000","last_peered":"2024-03-07T10:20:59.126993+0000","last_clean":"2024-03-07T10:20:59.126993+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:20:59.126993+0000","last_undegraded":"2024-03-07T10:20:59.126993+0000","last_fullsized":"2024-03-07T10:20:59.126993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154153+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:20:59.154153+0000","last_peered":"2024-03-07T10:20:59.154153+0000","last_clean":"2024-03-07T10:20:59.154153+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:20:59.154153+0000","last_undegraded":"2024-03-07T10:20:59.154153+0000","last_fullsized":"2024-03-07T10:20:59.154153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127563+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:20:59.127563+0000","last_peered":"2024-03-07T10:20:59.127563+0000","last_clean":"2024-03-07T10:20:59.127563+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:20:59.127563+0000","last_undegraded":"2024-03-07T10:20:59.127563+0000","last_fullsized":"2024-03-07T10:20:59.127563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161004+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:20:59.161004+0000","last_peered":"2024-03-07T10:20:59.161004+0000","last_clean":"2024-03-07T10:20:59.161004+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:20:59.161004+0000","last_undegraded":"2024-03-07T10:20:59.161004+0000","last_fullsized":"2024-03-07T10:20:59.161004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157613+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:20:59.157613+0000","last_peered":"2024-03-07T10:20:59.157613+0000","last_clean":"2024-03-07T10:20:59.157613+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:20:59.157613+0000","last_undegraded":"2024-03-07T10:20:59.157613+0000","last_fullsized":"2024-03-07T10:20:59.157613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161920+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:20:59.161920+0000","last_peered":"2024-03-07T10:20:59.161920+0000","last_clean":"2024-03-07T10:20:59.161920+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:20:59.161920+0000","last_undegraded":"2024-03-07T10:20:59.161920+0000","last_fullsized":"2024-03-07T10:20:59.161920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157312+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:20:59.157312+0000","last_peered":"2024-03-07T10:20:59.157312+0000","last_clean":"2024-03-07T10:20:59.157312+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:20:59.157312+0000","last_undegraded":"2024-03-07T10:20:59.157312+0000","last_fullsized":"2024-03-07T10:20:59.157312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161708+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:20:59.161708+0000","last_peered":"2024-03-07T10:20:59.161708+0000","last_clean":"2024-03-07T10:20:59.161708+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:20:59.161708+0000","last_undegraded":"2024-03-07T10:20:59.161708+0000","last_fullsized":"2024-03-07T10:20:59.161708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158438+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:20:59.158438+0000","last_peered":"2024-03-07T10:20:59.158438+0000","last_clean":"2024-03-07T10:20:59.158438+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:20:59.158438+0000","last_undegraded":"2024-03-07T10:20:59.158438+0000","last_fullsized":"2024-03-07T10:20:59.158438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156277+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:20:59.156277+0000","last_peered":"2024-03-07T10:20:59.156277+0000","last_clean":"2024-03-07T10:20:59.156277+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:20:59.156277+0000","last_undegraded":"2024-03-07T10:20:59.156277+0000","last_fullsized":"2024-03-07T10:20:59.156277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127787+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:20:59.127787+0000","last_peered":"2024-03-07T10:20:59.127787+0000","last_clean":"2024-03-07T10:20:59.127787+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:20:59.127787+0000","last_undegraded":"2024-03-07T10:20:59.127787+0000","last_fullsized":"2024-03-07T10:20:59.127787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127710+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:20:59.127710+0000","last_peered":"2024-03-07T10:20:59.127710+0000","last_clean":"2024-03-07T10:20:59.127710+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:20:59.127710+0000","last_undegraded":"2024-03-07T10:20:59.127710+0000","last_fullsized":"2024-03-07T10:20:59.127710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156427+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:20:59.156427+0000","last_peered":"2024-03-07T10:20:59.156427+0000","last_clean":"2024-03-07T10:20:59.156427+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:20:59.156427+0000","last_undegraded":"2024-03-07T10:20:59.156427+0000","last_fullsized":"2024-03-07T10:20:59.156427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:03.603 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:03.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.839+0000 7f6a00a00640 1 Processor -- start 2024-03-07T10:21:03.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.839+0000 7f6a00a00640 1 -- start start 2024-03-07T10:21:03.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.840+0000 7f6a00a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.840+0000 7f6a00a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.840+0000 7f6a00a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc155b20 con 0x7f69fc06c1c0 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f6a00a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc1531c0 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f6a00a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc155dc0 con 0x7f69fc1528a0 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37138/0 (socket says 172.21.15.194:37138) 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 -- 172.21.15.194:0/1275589719 learned_addr learned my addr 172.21.15.194:0/1275589719 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69f9e00640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 -- 172.21.15.194:0/1275589719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 msgr2=0x7f69fc152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 -- 172.21.15.194:0/1275589719 >> v1:172.21.15.196:6789/0 conn(0x7f69fc06c1c0 legacy=0x7f69fc06c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:03.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.841+0000 7f69fa800640 1 -- 172.21.15.194:0/1275589719 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc156080 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.842+0000 7f69fa800640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0cbd20 tx=0x7f69ec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c3ce553131dcd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f69f9400640 1 -- 172.21.15.194:0/1275589719 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0315a0 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f69f9400640 1 -- 172.21.15.194:0/1275589719 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec037070 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f69f9400640 1 -- 172.21.15.194:0/1275589719 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec031960 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 -- 172.21.15.194:0/1275589719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 msgr2=0x7f69fc0c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f69fc0cbd20 tx=0x7f69ec02b840 comp rx=0 tx=0).stop 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 -- 172.21.15.194:0/1275589719 shutdown_connections 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 --2- 172.21.15.194:0/1275589719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc0c8ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 -- 172.21.15.194:0/1275589719 >> 172.21.15.194:0/1275589719 conn(0x7f69fc0675e0 msgr2=0x7f69fc0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 -- 172.21.15.194:0/1275589719 shutdown_connections 2024-03-07T10:21:03.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.843+0000 7f6a00a00640 1 -- 172.21.15.194:0/1275589719 wait complete. 2024-03-07T10:21:03.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.845+0000 7f6a00a00640 1 Processor -- start 2024-03-07T10:21:03.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.845+0000 7f6a00a00640 1 -- start start 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69fc06c1c0 0x7f69fc0c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc06cd40 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc156640 con 0x7f69fc06c1c0 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f6a00a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc06cec0 con 0x7f69fc1528a0 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f69f9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f69f9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37148/0 (socket says 172.21.15.194:37148) 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f69f9e00640 1 -- 172.21.15.194:0/2892340351 learned_addr learned my addr 172.21.15.194:0/2892340351 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f69fa800640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69fc06c1c0 0x7f69fc0c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.846+0000 7f69fb200640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 -- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 msgr2=0x7f69fc154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc154820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 -- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69fc06c1c0 msgr2=0x7f69fc0c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69fc06c1c0 0x7f69fc0c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 -- 172.21.15.194:0/2892340351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc158400 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69fb200640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:03.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f9e00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c7f0 tx=0x7f69e800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8015070 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e8004220 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e8007620 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc0c1cf0 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.847+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc158980 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.848+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc068170 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.849+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f69e80079d0 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.850+0000 7f69f2a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 0x7f69dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:03.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.850+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f69e808a270 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.851+0000 7f69fa800640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 0x7f69dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:03.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.852+0000 7f69fa800640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 0x7f69dc06d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69ec036000 tx=0x7f69ec03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:03.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:03.854+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f69e80590f0 con 0x7f69fc0c5bc0 2024-03-07T10:21:03.909 INFO:tasks.ceph.mds.b.smithi196.stderr:2024-03-07T10:21:03.907+0000 7f010ac00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:21:04.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.050+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69fc06d450 con 0x7f69dc06b4d0 2024-03-07T10:21:04.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.068+0000 7f69f2a00640 1 -- 172.21.15.194:0/2892340351 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251948 (secure 0 0 0) 0x7f69fc06d450 con 0x7f69dc06b4d0 2024-03-07T10:21:04.074 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:04.075 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.073+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 msgr2=0x7f69dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.073+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 0x7f69dc06d990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69ec036000 tx=0x7f69ec03d040 comp rx=0 tx=0).stop 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.073+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 msgr2=0x7f69fc1ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.073+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f69e800c7f0 tx=0x7f69e800ccb0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 shutdown_connections 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69dc06b4d0 0x7f69dc06d990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69fc1528a0 0x7f69fc154820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69fc0c5bc0 0x7f69fc1ee450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 --2- 172.21.15.194:0/2892340351 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69fc06c1c0 0x7f69fc0c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 >> 172.21.15.194:0/2892340351 conn(0x7f69fc0675e0 msgr2=0x7f69fc0c8150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:04.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 shutdown_connections 2024-03-07T10:21:04.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.074+0000 7f6a00a00640 1 -- 172.21.15.194:0/2892340351 wait complete. 2024-03-07T10:21:04.096 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-07T10:21:02.411311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218988,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755732,"statfs":{"total":773094113280,"available":772869869568,"internally_reserved":0,"allocated":2891776,"data_stored":1752388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002303"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160564+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:20:59.160564+0000","last_peered":"2024-03-07T10:20:59.160564+0000","last_clean":"2024-03-07T10:20:59.160564+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:20:59.160564+0000","last_undegraded":"2024-03-07T10:20:59.160564+0000","last_fullsized":"2024-03-07T10:20:59.160564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154601+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:20:59.154601+0000","last_peered":"2024-03-07T10:20:59.154601+0000","last_clean":"2024-03-07T10:20:59.154601+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:20:59.154601+0000","last_undegraded":"2024-03-07T10:20:59.154601+0000","last_fullsized":"2024-03-07T10:20:59.154601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155951+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:20:59.155951+0000","last_peered":"2024-03-07T10:20:59.155951+0000","last_clean":"2024-03-07T10:20:59.155951+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:20:59.155951+0000","last_undegraded":"2024-03-07T10:20:59.155951+0000","last_fullsized":"2024-03-07T10:20:59.155951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161469+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:20:59.161469+0000","last_peered":"2024-03-07T10:20:59.161469+0000","last_clean":"2024-03-07T10:20:59.161469+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:20:59.161469+0000","last_undegraded":"2024-03-07T10:20:59.161469+0000","last_fullsized":"2024-03-07T10:20:59.161469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160556+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:20:59.160556+0000","last_peered":"2024-03-07T10:20:59.160556+0000","last_clean":"2024-03-07T10:20:59.160556+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:20:59.160556+0000","last_undegraded":"2024-03-07T10:20:59.160556+0000","last_fullsized":"2024-03-07T10:20:59.160556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160744+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:20:59.160744+0000","last_peered":"2024-03-07T10:20:59.160744+0000","last_clean":"2024-03-07T10:20:59.160744+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:20:59.160744+0000","last_undegraded":"2024-03-07T10:20:59.160744+0000","last_fullsized":"2024-03-07T10:20:59.160744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159549+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:20:59.159549+0000","last_peered":"2024-03-07T10:20:59.159549+0000","last_clean":"2024-03-07T10:20:59.159549+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:20:59.159549+0000","last_undegraded":"2024-03-07T10:20:59.159549+0000","last_fullsized":"2024-03-07T10:20:59.159549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126769+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:20:59.126769+0000","last_peered":"2024-03-07T10:20:59.126769+0000","last_clean":"2024-03-07T10:20:59.126769+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:20:59.126769+0000","last_undegraded":"2024-03-07T10:20:59.126769+0000","last_fullsized":"2024-03-07T10:20:59.126769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160811+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:20:59.160811+0000","last_peered":"2024-03-07T10:20:59.160811+0000","last_clean":"2024-03-07T10:20:59.160811+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:20:59.160811+0000","last_undegraded":"2024-03-07T10:20:59.160811+0000","last_fullsized":"2024-03-07T10:20:59.160811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158899+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:20:59.158899+0000","last_peered":"2024-03-07T10:20:59.158899+0000","last_clean":"2024-03-07T10:20:59.158899+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:20:59.158899+0000","last_undegraded":"2024-03-07T10:20:59.158899+0000","last_fullsized":"2024-03-07T10:20:59.158899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157735+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:20:59.157735+0000","last_peered":"2024-03-07T10:20:59.157735+0000","last_clean":"2024-03-07T10:20:59.157735+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:20:59.157735+0000","last_undegraded":"2024-03-07T10:20:59.157735+0000","last_fullsized":"2024-03-07T10:20:59.157735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128008+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:20:59.128008+0000","last_peered":"2024-03-07T10:20:59.128008+0000","last_clean":"2024-03-07T10:20:59.128008+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:20:59.128008+0000","last_undegraded":"2024-03-07T10:20:59.128008+0000","last_fullsized":"2024-03-07T10:20:59.128008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127342+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:20:59.127342+0000","last_peered":"2024-03-07T10:20:59.127342+0000","last_clean":"2024-03-07T10:20:59.127342+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:20:59.127342+0000","last_undegraded":"2024-03-07T10:20:59.127342+0000","last_fullsized":"2024-03-07T10:20:59.127342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155774+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:20:59.155774+0000","last_peered":"2024-03-07T10:20:59.155774+0000","last_clean":"2024-03-07T10:20:59.155774+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:20:59.155774+0000","last_undegraded":"2024-03-07T10:20:59.155774+0000","last_fullsized":"2024-03-07T10:20:59.155774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154619+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:20:59.154619+0000","last_peered":"2024-03-07T10:20:59.154619+0000","last_clean":"2024-03-07T10:20:59.154619+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:20:59.154619+0000","last_undegraded":"2024-03-07T10:20:59.154619+0000","last_fullsized":"2024-03-07T10:20:59.154619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156709+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:20:59.156709+0000","last_peered":"2024-03-07T10:20:59.156709+0000","last_clean":"2024-03-07T10:20:59.156709+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:20:59.156709+0000","last_undegraded":"2024-03-07T10:20:59.156709+0000","last_fullsized":"2024-03-07T10:20:59.156709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.163642+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:20:59.163642+0000","last_peered":"2024-03-07T10:20:59.163642+0000","last_clean":"2024-03-07T10:20:59.163642+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:20:59.163642+0000","last_undegraded":"2024-03-07T10:20:59.163642+0000","last_fullsized":"2024-03-07T10:20:59.163642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128999+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:20:59.128999+0000","last_peered":"2024-03-07T10:20:59.128999+0000","last_clean":"2024-03-07T10:20:59.128999+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:20:59.128999+0000","last_undegraded":"2024-03-07T10:20:59.128999+0000","last_fullsized":"2024-03-07T10:20:59.128999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158847+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:20:59.158847+0000","last_peered":"2024-03-07T10:20:59.158847+0000","last_clean":"2024-03-07T10:20:59.158847+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:20:59.158847+0000","last_undegraded":"2024-03-07T10:20:59.158847+0000","last_fullsized":"2024-03-07T10:20:59.158847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158156+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:20:59.158156+0000","last_peered":"2024-03-07T10:20:59.158156+0000","last_clean":"2024-03-07T10:20:59.158156+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:20:59.158156+0000","last_undegraded":"2024-03-07T10:20:59.158156+0000","last_fullsized":"2024-03-07T10:20:59.158156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156259+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:20:59.156259+0000","last_peered":"2024-03-07T10:20:59.156259+0000","last_clean":"2024-03-07T10:20:59.156259+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:20:59.156259+0000","last_undegraded":"2024-03-07T10:20:59.156259+0000","last_fullsized":"2024-03-07T10:20:59.156259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161101+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:20:59.161101+0000","last_peered":"2024-03-07T10:20:59.161101+0000","last_clean":"2024-03-07T10:20:59.161101+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:20:59.161101+0000","last_undegraded":"2024-03-07T10:20:59.161101+0000","last_fullsized":"2024-03-07T10:20:59.161101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127221+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:20:59.127221+0000","last_peered":"2024-03-07T10:20:59.127221+0000","last_clean":"2024-03-07T10:20:59.127221+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:20:59.127221+0000","last_undegraded":"2024-03-07T10:20:59.127221+0000","last_fullsized":"2024-03-07T10:20:59.127221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160026+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:20:59.160026+0000","last_peered":"2024-03-07T10:20:59.160026+0000","last_clean":"2024-03-07T10:20:59.160026+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:20:59.160026+0000","last_undegraded":"2024-03-07T10:20:59.160026+0000","last_fullsized":"2024-03-07T10:20:59.160026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127443+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:20:59.127443+0000","last_peered":"2024-03-07T10:20:59.127443+0000","last_clean":"2024-03-07T10:20:59.127443+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:20:59.127443+0000","last_undegraded":"2024-03-07T10:20:59.127443+0000","last_fullsized":"2024-03-07T10:20:59.127443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159296+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:20:59.159296+0000","last_peered":"2024-03-07T10:20:59.159296+0000","last_clean":"2024-03-07T10:20:59.159296+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:20:59.159296+0000","last_undegraded":"2024-03-07T10:20:59.159296+0000","last_fullsized":"2024-03-07T10:20:59.159296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154172+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:20:59.154172+0000","last_peered":"2024-03-07T10:20:59.154172+0000","last_clean":"2024-03-07T10:20:59.154172+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:20:59.154172+0000","last_undegraded":"2024-03-07T10:20:59.154172+0000","last_fullsized":"2024-03-07T10:20:59.154172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128300+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:20:59.128300+0000","last_peered":"2024-03-07T10:20:59.128300+0000","last_clean":"2024-03-07T10:20:59.128300+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:20:59.128300+0000","last_undegraded":"2024-03-07T10:20:59.128300+0000","last_fullsized":"2024-03-07T10:20:59.128300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156283+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:20:59.156283+0000","last_peered":"2024-03-07T10:20:59.156283+0000","last_clean":"2024-03-07T10:20:59.156283+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:20:59.156283+0000","last_undegraded":"2024-03-07T10:20:59.156283+0000","last_fullsized":"2024-03-07T10:20:59.156283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161484+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:20:59.161484+0000","last_peered":"2024-03-07T10:20:59.161484+0000","last_clean":"2024-03-07T10:20:59.161484+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:20:59.161484+0000","last_undegraded":"2024-03-07T10:20:59.161484+0000","last_fullsized":"2024-03-07T10:20:59.161484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128082+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:20:59.128082+0000","last_peered":"2024-03-07T10:20:59.128082+0000","last_clean":"2024-03-07T10:20:59.128082+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:20:59.128082+0000","last_undegraded":"2024-03-07T10:20:59.128082+0000","last_fullsized":"2024-03-07T10:20:59.128082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155642+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:20:59.155642+0000","last_peered":"2024-03-07T10:20:59.155642+0000","last_clean":"2024-03-07T10:20:59.155642+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:20:59.155642+0000","last_undegraded":"2024-03-07T10:20:59.155642+0000","last_fullsized":"2024-03-07T10:20:59.155642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127129+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:20:59.127129+0000","last_peered":"2024-03-07T10:20:59.127129+0000","last_clean":"2024-03-07T10:20:59.127129+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:20:59.127129+0000","last_undegraded":"2024-03-07T10:20:59.127129+0000","last_fullsized":"2024-03-07T10:20:59.127129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127612+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:20:59.127612+0000","last_peered":"2024-03-07T10:20:59.127612+0000","last_clean":"2024-03-07T10:20:59.127612+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:20:59.127612+0000","last_undegraded":"2024-03-07T10:20:59.127612+0000","last_fullsized":"2024-03-07T10:20:59.127612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156586+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:20:59.156586+0000","last_peered":"2024-03-07T10:20:59.156586+0000","last_clean":"2024-03-07T10:20:59.156586+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:20:59.156586+0000","last_undegraded":"2024-03-07T10:20:59.156586+0000","last_fullsized":"2024-03-07T10:20:59.156586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157607+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:20:59.157607+0000","last_peered":"2024-03-07T10:20:59.157607+0000","last_clean":"2024-03-07T10:20:59.157607+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:20:59.157607+0000","last_undegraded":"2024-03-07T10:20:59.157607+0000","last_fullsized":"2024-03-07T10:20:59.157607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127293+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:20:59.127293+0000","last_peered":"2024-03-07T10:20:59.127293+0000","last_clean":"2024-03-07T10:20:59.127293+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:20:59.127293+0000","last_undegraded":"2024-03-07T10:20:59.127293+0000","last_fullsized":"2024-03-07T10:20:59.127293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127062+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:20:59.127062+0000","last_peered":"2024-03-07T10:20:59.127062+0000","last_clean":"2024-03-07T10:20:59.127062+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:20:59.127062+0000","last_undegraded":"2024-03-07T10:20:59.127062+0000","last_fullsized":"2024-03-07T10:20:59.127062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159708+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:20:59.159708+0000","last_peered":"2024-03-07T10:20:59.159708+0000","last_clean":"2024-03-07T10:20:59.159708+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:20:59.159708+0000","last_undegraded":"2024-03-07T10:20:59.159708+0000","last_fullsized":"2024-03-07T10:20:59.159708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155083+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:20:59.155083+0000","last_peered":"2024-03-07T10:20:59.155083+0000","last_clean":"2024-03-07T10:20:59.155083+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:20:59.155083+0000","last_undegraded":"2024-03-07T10:20:59.155083+0000","last_fullsized":"2024-03-07T10:20:59.155083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156418+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:20:59.156418+0000","last_peered":"2024-03-07T10:20:59.156418+0000","last_clean":"2024-03-07T10:20:59.156418+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:20:59.156418+0000","last_undegraded":"2024-03-07T10:20:59.156418+0000","last_fullsized":"2024-03-07T10:20:59.156418+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162999+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:20:59.162999+0000","last_peered":"2024-03-07T10:20:59.162999+0000","last_clean":"2024-03-07T10:20:59.162999+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:20:59.162999+0000","last_undegraded":"2024-03-07T10:20:59.162999+0000","last_fullsized":"2024-03-07T10:20:59.162999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162981+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:20:59.162981+0000","last_peered":"2024-03-07T10:20:59.162981+0000","last_clean":"2024-03-07T10:20:59.162981+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:20:59.162981+0000","last_undegraded":"2024-03-07T10:20:59.162981+0000","last_fullsized":"2024-03-07T10:20:59.162981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156375+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:20:59.156375+0000","last_peered":"2024-03-07T10:20:59.156375+0000","last_clean":"2024-03-07T10:20:59.156375+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:20:59.156375+0000","last_undegraded":"2024-03-07T10:20:59.156375+0000","last_fullsized":"2024-03-07T10:20:59.156375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154219+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:20:59.154219+0000","last_peered":"2024-03-07T10:20:59.154219+0000","last_clean":"2024-03-07T10:20:59.154219+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:20:59.154219+0000","last_undegraded":"2024-03-07T10:20:59.154219+0000","last_fullsized":"2024-03-07T10:20:59.154219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128063+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:20:59.128063+0000","last_peered":"2024-03-07T10:20:59.128063+0000","last_clean":"2024-03-07T10:20:59.128063+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:20:59.128063+0000","last_undegraded":"2024-03-07T10:20:59.128063+0000","last_fullsized":"2024-03-07T10:20:59.128063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158087+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:20:59.158087+0000","last_peered":"2024-03-07T10:20:59.158087+0000","last_clean":"2024-03-07T10:20:59.158087+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:20:59.158087+0000","last_undegraded":"2024-03-07T10:20:59.158087+0000","last_fullsized":"2024-03-07T10:20:59.158087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157998+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:20:59.157998+0000","last_peered":"2024-03-07T10:20:59.157998+0000","last_clean":"2024-03-07T10:20:59.157998+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:20:59.157998+0000","last_undegraded":"2024-03-07T10:20:59.157998+0000","last_fullsized":"2024-03-07T10:20:59.157998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156386+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:20:59.156386+0000","last_peered":"2024-03-07T10:20:59.156386+0000","last_clean":"2024-03-07T10:20:59.156386+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:20:59.156386+0000","last_undegraded":"2024-03-07T10:20:59.156386+0000","last_fullsized":"2024-03-07T10:20:59.156386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156134+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:20:59.156134+0000","last_peered":"2024-03-07T10:20:59.156134+0000","last_clean":"2024-03-07T10:20:59.156134+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:20:59.156134+0000","last_undegraded":"2024-03-07T10:20:59.156134+0000","last_fullsized":"2024-03-07T10:20:59.156134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161624+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:20:59.161624+0000","last_peered":"2024-03-07T10:20:59.161624+0000","last_clean":"2024-03-07T10:20:59.161624+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:20:59.161624+0000","last_undegraded":"2024-03-07T10:20:59.161624+0000","last_fullsized":"2024-03-07T10:20:59.161624+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160807+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:20:59.160807+0000","last_peered":"2024-03-07T10:20:59.160807+0000","last_clean":"2024-03-07T10:20:59.160807+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:20:59.160807+0000","last_undegraded":"2024-03-07T10:20:59.160807+0000","last_fullsized":"2024-03-07T10:20:59.160807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155880+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:20:59.155880+0000","last_peered":"2024-03-07T10:20:59.155880+0000","last_clean":"2024-03-07T10:20:59.155880+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:20:59.155880+0000","last_undegraded":"2024-03-07T10:20:59.155880+0000","last_fullsized":"2024-03-07T10:20:59.155880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155610+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:20:59.155610+0000","last_peered":"2024-03-07T10:20:59.155610+0000","last_clean":"2024-03-07T10:20:59.155610+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:20:59.155610+0000","last_undegraded":"2024-03-07T10:20:59.155610+0000","last_fullsized":"2024-03-07T10:20:59.155610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126868+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:20:59.126868+0000","last_peered":"2024-03-07T10:20:59.126868+0000","last_clean":"2024-03-07T10:20:59.126868+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:20:59.126868+0000","last_undegraded":"2024-03-07T10:20:59.126868+0000","last_fullsized":"2024-03-07T10:20:59.126868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159818+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:20:59.159818+0000","last_peered":"2024-03-07T10:20:59.159818+0000","last_clean":"2024-03-07T10:20:59.159818+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:20:59.159818+0000","last_undegraded":"2024-03-07T10:20:59.159818+0000","last_fullsized":"2024-03-07T10:20:59.159818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128163+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:20:59.128163+0000","last_peered":"2024-03-07T10:20:59.128163+0000","last_clean":"2024-03-07T10:20:59.128163+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:20:59.128163+0000","last_undegraded":"2024-03-07T10:20:59.128163+0000","last_fullsized":"2024-03-07T10:20:59.128163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.159690+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:20:59.159690+0000","last_peered":"2024-03-07T10:20:59.159690+0000","last_clean":"2024-03-07T10:20:59.159690+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:20:59.159690+0000","last_undegraded":"2024-03-07T10:20:59.159690+0000","last_fullsized":"2024-03-07T10:20:59.159690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.129075+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:20:59.129075+0000","last_peered":"2024-03-07T10:20:59.129075+0000","last_clean":"2024-03-07T10:20:59.129075+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:20:59.129075+0000","last_undegraded":"2024-03-07T10:20:59.129075+0000","last_fullsized":"2024-03-07T10:20:59.129075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161057+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:20:59.161057+0000","last_peered":"2024-03-07T10:20:59.161057+0000","last_clean":"2024-03-07T10:20:59.161057+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:20:59.161057+0000","last_undegraded":"2024-03-07T10:20:59.161057+0000","last_fullsized":"2024-03-07T10:20:59.161057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154269+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:20:59.154269+0000","last_peered":"2024-03-07T10:20:59.154269+0000","last_clean":"2024-03-07T10:20:59.154269+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:20:59.154269+0000","last_undegraded":"2024-03-07T10:20:59.154269+0000","last_fullsized":"2024-03-07T10:20:59.154269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161902+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:20:59.161902+0000","last_peered":"2024-03-07T10:20:59.161902+0000","last_clean":"2024-03-07T10:20:59.161902+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:20:59.161902+0000","last_undegraded":"2024-03-07T10:20:59.161902+0000","last_fullsized":"2024-03-07T10:20:59.161902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128700+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:20:59.128700+0000","last_peered":"2024-03-07T10:20:59.128700+0000","last_clean":"2024-03-07T10:20:59.128700+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:20:59.128700+0000","last_undegraded":"2024-03-07T10:20:59.128700+0000","last_fullsized":"2024-03-07T10:20:59.128700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158328+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:20:59.158328+0000","last_peered":"2024-03-07T10:20:59.158328+0000","last_clean":"2024-03-07T10:20:59.158328+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:20:59.158328+0000","last_undegraded":"2024-03-07T10:20:59.158328+0000","last_fullsized":"2024-03-07T10:20:59.158328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160651+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:20:59.160651+0000","last_peered":"2024-03-07T10:20:59.160651+0000","last_clean":"2024-03-07T10:20:59.160651+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:20:59.160651+0000","last_undegraded":"2024-03-07T10:20:59.160651+0000","last_fullsized":"2024-03-07T10:20:59.160651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160618+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:20:59.160618+0000","last_peered":"2024-03-07T10:20:59.160618+0000","last_clean":"2024-03-07T10:20:59.160618+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:20:59.160618+0000","last_undegraded":"2024-03-07T10:20:59.160618+0000","last_fullsized":"2024-03-07T10:20:59.160618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127396+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:20:59.127396+0000","last_peered":"2024-03-07T10:20:59.127396+0000","last_clean":"2024-03-07T10:20:59.127396+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:20:59.127396+0000","last_undegraded":"2024-03-07T10:20:59.127396+0000","last_fullsized":"2024-03-07T10:20:59.127396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160346+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:20:59.160346+0000","last_peered":"2024-03-07T10:20:59.160346+0000","last_clean":"2024-03-07T10:20:59.160346+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:20:59.160346+0000","last_undegraded":"2024-03-07T10:20:59.160346+0000","last_fullsized":"2024-03-07T10:20:59.160346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155688+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:20:59.155688+0000","last_peered":"2024-03-07T10:20:59.155688+0000","last_clean":"2024-03-07T10:20:59.155688+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:20:59.155688+0000","last_undegraded":"2024-03-07T10:20:59.155688+0000","last_fullsized":"2024-03-07T10:20:59.155688+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128217+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:20:59.128217+0000","last_peered":"2024-03-07T10:20:59.128217+0000","last_clean":"2024-03-07T10:20:59.128217+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:20:59.128217+0000","last_undegraded":"2024-03-07T10:20:59.128217+0000","last_fullsized":"2024-03-07T10:20:59.128217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155001+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:20:59.155001+0000","last_peered":"2024-03-07T10:20:59.155001+0000","last_clean":"2024-03-07T10:20:59.155001+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:20:59.155001+0000","last_undegraded":"2024-03-07T10:20:59.155001+0000","last_fullsized":"2024-03-07T10:20:59.155001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161860+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:20:59.161860+0000","last_peered":"2024-03-07T10:20:59.161860+0000","last_clean":"2024-03-07T10:20:59.161860+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:20:59.161860+0000","last_undegraded":"2024-03-07T10:20:59.161860+0000","last_fullsized":"2024-03-07T10:20:59.161860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128125+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:20:59.128125+0000","last_peered":"2024-03-07T10:20:59.128125+0000","last_clean":"2024-03-07T10:20:59.128125+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:20:59.128125+0000","last_undegraded":"2024-03-07T10:20:59.128125+0000","last_fullsized":"2024-03-07T10:20:59.128125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154411+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:20:59.154411+0000","last_peered":"2024-03-07T10:20:59.154411+0000","last_clean":"2024-03-07T10:20:59.154411+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:20:59.154411+0000","last_undegraded":"2024-03-07T10:20:59.154411+0000","last_fullsized":"2024-03-07T10:20:59.154411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.162358+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:20:59.162358+0000","last_peered":"2024-03-07T10:20:59.162358+0000","last_clean":"2024-03-07T10:20:59.162358+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:20:59.162358+0000","last_undegraded":"2024-03-07T10:20:59.162358+0000","last_fullsized":"2024-03-07T10:20:59.162358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158957+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:20:59.158957+0000","last_peered":"2024-03-07T10:20:59.158957+0000","last_clean":"2024-03-07T10:20:59.158957+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:20:59.158957+0000","last_undegraded":"2024-03-07T10:20:59.158957+0000","last_fullsized":"2024-03-07T10:20:59.158957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154278+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:20:59.154278+0000","last_peered":"2024-03-07T10:20:59.154278+0000","last_clean":"2024-03-07T10:20:59.154278+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:20:59.154278+0000","last_undegraded":"2024-03-07T10:20:59.154278+0000","last_fullsized":"2024-03-07T10:20:59.154278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155431+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:20:59.155431+0000","last_peered":"2024-03-07T10:20:59.155431+0000","last_clean":"2024-03-07T10:20:59.155431+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:20:59.155431+0000","last_undegraded":"2024-03-07T10:20:59.155431+0000","last_fullsized":"2024-03-07T10:20:59.155431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.128112+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:20:59.128112+0000","last_peered":"2024-03-07T10:20:59.128112+0000","last_clean":"2024-03-07T10:20:59.128112+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:20:59.128112+0000","last_undegraded":"2024-03-07T10:20:59.128112+0000","last_fullsized":"2024-03-07T10:20:59.128112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156657+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:20:59.156657+0000","last_peered":"2024-03-07T10:20:59.156657+0000","last_clean":"2024-03-07T10:20:59.156657+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:20:59.156657+0000","last_undegraded":"2024-03-07T10:20:59.156657+0000","last_fullsized":"2024-03-07T10:20:59.156657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.155877+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:20:59.155877+0000","last_peered":"2024-03-07T10:20:59.155877+0000","last_clean":"2024-03-07T10:20:59.155877+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:20:59.155877+0000","last_undegraded":"2024-03-07T10:20:59.155877+0000","last_fullsized":"2024-03-07T10:20:59.155877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.160329+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:20:59.160329+0000","last_peered":"2024-03-07T10:20:59.160329+0000","last_clean":"2024-03-07T10:20:59.160329+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:20:59.160329+0000","last_undegraded":"2024-03-07T10:20:59.160329+0000","last_fullsized":"2024-03-07T10:20:59.160329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127175+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:20:59.127175+0000","last_peered":"2024-03-07T10:20:59.127175+0000","last_clean":"2024-03-07T10:20:59.127175+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:20:59.127175+0000","last_undegraded":"2024-03-07T10:20:59.127175+0000","last_fullsized":"2024-03-07T10:20:59.127175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154704+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:20:59.154704+0000","last_peered":"2024-03-07T10:20:59.154704+0000","last_clean":"2024-03-07T10:20:59.154704+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:20:59.154704+0000","last_undegraded":"2024-03-07T10:20:59.154704+0000","last_fullsized":"2024-03-07T10:20:59.154704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.126993+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:20:59.126993+0000","last_peered":"2024-03-07T10:20:59.126993+0000","last_clean":"2024-03-07T10:20:59.126993+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:20:59.126993+0000","last_undegraded":"2024-03-07T10:20:59.126993+0000","last_fullsized":"2024-03-07T10:20:59.126993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.154153+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:20:59.154153+0000","last_peered":"2024-03-07T10:20:59.154153+0000","last_clean":"2024-03-07T10:20:59.154153+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:20:59.154153+0000","last_undegraded":"2024-03-07T10:20:59.154153+0000","last_fullsized":"2024-03-07T10:20:59.154153+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127563+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:20:59.127563+0000","last_peered":"2024-03-07T10:20:59.127563+0000","last_clean":"2024-03-07T10:20:59.127563+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:20:59.127563+0000","last_undegraded":"2024-03-07T10:20:59.127563+0000","last_fullsized":"2024-03-07T10:20:59.127563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161004+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:20:59.161004+0000","last_peered":"2024-03-07T10:20:59.161004+0000","last_clean":"2024-03-07T10:20:59.161004+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:20:59.161004+0000","last_undegraded":"2024-03-07T10:20:59.161004+0000","last_fullsized":"2024-03-07T10:20:59.161004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157613+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:20:59.157613+0000","last_peered":"2024-03-07T10:20:59.157613+0000","last_clean":"2024-03-07T10:20:59.157613+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:20:59.157613+0000","last_undegraded":"2024-03-07T10:20:59.157613+0000","last_fullsized":"2024-03-07T10:20:59.157613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161920+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:20:59.161920+0000","last_peered":"2024-03-07T10:20:59.161920+0000","last_clean":"2024-03-07T10:20:59.161920+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:20:59.161920+0000","last_undegraded":"2024-03-07T10:20:59.161920+0000","last_fullsized":"2024-03-07T10:20:59.161920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.157312+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:20:59.157312+0000","last_peered":"2024-03-07T10:20:59.157312+0000","last_clean":"2024-03-07T10:20:59.157312+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:20:59.157312+0000","last_undegraded":"2024-03-07T10:20:59.157312+0000","last_fullsized":"2024-03-07T10:20:59.157312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.161708+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:20:59.161708+0000","last_peered":"2024-03-07T10:20:59.161708+0000","last_clean":"2024-03-07T10:20:59.161708+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:20:59.161708+0000","last_undegraded":"2024-03-07T10:20:59.161708+0000","last_fullsized":"2024-03-07T10:20:59.161708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.158438+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:20:59.158438+0000","last_peered":"2024-03-07T10:20:59.158438+0000","last_clean":"2024-03-07T10:20:59.158438+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:20:59.158438+0000","last_undegraded":"2024-03-07T10:20:59.158438+0000","last_fullsized":"2024-03-07T10:20:59.158438+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156277+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:20:59.156277+0000","last_peered":"2024-03-07T10:20:59.156277+0000","last_clean":"2024-03-07T10:20:59.156277+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:20:59.156277+0000","last_undegraded":"2024-03-07T10:20:59.156277+0000","last_fullsized":"2024-03-07T10:20:59.156277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127787+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:20:59.127787+0000","last_peered":"2024-03-07T10:20:59.127787+0000","last_clean":"2024-03-07T10:20:59.127787+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:20:59.127787+0000","last_undegraded":"2024-03-07T10:20:59.127787+0000","last_fullsized":"2024-03-07T10:20:59.127787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.127710+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:20:59.127710+0000","last_peered":"2024-03-07T10:20:59.127710+0000","last_clean":"2024-03-07T10:20:59.127710+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:20:59.127710+0000","last_undegraded":"2024-03-07T10:20:59.127710+0000","last_fullsized":"2024-03-07T10:20:59.127710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-07T10:20:59.156427+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:20:59.156427+0000","last_peered":"2024-03-07T10:20:59.156427+0000","last_clean":"2024-03-07T10:20:59.156427+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:20:59.156427+0000","last_undegraded":"2024-03-07T10:20:59.156427+0000","last_fullsized":"2024-03-07T10:20:59.156427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:04.100 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-07T10:21:04.100 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:04.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.346+0000 7fba96c00640 1 Processor -- start 2024-03-07T10:21:04.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.346+0000 7fba96c00640 1 -- start start 2024-03-07T10:21:04.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba96c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fba90154100 0x7fba90155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba96c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba901568e0 con 0x7fba900c19c0 2024-03-07T10:21:04.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba96c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba9006d6d0 con 0x7fba90148f40 2024-03-07T10:21:04.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba96c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba90073240 con 0x7fba90154100 2024-03-07T10:21:04.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba94c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fba900c19c0 0x7fba90156030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47464/0 (socket says 172.21.15.194:47464) 2024-03-07T10:21:04.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.347+0000 7fba94c00640 1 -- 172.21.15.194:0/3402983132 learned_addr learned my addr 172.21.15.194:0/3402983132 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:04.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba87400640 1 --2- 172.21.15.194:0/3402983132 >> v2:172.21.15.196:3300/0 conn(0x7fba90154100 0x7fba90155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119153439 0 0) 0x7fba901568e0 con 0x7fba900c19c0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba74005730 con 0x7fba900c19c0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039175564 0 0) 0x7fba74005730 con 0x7fba900c19c0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 >> v2:172.21.15.196:3300/0 conn(0x7fba90154100 msgr2=0x7fba90155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 --2- 172.21.15.194:0/3402983132 >> v2:172.21.15.196:3300/0 conn(0x7fba90154100 0x7fba90155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 >> v1:172.21.15.196:6789/0 conn(0x7fba90148f40 legacy=0x7fba901539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9006d9b0 con 0x7fba900c19c0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fba880019f0 con 0x7fba900c19c0 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 >> v1:172.21.15.194:6789/0 conn(0x7fba900c19c0 legacy=0x7fba90156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74005c10 0x7fba74006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba74006a10 0x7fba74006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 0x7fba7400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90073240 con 0x7fba74007420 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7400e370 con 0x7fba74005c10 2024-03-07T10:21:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.348+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7400e570 con 0x7fba74006a10 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 0x7fba7400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba8fe00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74005c10 0x7fba74006030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba87400640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba74006a10 0x7fba74006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 -- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba74006a10 msgr2=0x7fba74006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba74006a10 0x7fba74006e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 -- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74005c10 msgr2=0x7fba74006030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74005c10 0x7fba74006030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.349+0000 7fba94c00640 1 -- 172.21.15.194:0/3402983132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74005730 con 0x7fba74007420 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.350+0000 7fba94c00640 1 -- 172.21.15.194:0/3402983132 reap_dead start 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.350+0000 7fba94c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 0x7fba7400dbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba8800a760 tx=0x7fba74007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284da37061147ca9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.350+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8800a3b0 con 0x7fba74007420 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.350+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba88034630 con 0x7fba74007420 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.350+0000 7fba8f400640 1 -- 172.21.15.194:0/3402983132 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88034a20 con 0x7fba74007420 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 -- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 msgr2=0x7fba7400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 0x7fba7400dbd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fba8800a760 tx=0x7fba74007a40 comp rx=0 tx=0).stop 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 -- 172.21.15.194:0/3402983132 shutdown_connections 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 --2- 172.21.15.194:0/3402983132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba74007420 0x7fba7400dbd0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 -- 172.21.15.194:0/3402983132 >> 172.21.15.194:0/3402983132 conn(0x7fba9006b840 msgr2=0x7fba900c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 -- 172.21.15.194:0/3402983132 shutdown_connections 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.351+0000 7fba96c00640 1 -- 172.21.15.194:0/3402983132 wait complete. 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.353+0000 7fba96c00640 1 Processor -- start 2024-03-07T10:21:04.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.353+0000 7fba96c00640 1 -- start start 2024-03-07T10:21:04.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74007420 0x7fba90151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 0x7fba900c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba90149320 con 0x7fba90155ff0 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9006e000 con 0x7fba74007420 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba96c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9006e490 con 0x7fba90152320 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37168/0 (socket says 172.21.15.194:37168) 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 -- 172.21.15.194:0/4105600489 learned_addr learned my addr 172.21.15.194:0/4105600489 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba8fe00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74007420 0x7fba90151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba94c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 0x7fba900c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 -- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 msgr2=0x7fba900c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 0x7fba900c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 -- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74007420 msgr2=0x7fba90151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74007420 0x7fba90151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba87400640 1 -- 172.21.15.194:0/4105600489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90145ed0 con 0x7fba90155ff0 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.354+0000 7fba94c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 0x7fba900c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:04.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba87400640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba780108c0 tx=0x7fba78010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7800f040 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7800eb00 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7801c400 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba900c6c30 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.355+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba901eaba0 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.356+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba900c1360 con 0x7fba90155ff0 2024-03-07T10:21:04.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.357+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fba7801c5a0 con 0x7fba90155ff0 2024-03-07T10:21:04.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.358+0000 7fba8cc00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 0x7fba6c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.358+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fba7808a840 con 0x7fba90155ff0 2024-03-07T10:21:04.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.358+0000 7fba8fe00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 0x7fba6c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.359+0000 7fba8fe00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 0x7fba6c06d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba80005410 tx=0x7fba80009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.362+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fba900c1360 con 0x7fba90155ff0 2024-03-07T10:21:04.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.557+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba90068170 con 0x7fba90155ff0 2024-03-07T10:21:04.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.559+0000 7fba8cc00640 1 -- 172.21.15.194:0/4105600489 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16633 (secure 0 0 0) 0x7fba78018030 con 0x7fba90155ff0 2024-03-07T10:21:04.562 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:04.562 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:20:59.117060+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 msgr2=0x7fba6c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 0x7fba6c06d990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fba80005410 tx=0x7fba80009040 comp rx=0 tx=0).stop 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 msgr2=0x7fba901e7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fba780108c0 tx=0x7fba78010d80 comp rx=0 tx=0).stop 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 shutdown_connections 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fba6c06b4d0 0x7fba6c06d990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fba90152320 0x7fba900c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba90155ff0 0x7fba901e7520 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 --2- 172.21.15.194:0/4105600489 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fba74007420 0x7fba90151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 >> 172.21.15.194:0/4105600489 conn(0x7fba9006b840 msgr2=0x7fba90146760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:04.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 shutdown_connections 2024-03-07T10:21:04.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.562+0000 7fba96c00640 1 -- 172.21.15.194:0/4105600489 wait complete. 2024-03-07T10:21:04.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:04.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:04.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.787+0000 7f2572a00640 1 Processor -- start 2024-03-07T10:21:04.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.787+0000 7f2572a00640 1 -- start start 2024-03-07T10:21:04.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f256c0a5f50 0x7f256c156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f256c0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c0c3160 con 0x7f256c153280 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0c33d0 con 0x7f256c0a5f50 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0c36b0 con 0x7f256c0c1400 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2571600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f256c153280 0x7f256c0a8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47468/0 (socket says 172.21.15.194:47468) 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2571600640 1 -- 172.21.15.194:0/1147765794 learned_addr learned my addr 172.21.15.194:0/1147765794 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2572000640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f256c0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f2570c00640 1 --2- 172.21.15.194:0/1147765794 >> v2:172.21.15.196:3300/0 conn(0x7f256c0a5f50 0x7f256c156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844381916 0 0) 0x7f256c0c3160 con 0x7f256c153280 2024-03-07T10:21:04.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.789+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2554003520 con 0x7f256c153280 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2359911244 0 0) 0x7f2554003520 con 0x7f256c153280 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 msgr2=0x7f256c0c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f256c0c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 >> v2:172.21.15.196:3300/0 conn(0x7f256c0a5f50 msgr2=0x7f256c156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 --2- 172.21.15.194:0/1147765794 >> v2:172.21.15.196:3300/0 conn(0x7f256c0a5f50 0x7f256c156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0c3990 con 0x7f256c153280 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f2560001670 con 0x7f256c153280 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 >> v1:172.21.15.194:6789/0 conn(0x7f256c153280 legacy=0x7f256c0a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25540039b0 0x7f2554003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f2554004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f25540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0c33d0 con 0x7f2554004d40 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0c36b0 con 0x7f25540039b0 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255400dc50 con 0x7f256c0c1400 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f2572000640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f25540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f2570c00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f2554004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f2572000640 1 -- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 msgr2=0x7f2554004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.790+0000 7f2572000640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f2554004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.791+0000 7f2572000640 1 -- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25540039b0 msgr2=0x7f2554003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:04.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.791+0000 7f2572000640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25540039b0 0x7f2554003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.791+0000 7f2572000640 1 -- 172.21.15.194:0/1147765794 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554003520 con 0x7f2554004d40 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.791+0000 7f2570c00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c0c1400 0x7f2554004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f2572000640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f25540051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2564009fc0 tx=0x7f2554005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780dab2f328e8d9f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564039070 con 0x7f2554004d40 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256402cbf0 con 0x7f2554004d40 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f256be00640 1 -- 172.21.15.194:0/1147765794 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2564009c10 con 0x7f2554004d40 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f2572a00640 1 -- 172.21.15.194:0/1147765794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 msgr2=0x7f25540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f2572a00640 1 --2- 172.21.15.194:0/1147765794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f25540051c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2564009fc0 tx=0x7f2554005830 comp rx=0 tx=0).stop 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.792+0000 7f2572000640 1 -- 172.21.15.194:0/1147765794 reap_dead start 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.793+0000 7f2572a00640 1 -- 172.21.15.194:0/1147765794 shutdown_connections 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.793+0000 7f2572a00640 1 -- 172.21.15.194:0/1147765794 >> 172.21.15.194:0/1147765794 conn(0x7f256c06cd60 msgr2=0x7f256c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.793+0000 7f2572a00640 1 -- 172.21.15.194:0/1147765794 shutdown_connections 2024-03-07T10:21:04.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.793+0000 7f2572a00640 1 -- 172.21.15.194:0/1147765794 wait complete. 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.794+0000 7f2572a00640 1 Processor -- start 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.794+0000 7f2572a00640 1 -- start start 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f256c1e7800 0x7f256c072de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c073320 0x7f256c071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c153660 con 0x7f2554004d40 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0c3f50 con 0x7f256c1e7800 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2572a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c0a8d30 con 0x7f256c073320 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2571600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2571600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37192/0 (socket says 172.21.15.194:37192) 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.795+0000 7f2571600640 1 -- 172.21.15.194:0/2294795646 learned_addr learned my addr 172.21.15.194:0/2294795646 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2570c00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f256c1e7800 0x7f256c072de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 -- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c073320 msgr2=0x7f256c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c073320 0x7f256c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 -- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f256c1e7800 msgr2=0x7f256c072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f256c1e7800 0x7f256c072de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 -- 172.21.15.194:0/2294795646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c14d6e0 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2571600640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f256000c760 tx=0x7f256000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560018070 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25600074e0 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c0707a0 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560004a20 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.796+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c070d60 con 0x7f2554004d40 2024-03-07T10:21:04.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.797+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c075600 con 0x7f2554004d40 2024-03-07T10:21:04.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.798+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f256001b070 con 0x7f2554004d40 2024-03-07T10:21:04.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.799+0000 7f2569600640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 0x7f254c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:04.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.799+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f2560089600 con 0x7f2554004d40 2024-03-07T10:21:04.802 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.800+0000 7f2570c00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 0x7f254c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:04.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.801+0000 7f2570c00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 0x7f254c06d9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f256c06e4c0 tx=0x7f2558008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:04.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:04.804+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2560058480 con 0x7f2554004d40 2024-03-07T10:21:05.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.000+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f256c0a5b20 con 0x7f2554004d40 2024-03-07T10:21:05.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.001+0000 7f2569600640 1 -- 172.21.15.194:0/2294795646 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2560057d80 con 0x7f2554004d40 2024-03-07T10:21:05.004 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:05.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 msgr2=0x7f254c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 0x7f254c06d9c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f256c06e4c0 tx=0x7f2558008040 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 msgr2=0x7f256c14c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f256000c760 tx=0x7f256000cc20 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 shutdown_connections 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f254c06b500 0x7f254c06d9c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f256c073320 0x7f256c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f256c1e7800 0x7f256c072de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 --2- 172.21.15.194:0/2294795646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2554004d40 0x7f256c14c6d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 >> 172.21.15.194:0/2294795646 conn(0x7f256c06cd60 msgr2=0x7f256c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:05.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 shutdown_connections 2024-03-07T10:21:05.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.004+0000 7f2572a00640 1 -- 172.21.15.194:0/2294795646 wait complete. 2024-03-07T10:21:05.024 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:05.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.228+0000 7fa649200640 1 Processor -- start 2024-03-07T10:21:05.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.228+0000 7fa649200640 1 -- start start 2024-03-07T10:21:05.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.229+0000 7fa649200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa644155cc0 0x7fa6441560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa649200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa644072f90 0x7fa644153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa649200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440c7cb0 con 0x7fa64406e360 2024-03-07T10:21:05.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa649200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64406d630 con 0x7fa644155cc0 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa649200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa64406d880 con 0x7fa644072f90 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa644155cc0 0x7fa6441560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa642800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa64406e360 0x7fa644148ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47476/0 (socket says 172.21.15.194:47476) 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa642800640 1 -- 172.21.15.194:0/3861211954 learned_addr learned my addr 172.21.15.194:0/3861211954 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641400640 1 --2- 172.21.15.194:0/3861211954 >> v2:172.21.15.196:3300/0 conn(0x7fa644072f90 0x7fa644153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa640a00640 1 -- 172.21.15.194:0/3861211954 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266825479 0 0) 0x7fa6440c7cb0 con 0x7fa64406e360 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641e00640 1 -- 172.21.15.194:0/3861211954 >> v2:172.21.15.196:3300/0 conn(0x7fa644072f90 msgr2=0x7fa644153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641e00640 1 --2- 172.21.15.194:0/3861211954 >> v2:172.21.15.196:3300/0 conn(0x7fa644072f90 0x7fa644153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641e00640 1 -- 172.21.15.194:0/3861211954 >> v1:172.21.15.194:6789/0 conn(0x7fa64406e360 legacy=0x7fa644148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.230+0000 7fa641e00640 1 -- 172.21.15.194:0/3861211954 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa64406db60 con 0x7fa644155cc0 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa641e00640 1 --2- 172.21.15.194:0/3861211954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644155cc0 0x7fa6441560a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa64406bfe0 tx=0x7fa63402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a85f9dad995f939 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa640a00640 1 -- 172.21.15.194:0/3861211954 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6340315a0 con 0x7fa644155cc0 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa640a00640 1 -- 172.21.15.194:0/3861211954 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa634037070 con 0x7fa644155cc0 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa640a00640 1 -- 172.21.15.194:0/3861211954 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634031960 con 0x7fa644155cc0 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa649200640 1 -- 172.21.15.194:0/3861211954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644155cc0 msgr2=0x7fa6441560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.232+0000 7fa649200640 1 --2- 172.21.15.194:0/3861211954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644155cc0 0x7fa6441560a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa64406bfe0 tx=0x7fa63402b840 comp rx=0 tx=0).stop 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 -- 172.21.15.194:0/3861211954 shutdown_connections 2024-03-07T10:21:05.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 --2- 172.21.15.194:0/3861211954 >> v2:172.21.15.196:3300/0 conn(0x7fa644072f90 0x7fa644153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 --2- 172.21.15.194:0/3861211954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644155cc0 0x7fa6441560a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 -- 172.21.15.194:0/3861211954 >> 172.21.15.194:0/3861211954 conn(0x7fa64406b860 msgr2=0x7fa6440c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:05.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 -- 172.21.15.194:0/3861211954 shutdown_connections 2024-03-07T10:21:05.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.233+0000 7fa649200640 1 -- 172.21.15.194:0/3861211954 wait complete. 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.234+0000 7fa649200640 1 Processor -- start 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.234+0000 7fa649200640 1 -- start start 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 0x7fa6441dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 0x7fa644152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c7a90 con 0x7fa644151ec0 2024-03-07T10:21:05.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c7910 con 0x7fa64406e360 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.235+0000 7fa649200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6441565e0 con 0x7fa644155cc0 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37196/0 (socket says 172.21.15.194:37196) 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 -- 172.21.15.194:0/496936271 learned_addr learned my addr 172.21.15.194:0/496936271 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa641400640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 0x7fa644152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa641e00640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 0x7fa6441dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 -- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 msgr2=0x7fa644152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 0x7fa644152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 -- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 msgr2=0x7fa6441dff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 0x7fa6441dff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 -- 172.21.15.194:0/496936271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6441513f0 con 0x7fa644151ec0 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa641400640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 0x7fa644152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa641e00640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 0x7fa6441dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:05.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa642800640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c780 tx=0x7fa63c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.236+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c018070 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.237+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c00a640 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.237+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c00aa70 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.237+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6441516d0 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.237+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6441e0460 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.238+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa644068170 con 0x7fa644151ec0 2024-03-07T10:21:05.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.239+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa63c00ac10 con 0x7fa644151ec0 2024-03-07T10:21:05.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.240+0000 7fa63a000640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 0x7fa62406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.240+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fa63c0897c0 con 0x7fa644151ec0 2024-03-07T10:21:05.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.240+0000 7fa641e00640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 0x7fa62406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.241+0000 7fa641e00640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 0x7fa62406d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa634036000 tx=0x7fa634008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.244+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa63c0586e0 con 0x7fa644151ec0 2024-03-07T10:21:05.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.441+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6440c35f0 con 0x7fa644151ec0 2024-03-07T10:21:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.441+0000 7fa63a000640 1 -- 172.21.15.194:0/496936271 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v20) v1 ==== 99+0+11 (secure 0 0 0) 0x7fa63c057fe0 con 0x7fa644151ec0 2024-03-07T10:21:05.444 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 msgr2=0x7fa62406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 0x7fa62406d990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa634036000 tx=0x7fa634008030 comp rx=0 tx=0).stop 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 msgr2=0x7fa644152e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa63c00c780 tx=0x7fa63c00cc40 comp rx=0 tx=0).stop 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 shutdown_connections 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa62406b4d0 0x7fa62406d990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa644151ec0 0x7fa644152e80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa644155cc0 0x7fa644152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 --2- 172.21.15.194:0/496936271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa64406e360 0x7fa6441dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 >> 172.21.15.194:0/496936271 conn(0x7fa64406b860 msgr2=0x7fa6440c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:05.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 shutdown_connections 2024-03-07T10:21:05.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.444+0000 7fa649200640 1 -- 172.21.15.194:0/496936271 wait complete. 2024-03-07T10:21:05.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:05.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.670+0000 7fbd7ca00640 1 Processor -- start 2024-03-07T10:21:05.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.670+0000 7fbd7ca00640 1 -- start start 2024-03-07T10:21:05.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.671+0000 7fbd7ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd780a5d30 0x7fbd78156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.671+0000 7fbd7ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd781574f0 0x7fbd7815ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.671+0000 7fbd7ca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd78157930 con 0x7fbd78150aa0 2024-03-07T10:21:05.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd7ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd780c3a70 con 0x7fbd780a5d30 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd7ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780c3d50 con 0x7fbd781574f0 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd780a5d30 0x7fbd78156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd780a5d30 0x7fbd78156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37200/0 (socket says 172.21.15.194:37200) 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 -- 172.21.15.194:0/2492500736 learned_addr learned my addr 172.21.15.194:0/2492500736 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd77e00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd781574f0 0x7fbd7815ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 -- 172.21.15.194:0/2492500736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd781574f0 msgr2=0x7fbd7815ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:05.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd781574f0 0x7fbd7815ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 -- 172.21.15.194:0/2492500736 >> v1:172.21.15.194:6789/0 conn(0x7fbd78150aa0 legacy=0x7fbd780a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.672+0000 7fbd76a00640 1 -- 172.21.15.194:0/2492500736 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd780c4030 con 0x7fbd780a5d30 2024-03-07T10:21:05.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.673+0000 7fbd76a00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd780a5d30 0x7fbd78156fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009870 tx=0x7fbd6402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941df1d7a36b9244 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd76000640 1 -- 172.21.15.194:0/2492500736 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64035020 con 0x7fbd780a5d30 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd76000640 1 -- 172.21.15.194:0/2492500736 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6402d040 con 0x7fbd780a5d30 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd76000640 1 -- 172.21.15.194:0/2492500736 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64031a80 con 0x7fbd780a5d30 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2492500736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd780a5d30 msgr2=0x7fbd78156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd780a5d30 0x7fbd78156fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd64009870 tx=0x7fbd6402b900 comp rx=0 tx=0).stop 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2492500736 shutdown_connections 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd781574f0 0x7fbd7815ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2492500736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd780a5d30 0x7fbd78156fb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2492500736 >> 172.21.15.194:0/2492500736 conn(0x7fbd7806cd60 msgr2=0x7fbd7806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.674+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2492500736 shutdown_connections 2024-03-07T10:21:05.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.675+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2492500736 wait complete. 2024-03-07T10:21:05.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.676+0000 7fbd7ca00640 1 Processor -- start 2024-03-07T10:21:05.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.676+0000 7fbd7ca00640 1 -- start start 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 0x7fbd781436f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd781574f0 0x7fbd780722b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780a61c0 con 0x7fbd78150aa0 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78156a90 con 0x7fbd781574f0 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd7ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78150e80 con 0x7fbd780a5d30 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd76a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd76a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37210/0 (socket says 172.21.15.194:37210) 2024-03-07T10:21:05.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.677+0000 7fbd76a00640 1 -- 172.21.15.194:0/2926070221 learned_addr learned my addr 172.21.15.194:0/2926070221 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd77400640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 0x7fbd781436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 -- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 msgr2=0x7fbd781436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 0x7fbd781436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 -- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd781574f0 msgr2=0x7fbd780722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd781574f0 0x7fbd780722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 -- 172.21.15.194:0/2926070221 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78073580 con 0x7fbd78150aa0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd77400640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 0x7fbd781436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd76a00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64040070 con 0x7fbd78150aa0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64039bf0 con 0x7fbd78150aa0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd780707a0 con 0x7fbd78150aa0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64035040 con 0x7fbd78150aa0 2024-03-07T10:21:05.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.678+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd781e9ac0 con 0x7fbd78150aa0 2024-03-07T10:21:05.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.680+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd78075600 con 0x7fbd78150aa0 2024-03-07T10:21:05.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.680+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbd6404b060 con 0x7fbd78150aa0 2024-03-07T10:21:05.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.682+0000 7fbd6f400640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:05.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.682+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7fbd640abc50 con 0x7fbd78150aa0 2024-03-07T10:21:05.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.682+0000 7fbd77400640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:05.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.683+0000 7fbd77400640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000f60 tx=0x7fbd68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:05.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.686+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd640b1020 con 0x7fbd78150aa0 2024-03-07T10:21:05.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.883+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fbd780a95a0 con 0x7fbd78150aa0 2024-03-07T10:21:05.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.883+0000 7fbd6f400640 1 -- 172.21.15.194:0/2926070221 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v20) v1 ==== 95+0+11 (secure 0 0 0) 0x7fbd6407ab70 con 0x7fbd78150aa0 2024-03-07T10:21:05.887 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 msgr2=0x7fbd5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd68000f60 tx=0x7fbd68009040 comp rx=0 tx=0).stop 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 msgr2=0x7fbd78143c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd64000c00 tx=0x7fbd640046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 shutdown_connections 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd781574f0 0x7fbd780722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150aa0 0x7fbd78143c30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 --2- 172.21.15.194:0/2926070221 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd780a5d30 0x7fbd781436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:05.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 >> 172.21.15.194:0/2926070221 conn(0x7fbd7806cd60 msgr2=0x7fbd780a64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:05.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 shutdown_connections 2024-03-07T10:21:05.890 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:05.886+0000 7fbd7ca00640 1 -- 172.21.15.194:0/2926070221 wait complete. 2024-03-07T10:21:05.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-07T10:21:06.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.115+0000 7f792e800640 1 Processor -- start 2024-03-07T10:21:06.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.116+0000 7f792e800640 1 -- start start 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79280a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792e800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7928152f20 0x7f79280c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792e800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79280c1de0 con 0x7f792806e930 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792e800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79280a6310 con 0x7f7928152f20 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7928152440 con 0x7f79280733a0 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792d400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f792806e930 0x7f79280c16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47484/0 (socket says 172.21.15.194:47484) 2024-03-07T10:21:06.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792d400640 1 -- 172.21.15.194:0/3402068042 learned_addr learned my addr 172.21.15.194:0/3402068042 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792de00640 1 --2- 172.21.15.194:0/3402068042 >> v2:172.21.15.196:3300/0 conn(0x7f7928152f20 0x7f79280c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.117+0000 7f792ca00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79280a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834415283 0 0) 0x7f79280c1de0 con 0x7f792806e930 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7910003520 con 0x7f792806e930 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2542477255 0 0) 0x7f7910003520 con 0x7f792806e930 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 msgr2=0x7f79280a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79280a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 >> v2:172.21.15.196:3300/0 conn(0x7f7928152f20 msgr2=0x7f79280c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 --2- 172.21.15.194:0/3402068042 >> v2:172.21.15.196:3300/0 conn(0x7f7928152f20 0x7f79280c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928152720 con 0x7f792806e930 2024-03-07T10:21:06.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f791c001670 con 0x7f792806e930 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 >> v1:172.21.15.194:6789/0 conn(0x7f792806e930 legacy=0x7f79280c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79100039b0 0x7f7910003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7910004800 0x7f7910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280a6310 con 0x7f79100039b0 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7928152440 con 0x7f7910004800 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f791000ba10 con 0x7f79280733a0 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.118+0000 7f792d400640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79100039b0 0x7f7910003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792d400640 1 -- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 msgr2=0x7f79100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:06.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792de00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792ca00640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7910004800 0x7f7910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792d400640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280733a0 0x7f79100051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792d400640 1 -- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7910004800 msgr2=0x7f7910004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:06.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792d400640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7910004800 0x7f7910004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.119+0000 7f792d400640 1 -- 172.21.15.194:0/3402068042 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910003520 con 0x7f79100039b0 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.120+0000 7f792d400640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79100039b0 0x7f7910003dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c1c0 tx=0x7f7910005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0ddfb2c17cb620 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.120+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c007c60 con 0x7f79100039b0 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.120+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f791c030070 con 0x7f79100039b0 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.120+0000 7f7927e00640 1 -- 172.21.15.194:0/3402068042 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c005d30 con 0x7f79100039b0 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 -- 172.21.15.194:0/3402068042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79100039b0 msgr2=0x7f7910003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 --2- 172.21.15.194:0/3402068042 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79100039b0 0x7f7910003dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f791c00c1c0 tx=0x7f7910005830 comp rx=0 tx=0).stop 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792de00640 1 -- 172.21.15.194:0/3402068042 reap_dead start 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 -- 172.21.15.194:0/3402068042 shutdown_connections 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 -- 172.21.15.194:0/3402068042 >> 172.21.15.194:0/3402068042 conn(0x7f79280c70f0 msgr2=0x7f79280c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:06.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 -- 172.21.15.194:0/3402068042 shutdown_connections 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.121+0000 7f792e800640 1 -- 172.21.15.194:0/3402068042 wait complete. 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.122+0000 7f792e800640 1 Processor -- start 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.123+0000 7f792e800640 1 -- start start 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.123+0000 7f792e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79100039b0 0x7f79281546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.123+0000 7f792e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280a8330 0x7f7928145000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.123+0000 7f792e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79280a65f0 con 0x7f79281eb440 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792806ed10 con 0x7f79100039b0 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79280c12e0 con 0x7f79280a8330 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37228/0 (socket says 172.21.15.194:37228) 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 -- 172.21.15.194:0/4257202823 learned_addr learned my addr 172.21.15.194:0/4257202823 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792ca00640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280a8330 0x7f7928145000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792d400640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79100039b0 0x7f79281546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 -- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280a8330 msgr2=0x7f7928145000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280a8330 0x7f7928145000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 -- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79100039b0 msgr2=0x7f79281546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79100039b0 0x7f79281546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.124+0000 7f792de00640 1 -- 172.21.15.194:0/4257202823 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928154d80 con 0x7f79281eb440 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f792de00640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79280c27d0 tx=0x7f7920010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000f040 con 0x7f79281eb440 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792000e8c0 con 0x7f79281eb440 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792000ecb0 con 0x7f79281eb440 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79281eebc0 con 0x7f79281eb440 2024-03-07T10:21:06.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.125+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79281ef180 con 0x7f79281eb440 2024-03-07T10:21:06.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.126+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79281ef380 con 0x7f79281eb440 2024-03-07T10:21:06.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.127+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f79200143f0 con 0x7f79281eb440 2024-03-07T10:21:06.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.128+0000 7f7925600640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 0x7f790c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.128+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f7920089eb0 con 0x7f79281eb440 2024-03-07T10:21:06.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.129+0000 7f792d400640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 0x7f790c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.130+0000 7f792d400640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 0x7f790c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f791c034000 tx=0x7f791c007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.133+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f79281ef380 con 0x7f79281eb440 2024-03-07T10:21:06.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.333+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f79281ee9b0 con 0x7f79281eb440 2024-03-07T10:21:06.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.334+0000 7f7925600640 1 -- 172.21.15.194:0/4257202823 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+197 (secure 0 0 0) 0x7f7920023070 con 0x7f79281eb440 2024-03-07T10:21:06.336 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:06.336 INFO:teuthology.orchestra.run.smithi194.stdout:[ 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolnum": 1, 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolname": ".mgr" 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolnum": 2, 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolname": "a_metadata" 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: }, 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: { 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolnum": 3, 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: "poolname": "a_data" 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout: } 2024-03-07T10:21:06.337 INFO:teuthology.orchestra.run.smithi194.stdout:] 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 msgr2=0x7f790c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 0x7f790c06d990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f791c034000 tx=0x7f791c007000 comp rx=0 tx=0).stop 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 msgr2=0x7f79281eb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f79280c27d0 tx=0x7f7920010c20 comp rx=0 tx=0).stop 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 shutdown_connections 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f790c06b4d0 0x7f790c06d990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f79281eb440 0x7f79281eb8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f79280a8330 0x7f7928145000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 --2- 172.21.15.194:0/4257202823 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f79100039b0 0x7f79281546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 >> 172.21.15.194:0/4257202823 conn(0x7f79280c70f0 msgr2=0x7f7928148710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:06.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 shutdown_connections 2024-03-07T10:21:06.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.336+0000 7f792e800640 1 -- 172.21.15.194:0/4257202823 wait complete. 2024-03-07T10:21:06.357 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-03-07T10:21:06.357 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-03-07T10:21:06.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.558+0000 7f4e54200640 1 Processor -- start 2024-03-07T10:21:06.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.558+0000 7f4e54200640 1 -- start start 2024-03-07T10:21:06.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e54200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 0x7f4e4c0c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e54200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e4c158d00 0x7f4e4c1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e54200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e4c155820 con 0x7f4e4c14f6b0 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e54200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e4c155b00 con 0x7f4e4c158d00 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e54200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c155de0 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e52200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e4c158d00 0x7f4e4c1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e51800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4e4c14f6b0 0x7f4e4c0c2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47496/0 (socket says 172.21.15.194:47496) 2024-03-07T10:21:06.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e51800640 1 -- 172.21.15.194:0/44385901 learned_addr learned my addr 172.21.15.194:0/44385901 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:06.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.560+0000 7f4e50e00640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 0x7f4e4c0c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.561+0000 7f4e52200640 1 -- 172.21.15.194:0/44385901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 msgr2=0x7f4e4c0c08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.561+0000 7f4e52200640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 0x7f4e4c0c08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.561+0000 7f4e52200640 1 -- 172.21.15.194:0/44385901 >> v1:172.21.15.194:6789/0 conn(0x7f4e4c14f6b0 legacy=0x7f4e4c0c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.561+0000 7f4e52200640 1 -- 172.21.15.194:0/44385901 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c1560c0 con 0x7f4e4c158d00 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.561+0000 7f4e50e00640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 0x7f4e4c0c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.562+0000 7f4e52200640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c158d00 0x7f4e4c1591b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009d90 tx=0x7f4e4402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655f46b50eec3dc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.562+0000 7f4e4be00640 1 -- 172.21.15.194:0/44385901 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44039070 con 0x7f4e4c158d00 2024-03-07T10:21:06.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.562+0000 7f4e4be00640 1 -- 172.21.15.194:0/44385901 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4402cbd0 con 0x7f4e4c158d00 2024-03-07T10:21:06.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.562+0000 7f4e4be00640 1 -- 172.21.15.194:0/44385901 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e44034440 con 0x7f4e4c158d00 2024-03-07T10:21:06.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 -- 172.21.15.194:0/44385901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c158d00 msgr2=0x7f4e4c1591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c158d00 0x7f4e4c1591b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4e44009d90 tx=0x7f4e4402be20 comp rx=0 tx=0).stop 2024-03-07T10:21:06.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 -- 172.21.15.194:0/44385901 shutdown_connections 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c158d00 0x7f4e4c1591b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 --2- 172.21.15.194:0/44385901 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c0c03f0 0x7f4e4c0c08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 -- 172.21.15.194:0/44385901 >> 172.21.15.194:0/44385901 conn(0x7f4e4c0c6fc0 msgr2=0x7f4e4c0c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 -- 172.21.15.194:0/44385901 shutdown_connections 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.563+0000 7f4e54200640 1 -- 172.21.15.194:0/44385901 wait complete. 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.565+0000 7f4e54200640 1 Processor -- start 2024-03-07T10:21:06.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.565+0000 7f4e54200640 1 -- start start 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e4c14f6b0 0x7f4e4c0c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c158d00 0x7f4e4c1eead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c14fc10 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c14fa90 con 0x7f4e4c14f6b0 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e54200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c06e5e0 con 0x7f4e4c158d00 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e51800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e51800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37234/0 (socket says 172.21.15.194:37234) 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.566+0000 7f4e51800640 1 -- 172.21.15.194:0/2583750666 learned_addr learned my addr 172.21.15.194:0/2583750666 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e52200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c158d00 0x7f4e4c1eead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 -- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c158d00 msgr2=0x7f4e4c1eead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c158d00 0x7f4e4c1eead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e50e00640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e4c14f6b0 0x7f4e4c0c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 -- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e4c14f6b0 msgr2=0x7f4e4c0c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e4c14f6b0 0x7f4e4c0c1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 -- 172.21.15.194:0/2583750666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c146890 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e51800640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c3f0 tx=0x7f4e3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c017070 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3c005ce0 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3c0072f0 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.567+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c14a600 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.568+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c0c2070 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.569+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c159c70 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.569+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4e3c01a070 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.571+0000 7f4e49600640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 0x7f4e2c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:06.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.571+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5689+0+0 (secure 0 0 0) 0x7f4e3c0896c0 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.571+0000 7f4e50e00640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 0x7f4e2c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:06.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.572+0000 7f4e50e00640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 0x7f4e2c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0c23e0 tx=0x7f4e38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:06.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.576+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4e4c159c70 con 0x7f4e4c0c03f0 2024-03-07T10:21:06.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:06.755+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4e4c0c2c70 con 0x7f4e4c0c03f0 2024-03-07T10:21:07.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.239+0000 7f4e49600640 1 -- 172.21.15.194:0/2583750666 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v21) v1 ==== 128+0+0 (secure 0 0 0) 0x7f4e3c058420 con 0x7f4e4c0c03f0 2024-03-07T10:21:07.242 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'b_metadata' created 2024-03-07T10:21:07.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 msgr2=0x7f4e2c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 0x7f4e2c06d990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c0c23e0 tx=0x7f4e38008040 comp rx=0 tx=0).stop 2024-03-07T10:21:07.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 msgr2=0x7f4e4c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c00c3f0 tx=0x7f4e3c00c8b0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 shutdown_connections 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e2c06b4d0 0x7f4e2c06d990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e4c158d00 0x7f4e4c1eead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e4c14f6b0 0x7f4e4c0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 --2- 172.21.15.194:0/2583750666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e4c0c03f0 0x7f4e4c146b70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 >> 172.21.15.194:0/2583750666 conn(0x7f4e4c0c6fc0 msgr2=0x7f4e4c147900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 shutdown_connections 2024-03-07T10:21:07.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.243+0000 7f4e54200640 1 -- 172.21.15.194:0/2583750666 wait complete. 2024-03-07T10:21:07.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-07T10:21:07.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.456+0000 7fcd63400640 1 Processor -- start 2024-03-07T10:21:07.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.456+0000 7fcd63400640 1 -- start start 2024-03-07T10:21:07.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.457+0000 7fcd63400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd5c06e820 0x7fcd5c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd63400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 0x7fcd5c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd63400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0aba50 con 0x7fcd5c14d6e0 2024-03-07T10:21:07.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd63400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c06daf0 con 0x7fcd5c06e820 2024-03-07T10:21:07.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd63400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c06eca0 con 0x7fcd5c0a9a10 2024-03-07T10:21:07.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd5c06e820 0x7fcd5c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd60a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fcd5c14d6e0 0x7fcd5c0ab340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47508/0 (socket says 172.21.15.194:47508) 2024-03-07T10:21:07.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd60a00640 1 -- 172.21.15.194:0/3414527221 learned_addr learned my addr 172.21.15.194:0/3414527221 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:07.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd61400640 1 --2- 172.21.15.194:0/3414527221 >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 0x7fcd5c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5b400640 1 -- 172.21.15.194:0/3414527221 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3515764379 0 0) 0x7fcd5c0aba50 con 0x7fcd5c14d6e0 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5b400640 1 -- 172.21.15.194:0/3414527221 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd44003520 con 0x7fcd5c14d6e0 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5be00640 1 -- 172.21.15.194:0/3414527221 >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 msgr2=0x7fcd5c15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5be00640 1 --2- 172.21.15.194:0/3414527221 >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 0x7fcd5c15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5be00640 1 -- 172.21.15.194:0/3414527221 >> v1:172.21.15.194:6789/0 conn(0x7fcd5c14d6e0 legacy=0x7fcd5c0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd5be00640 1 -- 172.21.15.194:0/3414527221 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c153760 con 0x7fcd5c06e820 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.458+0000 7fcd61400640 1 --2- 172.21.15.194:0/3414527221 >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 0x7fcd5c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.459+0000 7fcd5be00640 1 --2- 172.21.15.194:0/3414527221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c0a94d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c06d540 tx=0x7fcd4c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26505215ad396550 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.460+0000 7fcd5b400640 1 -- 172.21.15.194:0/3414527221 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0315a0 con 0x7fcd5c06e820 2024-03-07T10:21:07.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.460+0000 7fcd5b400640 1 -- 172.21.15.194:0/3414527221 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c037070 con 0x7fcd5c06e820 2024-03-07T10:21:07.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.460+0000 7fcd5b400640 1 -- 172.21.15.194:0/3414527221 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c031960 con 0x7fcd5c06e820 2024-03-07T10:21:07.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.460+0000 7fcd63400640 1 -- 172.21.15.194:0/3414527221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 msgr2=0x7fcd5c0a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.460+0000 7fcd63400640 1 --2- 172.21.15.194:0/3414527221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c0a94d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c06d540 tx=0x7fcd4c02b840 comp rx=0 tx=0).stop 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 -- 172.21.15.194:0/3414527221 shutdown_connections 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 --2- 172.21.15.194:0/3414527221 >> v2:172.21.15.196:3300/0 conn(0x7fcd5c0a9a10 0x7fcd5c15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 --2- 172.21.15.194:0/3414527221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c0a94d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 -- 172.21.15.194:0/3414527221 >> 172.21.15.194:0/3414527221 conn(0x7fcd5c06b860 msgr2=0x7fcd5c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 -- 172.21.15.194:0/3414527221 shutdown_connections 2024-03-07T10:21:07.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.461+0000 7fcd63400640 1 -- 172.21.15.194:0/3414527221 wait complete. 2024-03-07T10:21:07.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.462+0000 7fcd63400640 1 Processor -- start 2024-03-07T10:21:07.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.462+0000 7fcd63400640 1 -- start start 2024-03-07T10:21:07.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd5c0a9a10 0x7fcd5c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd5c14d6e0 0x7fcd5c1517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c06e300 con 0x7fcd5c06e820 2024-03-07T10:21:07.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c06e020 con 0x7fcd5c14d6e0 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd63400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c0c79c0 con 0x7fcd5c0a9a10 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd60a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd60a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37252/0 (socket says 172.21.15.194:37252) 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.463+0000 7fcd60a00640 1 -- 172.21.15.194:0/305114650 learned_addr learned my addr 172.21.15.194:0/305114650 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd61400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd5c14d6e0 0x7fcd5c1517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd5be00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd5c0a9a10 0x7fcd5c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 -- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd5c0a9a10 msgr2=0x7fcd5c151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd5c0a9a10 0x7fcd5c151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 -- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd5c14d6e0 msgr2=0x7fcd5c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd5c14d6e0 0x7fcd5c1517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 -- 172.21.15.194:0/305114650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c072880 con 0x7fcd5c06e820 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd60a00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c390 tx=0x7fcd5000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd50017070 con 0x7fcd5c06e820 2024-03-07T10:21:07.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd50005ce0 con 0x7fcd5c06e820 2024-03-07T10:21:07.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd500072f0 con 0x7fcd5c06e820 2024-03-07T10:21:07.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c072b60 con 0x7fcd5c06e820 2024-03-07T10:21:07.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.464+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c071930 con 0x7fcd5c06e820 2024-03-07T10:21:07.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.465+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c068170 con 0x7fcd5c06e820 2024-03-07T10:21:07.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.466+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcd5001a070 con 0x7fcd5c06e820 2024-03-07T10:21:07.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.467+0000 7fcd58c00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 0x7fcd4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:07.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.467+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6054+0+0 (secure 0 0 0) 0x7fcd500896a0 con 0x7fcd5c06e820 2024-03-07T10:21:07.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.468+0000 7fcd5be00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 0x7fcd4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:07.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.469+0000 7fcd5be00640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 0x7fcd4006d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c036000 tx=0x7fcd4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:07.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.472+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcd50058450 con 0x7fcd5c06e820 2024-03-07T10:21:07.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:07.653+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcd5c0ac550 con 0x7fcd5c06e820 2024-03-07T10:21:08.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.245+0000 7fcd58c00640 1 -- 172.21.15.194:0/305114650 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v22) v1 ==== 160+0+0 (secure 0 0 0) 0x7fcd50057d50 con 0x7fcd5c06e820 2024-03-07T10:21:08.247 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'b_data' created 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 msgr2=0x7fcd4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 0x7fcd4006d9c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c036000 tx=0x7fcd4c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 msgr2=0x7fcd5c14ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcd5000c390 tx=0x7fcd5000c850 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 shutdown_connections 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcd4006b500 0x7fcd4006d9c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcd5c14d6e0 0x7fcd5c1517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcd5c0a9a10 0x7fcd5c151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 --2- 172.21.15.194:0/305114650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd5c06e820 0x7fcd5c14ba90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.248+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 >> 172.21.15.194:0/305114650 conn(0x7fcd5c06b860 msgr2=0x7fcd5c0c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:08.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.249+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 shutdown_connections 2024-03-07T10:21:08.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.249+0000 7fcd63400640 1 -- 172.21.15.194:0/305114650 wait complete. 2024-03-07T10:21:08.288 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-03-07T10:21:08.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.463+0000 7f87f2800640 1 Processor -- start 2024-03-07T10:21:08.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.464+0000 7f87f2800640 1 -- start start 2024-03-07T10:21:08.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87f2800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87ec06dc90 0x7f87ec0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87f2800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f87ec072f10 0x7f87ec159c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87f2800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87ec071a30 con 0x7f87ec157360 2024-03-07T10:21:08.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87f2800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec06daf0 con 0x7f87ec06dc90 2024-03-07T10:21:08.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87f2800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87ec071750 con 0x7f87ec072f10 2024-03-07T10:21:08.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87e3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87ec06dc90 0x7f87ec0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87e3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87ec06dc90 0x7f87ec0c19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37260/0 (socket says 172.21.15.194:37260) 2024-03-07T10:21:08.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.465+0000 7f87e3e00640 1 -- 172.21.15.194:0/2377222462 learned_addr learned my addr 172.21.15.194:0/2377222462 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:08.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.466+0000 7f87ebe00640 1 --2- 172.21.15.194:0/2377222462 >> v2:172.21.15.196:3300/0 conn(0x7f87ec072f10 0x7f87ec159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.466+0000 7f87e3e00640 1 -- 172.21.15.194:0/2377222462 >> v2:172.21.15.196:3300/0 conn(0x7f87ec072f10 msgr2=0x7f87ec159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.466+0000 7f87e3e00640 1 --2- 172.21.15.194:0/2377222462 >> v2:172.21.15.196:3300/0 conn(0x7f87ec072f10 0x7f87ec159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.466+0000 7f87e3e00640 1 -- 172.21.15.194:0/2377222462 >> v1:172.21.15.196:6789/0 conn(0x7f87ec157360 legacy=0x7f87ec06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.466+0000 7f87e3e00640 1 -- 172.21.15.194:0/2377222462 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec15a850 con 0x7f87ec06dc90 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.467+0000 7f87e3e00640 1 --2- 172.21.15.194:0/2377222462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec06dc90 0x7f87ec0c19c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f87ec15ab30 tx=0x7f87d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d07745af4cbd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.467+0000 7f87eaa00640 1 -- 172.21.15.194:0/2377222462 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d402e070 con 0x7f87ec06dc90 2024-03-07T10:21:08.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.467+0000 7f87eaa00640 1 -- 172.21.15.194:0/2377222462 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d4037070 con 0x7f87ec06dc90 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.467+0000 7f87eaa00640 1 -- 172.21.15.194:0/2377222462 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d4031a00 con 0x7f87ec06dc90 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 -- 172.21.15.194:0/2377222462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec06dc90 msgr2=0x7f87ec0c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 --2- 172.21.15.194:0/2377222462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec06dc90 0x7f87ec0c19c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f87ec15ab30 tx=0x7f87d402b880 comp rx=0 tx=0).stop 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 -- 172.21.15.194:0/2377222462 shutdown_connections 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 --2- 172.21.15.194:0/2377222462 >> v2:172.21.15.196:3300/0 conn(0x7f87ec072f10 0x7f87ec159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 --2- 172.21.15.194:0/2377222462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec06dc90 0x7f87ec0c19c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 -- 172.21.15.194:0/2377222462 >> 172.21.15.194:0/2377222462 conn(0x7f87ec06b860 msgr2=0x7f87ec0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:08.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 -- 172.21.15.194:0/2377222462 shutdown_connections 2024-03-07T10:21:08.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.468+0000 7f87f2800640 1 -- 172.21.15.194:0/2377222462 wait complete. 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.469+0000 7f87f2800640 1 Processor -- start 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.469+0000 7f87f2800640 1 -- start start 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87ec06dc90 0x7f87ec14cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 0x7f87ec14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec070f30 con 0x7f87ec157360 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec070db0 con 0x7f87ec06dc90 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.470+0000 7f87f2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec15a170 con 0x7f87ec072f10 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:37262/0 (socket says 172.21.15.194:37262) 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 -- 172.21.15.194:0/3870596316 learned_addr learned my addr 172.21.15.194:0/3870596316 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:08.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87e3e00640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 0x7f87ec14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87eb400640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87ec06dc90 0x7f87ec14cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 -- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 msgr2=0x7f87ec14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 0x7f87ec14d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 -- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87ec06dc90 msgr2=0x7f87ec14cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87ec06dc90 0x7f87ec14cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 -- 172.21.15.194:0/3870596316 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0c15f0 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87e3e00640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 0x7f87ec14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87ebe00640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87e400cd70 tx=0x7f87e400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.471+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4003b90 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.472+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e4003d30 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.472+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4004240 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.472+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec1f3910 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.472+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec0abfc0 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.473+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec068170 con 0x7f87ec157360 2024-03-07T10:21:08.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.474+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f87e40043e0 con 0x7f87ec157360 2024-03-07T10:21:08.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.475+0000 7f87e3400640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 0x7f87c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:08.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.475+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6431+0+0 (secure 0 0 0) 0x7f87e408aff0 con 0x7f87ec157360 2024-03-07T10:21:08.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.475+0000 7f87eb400640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 0x7f87c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:08.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.476+0000 7f87eb400640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 0x7f87c806d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00a750 tx=0x7f87dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:08.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.480+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f87e4059b40 con 0x7f87ec157360 2024-03-07T10:21:08.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:08.709+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) v1 -- 0x7f87ec06cd20 con 0x7f87ec157360 2024-03-07T10:21:09.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.290+0000 7f87e3400640 1 -- 172.21.15.194:0/3870596316 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 157+0+0 (secure 0 0 0) 0x7f87e4059440 con 0x7f87ec157360 2024-03-07T10:21:09.300 INFO:teuthology.orchestra.run.smithi194.stderr:new fs with metadata pool 4 and data pool 5 2024-03-07T10:21:09.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.302+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 msgr2=0x7f87c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.302+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 0x7f87c806d990 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00a750 tx=0x7f87dc008040 comp rx=0 tx=0).stop 2024-03-07T10:21:09.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.302+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 msgr2=0x7f87ec0a9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.302+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f87e400cd70 tx=0x7f87e400a660 comp rx=0 tx=0).stop 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.303+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 shutdown_connections 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.303+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f87c806b4d0 0x7f87c806d990 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.303+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87ec157360 0x7f87ec0a9eb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.303+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f87ec072f10 0x7f87ec14d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.303+0000 7f87f2800640 1 --2- 172.21.15.194:0/3870596316 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f87ec06dc90 0x7f87ec14cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.304+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 >> 172.21.15.194:0/3870596316 conn(0x7f87ec06b860 msgr2=0x7f87ec159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:09.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.305+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 shutdown_connections 2024-03-07T10:21:09.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.305+0000 7f87f2800640 1 -- 172.21.15.194:0/3870596316 wait complete. 2024-03-07T10:21:09.341 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:09.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.508+0000 7f2606e00640 1 Processor -- start 2024-03-07T10:21:09.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.508+0000 7f2606e00640 1 -- start start 2024-03-07T10:21:09.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f2606e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f260006e010 0x7f260015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f2606e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2600153980 con 0x7f2600150b70 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f2606e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2600153c60 con 0x7f2600156c20 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f2606e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2600153f40 con 0x7f260006e010 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f25ffe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2600150b70 0x7f26000a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60432/0 (socket says 172.21.15.194:60432) 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f25ffe00640 1 -- 172.21.15.194:0/3691676246 learned_addr learned my addr 172.21.15.194:0/3691676246 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678029767 0 0) 0x7f2600153980 con 0x7f2600150b70 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.510+0000 7f2604e00640 1 --2- 172.21.15.194:0/3691676246 >> v2:172.21.15.196:3300/0 conn(0x7f260006e010 0x7f260015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25e4003520 con 0x7f2600150b70 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791733570 0 0) 0x7f25e4003520 con 0x7f2600150b70 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 >> v2:172.21.15.196:3300/0 conn(0x7f260006e010 msgr2=0x7f260015efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:09.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 --2- 172.21.15.194:0/3691676246 >> v2:172.21.15.196:3300/0 conn(0x7f260006e010 0x7f260015efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 >> v1:172.21.15.196:6789/0 conn(0x7f2600156c20 legacy=0x7f260006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600154220 con 0x7f2600150b70 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f25f0001670 con 0x7f2600150b70 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 >> v1:172.21.15.194:6789/0 conn(0x7f2600150b70 legacy=0x7f26000a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 0x7f25e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25e4004800 0x7f25e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e40052e0 0x7f25e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600153f40 con 0x7f25e4003a00 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e400c200 con 0x7f25e4004800 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e400c400 con 0x7f25e40052e0 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.511+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 0x7f25e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f2604e00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e40052e0 0x7f25e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25f7400640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25e4004800 0x7f25e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25ffe00640 1 -- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e40052e0 msgr2=0x7f25e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:09.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e40052e0 0x7f25e400b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25ffe00640 1 -- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25e4004800 msgr2=0x7f25e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f25e4004800 0x7f25e4004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f25ffe00640 1 -- 172.21.15.194:0/3691676246 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4003520 con 0x7f25e4003a00 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.512+0000 7f2604e00640 1 -- 172.21.15.194:0/3691676246 reap_dead start 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.513+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 0x7f25e4003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c190 tx=0x7f25e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5afc36755d7e1a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.513+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0007c60 con 0x7f25e4003a00 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.513+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0030070 con 0x7f25e4003a00 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.513+0000 7f25ff400640 1 -- 172.21.15.194:0/3691676246 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0005db0 con 0x7f25e4003a00 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 -- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 msgr2=0x7f25e4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 0x7f25e4003e20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c190 tx=0x7f25e4005830 comp rx=0 tx=0).stop 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 -- 172.21.15.194:0/3691676246 shutdown_connections 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 --2- 172.21.15.194:0/3691676246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e4003a00 0x7f25e4003e20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 -- 172.21.15.194:0/3691676246 >> 172.21.15.194:0/3691676246 conn(0x7f260006b840 msgr2=0x7f26000c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:09.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 -- 172.21.15.194:0/3691676246 shutdown_connections 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.514+0000 7f2606e00640 1 -- 172.21.15.194:0/3691676246 wait complete. 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.515+0000 7f2606e00640 1 Processor -- start 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 -- start start 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e4003a00 0x7f26001ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f260006d4e0 0x7f26001eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260006e460 con 0x7f2600070ba0 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2600153630 con 0x7f260006d4e0 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.516+0000 7f2606e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2600150f50 con 0x7f25e4003a00 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50666/0 (socket says 172.21.15.194:50666) 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 -- 172.21.15.194:0/3875881458 learned_addr learned my addr 172.21.15.194:0/3875881458 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e4003a00 0x7f26001ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f25f7400640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f260006d4e0 0x7f26001eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 -- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e4003a00 msgr2=0x7f26001ef3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e4003a00 0x7f26001ef3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 -- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f260006d4e0 msgr2=0x7f26001eb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f260006d4e0 0x7f26001eb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 -- 172.21.15.194:0/3875881458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2600071e70 con 0x7f2600070ba0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f2604e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2600157d40 tx=0x7f25f8009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.517+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8019070 con 0x7f2600070ba0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.518+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f8007d10 con 0x7f2600070ba0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.518+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f8014640 con 0x7f2600070ba0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.518+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26000c6a90 con 0x7f2600070ba0 2024-03-07T10:21:09.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.518+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26000c6d30 con 0x7f2600070ba0 2024-03-07T10:21:09.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.519+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2600068170 con 0x7f2600070ba0 2024-03-07T10:21:09.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.520+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f25f801c070 con 0x7f2600070ba0 2024-03-07T10:21:09.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.521+0000 7f25fcc00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 0x7f25dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.521+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f25f8089e70 con 0x7f2600070ba0 2024-03-07T10:21:09.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.521+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 0x7f25dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.522+0000 7f25ffe00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 0x7f25dc06d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c160 tx=0x7f25f0009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.526+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f25f80582d0 con 0x7f2600070ba0 2024-03-07T10:21:09.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.724+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f260006cd20 con 0x7f2600070ba0 2024-03-07T10:21:09.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.726+0000 7f25fcc00640 1 -- 172.21.15.194:0/3875881458 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+20404 (secure 0 0 0) 0x7f25f805c370 con 0x7f2600070ba0 2024-03-07T10:21:09.728 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:09.729 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":23,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:08.712063+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 msgr2=0x7f25dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 0x7f25dc06d9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f25f000c160 tx=0x7f25f0009030 comp rx=0 tx=0).stop 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 msgr2=0x7f2600071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2600157d40 tx=0x7f25f8009cb0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 shutdown_connections 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.728+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f25dc06b500 0x7f25dc06d9c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2600070ba0 0x7f2600071020 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f260006d4e0 0x7f26001eb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 --2- 172.21.15.194:0/3875881458 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f25e4003a00 0x7f26001ef3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 >> 172.21.15.194:0/3875881458 conn(0x7f260006b840 msgr2=0x7f26000c2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:09.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 shutdown_connections 2024-03-07T10:21:09.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.729+0000 7f2606e00640 1 -- 172.21.15.194:0/3875881458 wait complete. 2024-03-07T10:21:09.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:09.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.958+0000 7ff4f4a00640 1 Processor -- start 2024-03-07T10:21:09.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.958+0000 7ff4f4a00640 1 -- start start 2024-03-07T10:21:09.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.959+0000 7ff4f4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4f0156c20 0x7ff4f006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.959+0000 7ff4f4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f0153980 con 0x7ff4f006de40 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.959+0000 7ff4f4a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f0153c60 con 0x7ff4f0150b70 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.959+0000 7ff4f4a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f0153f40 con 0x7ff4f0156c20 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4f0156c20 0x7ff4f006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff4f0156c20 0x7ff4f006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50674/0 (socket says 172.21.15.194:50674) 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 -- 172.21.15.194:0/2091006037 learned_addr learned my addr 172.21.15.194:0/2091006037 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4ee800640 1 --1- 172.21.15.194:0/2091006037 >> v1:172.21.15.194:6789/0 conn(0x7ff4f006de40 0x7ff4f015dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60436/0 (socket says 172.21.15.194:60436) 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 -- 172.21.15.194:0/2091006037 >> v1:172.21.15.196:6789/0 conn(0x7ff4f0150b70 legacy=0x7ff4f00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 -- 172.21.15.194:0/2091006037 >> v1:172.21.15.194:6789/0 conn(0x7ff4f006de40 legacy=0x7ff4f015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.960+0000 7ff4e5400640 1 -- 172.21.15.194:0/2091006037 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f0154220 con 0x7ff4f0156c20 2024-03-07T10:21:09.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.961+0000 7ff4e5400640 1 --2- 172.21.15.194:0/2091006037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f006d900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009870 tx=0x7ff4d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802b2520207a6a43 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.961+0000 7ff4ed400640 1 -- 172.21.15.194:0/2091006037 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8034070 con 0x7ff4f0156c20 2024-03-07T10:21:09.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4ed400640 1 -- 172.21.15.194:0/2091006037 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d8030860 con 0x7ff4f0156c20 2024-03-07T10:21:09.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4ed400640 1 -- 172.21.15.194:0/2091006037 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8030c30 con 0x7ff4f0156c20 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 -- 172.21.15.194:0/2091006037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 msgr2=0x7ff4f006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/2091006037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f006d900 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009870 tx=0x7ff4d802b9a0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 -- 172.21.15.194:0/2091006037 shutdown_connections 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/2091006037 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f006d900 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 -- 172.21.15.194:0/2091006037 >> 172.21.15.194:0/2091006037 conn(0x7ff4f006b840 msgr2=0x7ff4f00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 -- 172.21.15.194:0/2091006037 shutdown_connections 2024-03-07T10:21:09.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.962+0000 7ff4f4a00640 1 -- 172.21.15.194:0/2091006037 wait complete. 2024-03-07T10:21:09.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.964+0000 7ff4f4a00640 1 Processor -- start 2024-03-07T10:21:09.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.964+0000 7ff4f4a00640 1 -- start start 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f006de40 0x7ff4f0156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f0150b70 0x7ff4f01ef060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00a9be0 con 0x7ff4f0156c20 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0153630 con 0x7ff4f0150b70 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4f4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f00a9d60 con 0x7ff4f006de40 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50690/0 (socket says 172.21.15.194:50690) 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 -- 172.21.15.194:0/4268093750 learned_addr learned my addr 172.21.15.194:0/4268093750 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ede00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f006de40 0x7ff4f0156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 -- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f006de40 msgr2=0x7ff4f0156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f006de40 0x7ff4f0156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4e5400640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f0150b70 0x7ff4f01ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 -- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f0150b70 msgr2=0x7ff4f01ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f0150b70 0x7ff4f01ef060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.965+0000 7ff4ee800640 1 -- 172.21.15.194:0/4268093750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f01efae0 con 0x7ff4f0156c20 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4ee800640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c730 tx=0x7ff4e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8017070 con 0x7ff4f0156c20 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e800ce40 con 0x7ff4f0156c20 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f01e1830 con 0x7ff4f0156c20 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e800a840 con 0x7ff4f0156c20 2024-03-07T10:21:09.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.966+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f0155fd0 con 0x7ff4f0156c20 2024-03-07T10:21:09.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.967+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f0155b00 con 0x7ff4f0156c20 2024-03-07T10:21:09.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.968+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff4e801a070 con 0x7ff4f0156c20 2024-03-07T10:21:09.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.969+0000 7ff4e6a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 0x7ff4cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:09.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.969+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff4e8089990 con 0x7ff4f0156c20 2024-03-07T10:21:09.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.970+0000 7ff4ede00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 0x7ff4cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:09.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.971+0000 7ff4ede00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 0x7ff4cc06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0001640 tx=0x7ff4e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:09.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:09.974+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff4e8057e90 con 0x7ff4f0156c20 2024-03-07T10:21:10.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.171+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f00c14b0 con 0x7ff4f0156c20 2024-03-07T10:21:10.176 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.174+0000 7ff4e6a00640 1 -- 172.21.15.194:0/4268093750 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+20404 (secure 0 0 0) 0x7ff4e805bf30 con 0x7ff4f0156c20 2024-03-07T10:21:10.177 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:10.177 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":23,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:08.712063+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:10.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 msgr2=0x7ff4cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 0x7ff4cc06d990 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0001640 tx=0x7ff4e0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:10.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 msgr2=0x7ff4f01ef5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff4e800c730 tx=0x7ff4e800cbf0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 shutdown_connections 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff4cc06b4d0 0x7ff4cc06d990 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f0156c20 0x7ff4f01ef5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff4f0150b70 0x7ff4f01ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 --2- 172.21.15.194:0/4268093750 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff4f006de40 0x7ff4f0156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 >> 172.21.15.194:0/4268093750 conn(0x7ff4f006b840 msgr2=0x7ff4f014e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 shutdown_connections 2024-03-07T10:21:10.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.177+0000 7ff4f4a00640 1 -- 172.21.15.194:0/4268093750 wait complete. 2024-03-07T10:21:10.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-03-07T10:21:10.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.405+0000 7ff90dc00640 1 Processor -- start 2024-03-07T10:21:10.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.405+0000 7ff90dc00640 1 -- start start 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.406+0000 7ff90dc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9080cb560 0x7ff9080cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.406+0000 7ff90dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9081532e0 con 0x7ff908155890 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.406+0000 7ff90dc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9080c9aa0 con 0x7ff908152f00 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.406+0000 7ff90dc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9080c9780 con 0x7ff9080cb560 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff907400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff908155890 0x7ff908155ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60446/0 (socket says 172.21.15.194:60446) 2024-03-07T10:21:10.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff907400640 1 -- 172.21.15.194:0/2724345105 learned_addr learned my addr 172.21.15.194:0/2724345105 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:10.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486757953 0 0) 0x7ff9081532e0 con 0x7ff908155890 2024-03-07T10:21:10.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ec003520 con 0x7ff908155890 2024-03-07T10:21:10.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/2724345105 >> v2:172.21.15.196:3300/0 conn(0x7ff9080cb560 0x7ff9080cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292883128 0 0) 0x7ff8ec003520 con 0x7ff908155890 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 >> v2:172.21.15.196:3300/0 conn(0x7ff9080cb560 msgr2=0x7ff9080cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 --2- 172.21.15.194:0/2724345105 >> v2:172.21.15.196:3300/0 conn(0x7ff9080cb560 0x7ff9080cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 >> v1:172.21.15.196:6789/0 conn(0x7ff908152f00 legacy=0x7ff9080c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff908158f20 con 0x7ff908155890 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7ff9000019f0 con 0x7ff908155890 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 >> v1:172.21.15.194:6789/0 conn(0x7ff908155890 legacy=0x7ff908155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.407+0000 7ff906000640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8ec003a00 0x7ff8ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906000640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff8ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906000640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8ec0052e0 0x7ff8ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9080c9780 con 0x7ff8ec004800 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec00c200 con 0x7ff8ec003a00 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec00c400 con 0x7ff8ec0052e0 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff8ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff906a00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8ec003a00 0x7ff8ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 -- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8ec0052e0 msgr2=0x7ff8ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff907400640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8ec0052e0 0x7ff8ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8ec0052e0 0x7ff8ec00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 -- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8ec003a00 msgr2=0x7ff8ec003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8ec003a00 0x7ff8ec003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff8ffe00640 1 -- 172.21.15.194:0/2724345105 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec003520 con 0x7ff8ec004800 2024-03-07T10:21:10.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.408+0000 7ff907400640 1 -- 172.21.15.194:0/2724345105 reap_dead start 2024-03-07T10:21:10.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.410+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff8ec004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000ba30 tx=0x7ff8ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9eebe8ceabde1e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:10.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.410+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0036020 con 0x7ff8ec004800 2024-03-07T10:21:10.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.410+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0032640 con 0x7ff8ec004800 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.410+0000 7ff906000640 1 -- 172.21.15.194:0/2724345105 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000b600 con 0x7ff8ec004800 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 -- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 msgr2=0x7ff8ec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff8ec004c80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000ba30 tx=0x7ff8ec005830 comp rx=0 tx=0).stop 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 -- 172.21.15.194:0/2724345105 shutdown_connections 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 --2- 172.21.15.194:0/2724345105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff8ec004c80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 -- 172.21.15.194:0/2724345105 >> 172.21.15.194:0/2724345105 conn(0x7ff9080671b0 msgr2=0x7ff9080675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 -- 172.21.15.194:0/2724345105 shutdown_connections 2024-03-07T10:21:10.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.411+0000 7ff90dc00640 1 -- 172.21.15.194:0/2724345105 wait complete. 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.413+0000 7ff90dc00640 1 Processor -- start 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.413+0000 7ff90dc00640 1 -- start start 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff908152470 0x7ff9081492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 0x7ff9081507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081597c0 con 0x7ff8ec004800 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9081594e0 con 0x7ff908149c20 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff90dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff908159ce0 con 0x7ff908152470 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50718/0 (socket says 172.21.15.194:50718) 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 -- 172.21.15.194:0/1073541677 learned_addr learned my addr 172.21.15.194:0/1073541677 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff908152470 0x7ff9081492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff907400640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 0x7ff9081507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 -- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff908152470 msgr2=0x7ff9081492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff908152470 0x7ff9081492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 -- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 msgr2=0x7ff9081507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 0x7ff9081507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff906a00640 1 -- 172.21.15.194:0/1073541677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9081e1840 con 0x7ff8ec004800 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.414+0000 7ff907400640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 0x7ff9081507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:10.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff906a00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e4c0 tx=0x7ff8f800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f80052e0 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f8018070 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8003830 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90814b370 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.415+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90814b5e0 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.416+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9080622b0 con 0x7ff8ec004800 2024-03-07T10:21:10.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.417+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff8f80039d0 con 0x7ff8ec004800 2024-03-07T10:21:10.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.418+0000 7ff8fea00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 0x7ff8e406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:10.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.418+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff8f808a0f0 con 0x7ff8ec004800 2024-03-07T10:21:10.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.419+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 0x7ff8e406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:10.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.420+0000 7ff8ffe00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 0x7ff8e406d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000ba00 tx=0x7ff8f003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:10.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.427+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff8f8058d90 con 0x7ff8ec004800 2024-03-07T10:21:10.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:10.660+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff90806d6e0 con 0x7ff8ec004800 2024-03-07T10:21:11.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.313+0000 7ff8fea00640 1 -- 172.21.15.194:0/1073541677 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 113+0+0 (secure 0 0 0) 0x7ff8f8058690 con 0x7ff8ec004800 2024-03-07T10:21:11.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.317+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 msgr2=0x7ff8e406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:11.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.317+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 0x7ff8e406d9c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000ba00 tx=0x7ff8f003d040 comp rx=0 tx=0).stop 2024-03-07T10:21:11.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.317+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 msgr2=0x7ff908153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:11.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.317+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e4c0 tx=0x7ff8f800e980 comp rx=0 tx=0).stop 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 shutdown_connections 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8e406b500 0x7ff8e406d9c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff908149c20 0x7ff9081507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff908152470 0x7ff9081492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 --2- 172.21.15.194:0/1073541677 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8ec004800 0x7ff908153700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 >> 172.21.15.194:0/1073541677 conn(0x7ff9080671b0 msgr2=0x7ff90806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 shutdown_connections 2024-03-07T10:21:11.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.318+0000 7ff90dc00640 1 -- 172.21.15.194:0/1073541677 wait complete. 2024-03-07T10:21:11.342 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-03-07T10:21:11.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-03-07T10:21:11.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.545+0000 7f5d76a00640 1 Processor -- start 2024-03-07T10:21:11.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.545+0000 7f5d76a00640 1 -- start start 2024-03-07T10:21:11.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d7014d6e0 0x7f5d7006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5d700ab340 0x7f5d700a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d700ab7c0 0x7f5d70156b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7006daf0 con 0x7f5d700ab7c0 2024-03-07T10:21:11.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d70153760 con 0x7f5d700ab340 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d76a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006dd40 con 0x7f5d7014d6e0 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d700ab7c0 0x7f5d70156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d700ab7c0 0x7f5d70156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50726/0 (socket says 172.21.15.194:50726) 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 -- 172.21.15.194:0/1419851113 learned_addr learned my addr 172.21.15.194:0/1419851113 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d6fe00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d7014d6e0 0x7f5d7006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 -- 172.21.15.194:0/1419851113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d7014d6e0 msgr2=0x7f5d7006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d7014d6e0 0x7f5d7006e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 -- 172.21.15.194:0/1419851113 >> v2:172.21.15.196:3300/0 conn(0x7f5d700ab340 msgr2=0x7f5d700a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 --2- 172.21.15.194:0/1419851113 >> v2:172.21.15.196:3300/0 conn(0x7f5d700ab340 0x7f5d700a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.547+0000 7f5d74a00640 1 -- 172.21.15.194:0/1419851113 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7006e020 con 0x7f5d700ab7c0 2024-03-07T10:21:11.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.548+0000 7f5d74a00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d700ab7c0 0x7f5d70156b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d7006ef60 tx=0x7f5d6802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36a8f5de42e56fe server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:11.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.548+0000 7f5d6f400640 1 -- 172.21.15.194:0/1419851113 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6802c9e0 con 0x7f5d700ab7c0 2024-03-07T10:21:11.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d6f400640 1 -- 172.21.15.194:0/1419851113 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6802cb80 con 0x7f5d700ab7c0 2024-03-07T10:21:11.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d6f400640 1 -- 172.21.15.194:0/1419851113 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d680343f0 con 0x7f5d700ab7c0 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 -- 172.21.15.194:0/1419851113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d700ab7c0 msgr2=0x7f5d70156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d700ab7c0 0x7f5d70156b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d7006ef60 tx=0x7f5d6802be40 comp rx=0 tx=0).stop 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 -- 172.21.15.194:0/1419851113 shutdown_connections 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d700ab7c0 0x7f5d70156b40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 --2- 172.21.15.194:0/1419851113 >> v2:172.21.15.196:3300/0 conn(0x7f5d700ab340 0x7f5d700a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 --2- 172.21.15.194:0/1419851113 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d7014d6e0 0x7f5d7006e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 -- 172.21.15.194:0/1419851113 >> 172.21.15.194:0/1419851113 conn(0x7f5d7006b860 msgr2=0x7f5d700c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 -- 172.21.15.194:0/1419851113 shutdown_connections 2024-03-07T10:21:11.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.549+0000 7f5d76a00640 1 -- 172.21.15.194:0/1419851113 wait complete. 2024-03-07T10:21:11.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.551+0000 7f5d76a00640 1 Processor -- start 2024-03-07T10:21:11.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.551+0000 7f5d76a00640 1 -- start start 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d700ab340 0x7f5d70148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d700ab7c0 0x7f5d701ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700aae10 con 0x7f5d7014d6e0 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d700c79c0 con 0x7f5d700ab340 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d76a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7006ce70 con 0x7f5d700ab7c0 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d74a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d74a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50732/0 (socket says 172.21.15.194:50732) 2024-03-07T10:21:11.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.552+0000 7f5d74a00640 1 -- 172.21.15.194:0/276739828 learned_addr learned my addr 172.21.15.194:0/276739828 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:11.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d67400640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d700ab7c0 0x7f5d701ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d6fe00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d700ab340 0x7f5d70148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 -- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d700ab7c0 msgr2=0x7f5d701ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d700ab7c0 0x7f5d701ee9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 -- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d700ab340 msgr2=0x7f5d70148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d700ab340 0x7f5d70148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 -- 172.21.15.194:0/276739828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7014db60 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d74a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d68036040 tx=0x7f5d68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68043020 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6803e450 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.553+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68009510 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.554+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7014de40 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.554+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d701eb8d0 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.555+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d70068170 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.556+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5d68046020 con 0x7f5d7014d6e0 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.557+0000 7f5d6cc00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:11.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.557+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5d680acde0 con 0x7f5d7014d6e0 2024-03-07T10:21:11.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.557+0000 7f5d6fe00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:11.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.558+0000 7f5d6fe00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:11.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.566+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5d6804d030 con 0x7f5d7014d6e0 2024-03-07T10:21:11.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:11.803+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5d701ebaa0 con 0x7f5d7014d6e0 2024-03-07T10:21:12.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.317+0000 7f5d6cc00640 1 -- 172.21.15.194:0/276739828 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 117+0+0 (secure 0 0 0) 0x7f5d6807b920 con 0x7f5d7014d6e0 2024-03-07T10:21:12.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.321+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 msgr2=0x7f5d4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.321+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5d60006fd0 tx=0x7f5d60008040 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.321+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 msgr2=0x7f5d70148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.321+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5d68036040 tx=0x7f5d68004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 shutdown_connections 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5d4c06b4d0 0x7f5d4c06d990 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d7014d6e0 0x7f5d70148860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d700ab7c0 0x7f5d701ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 --2- 172.21.15.194:0/276739828 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d700ab340 0x7f5d70148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 >> 172.21.15.194:0/276739828 conn(0x7f5d7006b860 msgr2=0x7f5d7014c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 shutdown_connections 2024-03-07T10:21:12.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.322+0000 7f5d76a00640 1 -- 172.21.15.194:0/276739828 wait complete. 2024-03-07T10:21:12.344 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-03-07T10:21:12.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.548+0000 7fe08bc00640 1 Processor -- start 2024-03-07T10:21:12.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.548+0000 7fe08bc00640 1 -- start start 2024-03-07T10:21:12.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe08bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe0840adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe08bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe084158c70 con 0x7fe0840c2ff0 2024-03-07T10:21:12.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe08bc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe084155680 con 0x7fe0840ad8e0 2024-03-07T10:21:12.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe08bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406de10 con 0x7fe084156290 2024-03-07T10:21:12.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe083e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe0840c2ff0 0x7fe08415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60448/0 (socket says 172.21.15.194:60448) 2024-03-07T10:21:12.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.550+0000 7fe083e00640 1 -- 172.21.15.194:0/2286421542 learned_addr learned my addr 172.21.15.194:0/2286421542 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe089c00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe0840adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656784828 0 0) 0x7fe084158c70 con 0x7fe0840c2ff0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe06c003520 con 0x7fe0840c2ff0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335078669 0 0) 0x7fe06c003520 con 0x7fe0840c2ff0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 msgr2=0x7fe0840adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe0840adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 >> v1:172.21.15.196:6789/0 conn(0x7fe0840ad8e0 legacy=0x7fe084155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840c4040 con 0x7fe0840c2ff0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fe070001670 con 0x7fe0840c2ff0 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 >> v1:172.21.15.194:6789/0 conn(0x7fe0840c2ff0 legacy=0x7fe08415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe06c0039e0 0x7fe06c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe06c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406de10 con 0x7fe06c004d40 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c00baa0 con 0x7fe06c0039e0 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.551+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c00bca0 con 0x7fe084156290 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089200640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe06c0039e0 0x7fe06c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe083e00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe06c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 -- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 msgr2=0x7fe06c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe084156290 0x7fe06c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 -- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe06c0039e0 msgr2=0x7fe06c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe06c0039e0 0x7fe06c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.552+0000 7fe089c00640 1 -- 172.21.15.194:0/2286421542 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c003520 con 0x7fe06c004d40 2024-03-07T10:21:12.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.553+0000 7fe089c00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009f90 tx=0x7fe06c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9b406d14da10d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:12.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.553+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c039070 con 0x7fe06c004d40 2024-03-07T10:21:12.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.553+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c02cbd0 con 0x7fe06c004d40 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.553+0000 7fe083400640 1 -- 172.21.15.194:0/2286421542 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009c10 con 0x7fe06c004d40 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 -- 172.21.15.194:0/2286421542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe06c004d40 msgr2=0x7fe06c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 --2- 172.21.15.194:0/2286421542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe06c004d40 0x7fe06c0051c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009f90 tx=0x7fe06c005830 comp rx=0 tx=0).stop 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe089c00640 1 -- 172.21.15.194:0/2286421542 reap_dead start 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 -- 172.21.15.194:0/2286421542 shutdown_connections 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 -- 172.21.15.194:0/2286421542 >> 172.21.15.194:0/2286421542 conn(0x7fe0840c4a60 msgr2=0x7fe0840c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 -- 172.21.15.194:0/2286421542 shutdown_connections 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.554+0000 7fe08bc00640 1 -- 172.21.15.194:0/2286421542 wait complete. 2024-03-07T10:21:12.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.556+0000 7fe08bc00640 1 Processor -- start 2024-03-07T10:21:12.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.556+0000 7fe08bc00640 1 -- start start 2024-03-07T10:21:12.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe06c004d40 0x7fe08414dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe084158700 0x7fe08413d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406dac0 con 0x7fe08414bfc0 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840c4600 con 0x7fe084158700 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe08bc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe084152f00 con 0x7fe06c004d40 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe083e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe083e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50762/0 (socket says 172.21.15.194:50762) 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe083e00640 1 -- 172.21.15.194:0/1395346257 learned_addr learned my addr 172.21.15.194:0/1395346257 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:12.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe089200640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe06c004d40 0x7fe08414dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe083e00640 1 -- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe06c004d40 msgr2=0x7fe08414dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe089c00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe084158700 0x7fe08413d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.557+0000 7fe083e00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe06c004d40 0x7fe08414dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe083e00640 1 -- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe084158700 msgr2=0x7fe08413d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe083e00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe084158700 0x7fe08413d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe083e00640 1 -- 172.21.15.194:0/1395346257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0841eea20 con 0x7fe08414bfc0 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe083e00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d760 tx=0x7fe07000dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:12.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070019070 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700074e0 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0841eecc0 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070004a00 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.558+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0841ef280 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.560+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe084068880 con 0x7fe08414bfc0 2024-03-07T10:21:12.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.560+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe07001c070 con 0x7fe08414bfc0 2024-03-07T10:21:12.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.561+0000 7fe080c00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 0x7fe06406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:12.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.561+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe07008a000 con 0x7fe08414bfc0 2024-03-07T10:21:12.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.562+0000 7fe089200640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 0x7fe06406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:12.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.563+0000 7fe089200640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 0x7fe06406d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe078005540 tx=0x7fe078007c50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:12.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.570+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe070058b80 con 0x7fe08414bfc0 2024-03-07T10:21:12.808 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:12.806+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fe084155680 con 0x7fe08414bfc0 2024-03-07T10:21:13.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.330+0000 7fe080c00640 1 -- 172.21.15.194:0/1395346257 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v15) v1 ==== 110+0+0 (secure 0 0 0) 0x7fe070058480 con 0x7fe08414bfc0 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.333+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 msgr2=0x7fe06406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.333+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 0x7fe06406d990 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe078005540 tx=0x7fe078007c50 comp rx=0 tx=0).stop 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.333+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 msgr2=0x7fe0841581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.333+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe07000d760 tx=0x7fe07000dc20 comp rx=0 tx=0).stop 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 shutdown_connections 2024-03-07T10:21:13.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe06406b4d0 0x7fe06406d990 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe084158700 0x7fe08413d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe08414bfc0 0x7fe0841581c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 --2- 172.21.15.194:0/1395346257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe06c004d40 0x7fe08414dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 >> 172.21.15.194:0/1395346257 conn(0x7fe0840c4a60 msgr2=0x7fe08414f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 shutdown_connections 2024-03-07T10:21:13.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.334+0000 7fe08bc00640 1 -- 172.21.15.194:0/1395346257 wait complete. 2024-03-07T10:21:13.363 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-03-07T10:21:13.363 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:13.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.563+0000 7fc421800640 1 Processor -- start 2024-03-07T10:21:13.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.563+0000 7fc421800640 1 -- start start 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc421800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc41c0c5bc0 0x7fc41c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc421800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc41c152c80 0x7fc41c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc421800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c155b20 con 0x7fc41c1528a0 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc421800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c155dc0 con 0x7fc41c152c80 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc421800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c156080 con 0x7fc41c0c5bc0 2024-03-07T10:21:13.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc420e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc41c152c80 0x7fc41c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.564+0000 7fc413400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc41c1528a0 0x7fc41c06c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60454/0 (socket says 172.21.15.194:60454) 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc413400640 1 -- 172.21.15.194:0/344626912 learned_addr learned my addr 172.21.15.194:0/344626912 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc41be00640 1 --2- 172.21.15.194:0/344626912 >> v2:172.21.15.196:3300/0 conn(0x7fc41c0c5bc0 0x7fc41c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc420e00640 1 -- 172.21.15.194:0/344626912 >> v2:172.21.15.196:3300/0 conn(0x7fc41c0c5bc0 msgr2=0x7fc41c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc420e00640 1 --2- 172.21.15.194:0/344626912 >> v2:172.21.15.196:3300/0 conn(0x7fc41c0c5bc0 0x7fc41c0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc420e00640 1 -- 172.21.15.194:0/344626912 >> v1:172.21.15.194:6789/0 conn(0x7fc41c1528a0 legacy=0x7fc41c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc420e00640 1 -- 172.21.15.194:0/344626912 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c156360 con 0x7fc41c152c80 2024-03-07T10:21:13.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.565+0000 7fc41b400640 1 -- 172.21.15.194:0/344626912 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003363438 0 0) 0x7fc41c155b20 con 0x7fc41c1528a0 2024-03-07T10:21:13.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.566+0000 7fc420e00640 1 --2- 172.21.15.194:0/344626912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c152c80 0x7fc41c06c8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0cbd20 tx=0x7fc41402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd511dd87bcd8f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:13.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.566+0000 7fc41b400640 1 -- 172.21.15.194:0/344626912 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140315a0 con 0x7fc41c152c80 2024-03-07T10:21:13.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.566+0000 7fc41b400640 1 -- 172.21.15.194:0/344626912 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414037070 con 0x7fc41c152c80 2024-03-07T10:21:13.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.566+0000 7fc41b400640 1 -- 172.21.15.194:0/344626912 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414031960 con 0x7fc41c152c80 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 -- 172.21.15.194:0/344626912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c152c80 msgr2=0x7fc41c06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 --2- 172.21.15.194:0/344626912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c152c80 0x7fc41c06c8d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0cbd20 tx=0x7fc41402b840 comp rx=0 tx=0).stop 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 -- 172.21.15.194:0/344626912 shutdown_connections 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 --2- 172.21.15.194:0/344626912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c152c80 0x7fc41c06c8d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 --2- 172.21.15.194:0/344626912 >> v2:172.21.15.196:3300/0 conn(0x7fc41c0c5bc0 0x7fc41c0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 -- 172.21.15.194:0/344626912 >> 172.21.15.194:0/344626912 conn(0x7fc41c0675e0 msgr2=0x7fc41c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 -- 172.21.15.194:0/344626912 shutdown_connections 2024-03-07T10:21:13.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.567+0000 7fc421800640 1 -- 172.21.15.194:0/344626912 wait complete. 2024-03-07T10:21:13.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.569+0000 7fc421800640 1 Processor -- start 2024-03-07T10:21:13.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.569+0000 7fc421800640 1 -- start start 2024-03-07T10:21:13.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc41c0c5bc0 0x7fc41c14e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 0x7fc41c14d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c1530d0 con 0x7fc41c1528a0 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c06ce10 con 0x7fc41c0c5bc0 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc421800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c155730 con 0x7fc41c152c80 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.570+0000 7fc413400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50778/0 (socket says 172.21.15.194:50778) 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 -- 172.21.15.194:0/645028621 learned_addr learned my addr 172.21.15.194:0/645028621 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc41be00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc41c0c5bc0 0x7fc41c14e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc420e00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 0x7fc41c14d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 -- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 msgr2=0x7fc41c14d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 0x7fc41c14d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 -- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc41c0c5bc0 msgr2=0x7fc41c14e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc41c0c5bc0 0x7fc41c14e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 -- 172.21.15.194:0/645028621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c14eb20 con 0x7fc41c1528a0 2024-03-07T10:21:13.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc420e00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 0x7fc41c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:13.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.571+0000 7fc413400640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c500 tx=0x7fc40400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.572+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404018070 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.572+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404007580 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.572+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404004a20 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.572+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c14f070 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.572+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c14ce50 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.573+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c068170 con 0x7fc41c1528a0 2024-03-07T10:21:13.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.574+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc404004bc0 con 0x7fc41c1528a0 2024-03-07T10:21:13.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.575+0000 7fc418c00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 0x7fc3f806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:13.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.575+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fc4040897b0 con 0x7fc41c1528a0 2024-03-07T10:21:13.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.575+0000 7fc41be00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 0x7fc3f806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:13.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.576+0000 7fc41be00640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 0x7fc3f806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a60 tx=0x7fc40c003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:13.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.584+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc404058390 con 0x7fc41c1528a0 2024-03-07T10:21:13.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.814+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc41c06d450 con 0x7fc41c1528a0 2024-03-07T10:21:13.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.815+0000 7fc418c00640 1 -- 172.21.15.194:0/645028621 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7fc404057c90 con 0x7fc41c1528a0 2024-03-07T10:21:13.817 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:13.817 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:13.817 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:13.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 msgr2=0x7fc3f806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 0x7fc3f806d990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc40c009a60 tx=0x7fc40c003990 comp rx=0 tx=0).stop 2024-03-07T10:21:13.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 msgr2=0x7fc41c159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:13.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc40400c500 tx=0x7fc40400c9c0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 shutdown_connections 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc3f806b4d0 0x7fc3f806d990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc41c152c80 0x7fc41c14d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc41c1528a0 0x7fc41c159520 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 --2- 172.21.15.194:0/645028621 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc41c0c5bc0 0x7fc41c14e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 >> 172.21.15.194:0/645028621 conn(0x7fc41c0675e0 msgr2=0x7fc41c154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 shutdown_connections 2024-03-07T10:21:13.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:13.819+0000 7fc421800640 1 -- 172.21.15.194:0/645028621 wait complete. 2024-03-07T10:21:13.845 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:14.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.046+0000 7fd0b4600640 1 Processor -- start 2024-03-07T10:21:14.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.046+0000 7fd0b4600640 1 -- start start 2024-03-07T10:21:14.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.047+0000 7fd0b4600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd0ac157530 0x7fd0ac153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b4600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac06c350 con 0x7fd0ac0abea0 2024-03-07T10:21:14.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b4600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac06c8a0 con 0x7fd0ac150c30 2024-03-07T10:21:14.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b4600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac153760 con 0x7fd0ac157530 2024-03-07T10:21:14.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b2600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd0ac0abea0 0x7fd0ac15deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60466/0 (socket says 172.21.15.194:60466) 2024-03-07T10:21:14.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b2600640 1 -- 172.21.15.194:0/3914811825 learned_addr learned my addr 172.21.15.194:0/3914811825 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:14.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0b1200640 1 --2- 172.21.15.194:0/3914811825 >> v2:172.21.15.196:3300/0 conn(0x7fd0ac157530 0x7fd0ac153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.048+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 880600660 0 0) 0x7fd0ac06c350 con 0x7fd0ac0abea0 2024-03-07T10:21:14.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.049+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd094003520 con 0x7fd0ac0abea0 2024-03-07T10:21:14.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.049+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 355116625 0 0) 0x7fd094003520 con 0x7fd0ac0abea0 2024-03-07T10:21:14.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.049+0000 7fd0b1200640 1 -- 172.21.15.194:0/3914811825 >> v1:172.21.15.196:6789/0 conn(0x7fd0ac150c30 legacy=0x7fd0ac06e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.049+0000 7fd0b1200640 1 -- 172.21.15.194:0/3914811825 >> v1:172.21.15.194:6789/0 conn(0x7fd0ac0abea0 legacy=0x7fd0ac15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.049+0000 7fd0b1200640 1 -- 172.21.15.194:0/3914811825 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac06c5c0 con 0x7fd0ac157530 2024-03-07T10:21:14.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.050+0000 7fd0b1200640 1 --2- 172.21.15.194:0/3914811825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac157530 0x7fd0ac153bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0980097a0 tx=0x7fd09802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b12b62cc6a1bf789 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.050+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd098037070 con 0x7fd0ac157530 2024-03-07T10:21:14.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd098030510 con 0x7fd0ac157530 2024-03-07T10:21:14.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0abe00640 1 -- 172.21.15.194:0/3914811825 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40019f0 con 0x7fd0ac157530 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 -- 172.21.15.194:0/3914811825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac157530 msgr2=0x7fd0ac153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3914811825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac157530 0x7fd0ac153bf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd0980097a0 tx=0x7fd09802b790 comp rx=0 tx=0).stop 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 -- 172.21.15.194:0/3914811825 shutdown_connections 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3914811825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac157530 0x7fd0ac153bf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 -- 172.21.15.194:0/3914811825 >> 172.21.15.194:0/3914811825 conn(0x7fd0ac0a9450 msgr2=0x7fd0ac0a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 -- 172.21.15.194:0/3914811825 shutdown_connections 2024-03-07T10:21:14.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.051+0000 7fd0b4600640 1 -- 172.21.15.194:0/3914811825 wait complete. 2024-03-07T10:21:14.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.053+0000 7fd0b4600640 1 Processor -- start 2024-03-07T10:21:14.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.053+0000 7fd0b4600640 1 -- start start 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 0x7fd0ac0c0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0ac150c30 0x7fd0ac1eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac06eb50 con 0x7fd0ac156880 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac06e9d0 con 0x7fd0ac0abea0 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b4600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac066d90 con 0x7fd0ac150c30 2024-03-07T10:21:14.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50782/0 (socket says 172.21.15.194:50782) 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b2600640 1 -- 172.21.15.194:0/3830201432 learned_addr learned my addr 172.21.15.194:0/3830201432 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b1c00640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 0x7fd0ac0c0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.054+0000 7fd0b1200640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0ac150c30 0x7fd0ac1eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 -- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0ac150c30 msgr2=0x7fd0ac1eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0ac150c30 0x7fd0ac1eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 -- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 msgr2=0x7fd0ac0c0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 0x7fd0ac0c0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 -- 172.21.15.194:0/3830201432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0730b0 con 0x7fd0ac156880 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b1c00640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 0x7fd0ac0c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b2600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400cc70 tx=0x7fd0a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4012400 con 0x7fd0ac156880 2024-03-07T10:21:14.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a40125a0 con 0x7fd0ac156880 2024-03-07T10:21:14.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac1ef590 con 0x7fd0ac156880 2024-03-07T10:21:14.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4012990 con 0x7fd0ac156880 2024-03-07T10:21:14.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.055+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac154920 con 0x7fd0ac156880 2024-03-07T10:21:14.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.057+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac06c090 con 0x7fd0ac156880 2024-03-07T10:21:14.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.058+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd0a4012b30 con 0x7fd0ac156880 2024-03-07T10:21:14.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.058+0000 7fd0a9600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 0x7fd08c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.058+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fd0a408ada0 con 0x7fd0ac156880 2024-03-07T10:21:14.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.059+0000 7fd0b1c00640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 0x7fd08c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.060+0000 7fd0b1c00640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 0x7fd08c06d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.067+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd0a40182b0 con 0x7fd0ac156880 2024-03-07T10:21:14.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.273+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0ac154450 con 0x7fd0ac156880 2024-03-07T10:21:14.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.274+0000 7fd0a9600640 1 -- 172.21.15.194:0/3830201432 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7fd0a40598e0 con 0x7fd0ac156880 2024-03-07T10:21:14.276 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:14.276 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 msgr2=0x7fd08c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 0x7fd08c06d990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd0a0007fd0 tx=0x7fd0a0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 msgr2=0x7fd0ac1eb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd0a400cc70 tx=0x7fd0a400a430 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 shutdown_connections 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd08c06b4d0 0x7fd08c06d990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac156880 0x7fd0ac1eb900 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0ac150c30 0x7fd0ac1eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 --2- 172.21.15.194:0/3830201432 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0ac0abea0 0x7fd0ac0c0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 >> 172.21.15.194:0/3830201432 conn(0x7fd0ac0a9450 msgr2=0x7fd0ac0a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 shutdown_connections 2024-03-07T10:21:14.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.277+0000 7fd0b4600640 1 -- 172.21.15.194:0/3830201432 wait complete. 2024-03-07T10:21:14.299 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-07T10:21:14.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:14.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.506+0000 7f38e3e00640 1 Processor -- start 2024-03-07T10:21:14.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.507+0000 7f38e3e00640 1 -- start start 2024-03-07T10:21:14.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38e41515e0 0x7f38e406d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 0x7f38e406db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38e40c16d0 0x7f38e4151c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e41519c0 con 0x7f38e41515e0 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e40c1420 con 0x7f38e40c16d0 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e3e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40c2890 con 0x7f38e40a5fc0 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.509+0000 7f38e2a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38e41515e0 0x7f38e406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f38e41515e0 0x7f38e406d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50784/0 (socket says 172.21.15.194:50784) 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 -- 172.21.15.194:0/2950447614 learned_addr learned my addr 172.21.15.194:0/2950447614 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:14.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2000640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 0x7f38e406db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e3400640 1 --2- 172.21.15.194:0/2950447614 >> v2:172.21.15.196:3300/0 conn(0x7f38e40c16d0 0x7f38e4151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 -- 172.21.15.194:0/2950447614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 msgr2=0x7f38e406db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 0x7f38e406db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 -- 172.21.15.194:0/2950447614 >> v2:172.21.15.196:3300/0 conn(0x7f38e40c16d0 msgr2=0x7f38e4151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 --2- 172.21.15.194:0/2950447614 >> v2:172.21.15.196:3300/0 conn(0x7f38e40c16d0 0x7f38e4151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2a00640 1 -- 172.21.15.194:0/2950447614 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40c2ae0 con 0x7f38e41515e0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.510+0000 7f38e2000640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 0x7f38e406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.511+0000 7f38e2a00640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e41515e0 0x7f38e406d610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c7d40 tx=0x7f38d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67762ea162078fe8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.511+0000 7f38e1600640 1 -- 172.21.15.194:0/2950447614 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d402e070 con 0x7f38e41515e0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.511+0000 7f38e1600640 1 -- 172.21.15.194:0/2950447614 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4037070 con 0x7f38e41515e0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.511+0000 7f38e1600640 1 -- 172.21.15.194:0/2950447614 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4031a00 con 0x7f38e41515e0 2024-03-07T10:21:14.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 -- 172.21.15.194:0/2950447614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e41515e0 msgr2=0x7f38e406d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e41515e0 0x7f38e406d610 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c7d40 tx=0x7f38d402b880 comp rx=0 tx=0).stop 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 -- 172.21.15.194:0/2950447614 shutdown_connections 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 --2- 172.21.15.194:0/2950447614 >> v2:172.21.15.196:3300/0 conn(0x7f38e40c16d0 0x7f38e4151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e40a5fc0 0x7f38e406db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 --2- 172.21.15.194:0/2950447614 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e41515e0 0x7f38e406d610 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 -- 172.21.15.194:0/2950447614 >> 172.21.15.194:0/2950447614 conn(0x7f38e40c70f0 msgr2=0x7f38e40c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 -- 172.21.15.194:0/2950447614 shutdown_connections 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.512+0000 7f38e3e00640 1 -- 172.21.15.194:0/2950447614 wait complete. 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.514+0000 7f38e3e00640 1 Processor -- start 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.514+0000 7f38e3e00640 1 -- start start 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e41515e0 0x7f38e41ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e41ee930 0x7f38e4143330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40c3380 con 0x7f38e40c16d0 2024-03-07T10:21:14.602 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e40c30a0 con 0x7f38e41ee930 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e3e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e406e090 con 0x7f38e41515e0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50794/0 (socket says 172.21.15.194:50794) 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.515+0000 7f38e2a00640 1 -- 172.21.15.194:0/410448853 learned_addr learned my addr 172.21.15.194:0/410448853 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2000640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e41515e0 0x7f38e41ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e3400640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e41ee930 0x7f38e4143330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 -- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e41515e0 msgr2=0x7f38e41ee3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e41515e0 0x7f38e41ee3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 -- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e41ee930 msgr2=0x7f38e4143330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e41ee930 0x7f38e4143330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 -- 172.21.15.194:0/410448853 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4145c80 con 0x7f38e40c16d0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e2a00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4032880 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d4032a20 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d4032e10 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.516+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e41459a0 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.517+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e41eb230 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.518+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e4068170 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.518+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f38d40453f0 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.519+0000 7f38daa00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 0x7f38c406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.519+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f38d40ac5a0 con 0x7f38e40c16d0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.520+0000 7f38e2000640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 0x7f38c406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.521+0000 7f38e2000640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 0x7f38c406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c02b0 tx=0x7f38d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:14.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.524+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f38d4040070 con 0x7f38e40c16d0 2024-03-07T10:21:14.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.732+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38e40c1fa0 con 0x7f38c406b4d0 2024-03-07T10:21:14.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.772+0000 7f38daa00640 1 -- 172.21.15.194:0/410448853 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490417 (secure 0 0 0) 0x7f38e40c1fa0 con 0x7f38c406b4d0 2024-03-07T10:21:14.776 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:14.783 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:14.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 msgr2=0x7f38c406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 0x7f38c406d990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38e40c02b0 tx=0x7f38d0008040 comp rx=0 tx=0).stop 2024-03-07T10:21:14.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 msgr2=0x7f38e41eba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:14.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f38d4000c00 tx=0x7f38d40046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 shutdown_connections 2024-03-07T10:21:14.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f38c406b4d0 0x7f38c406d990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38e41ee930 0x7f38e4143330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38e41515e0 0x7f38e41ee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 --2- 172.21.15.194:0/410448853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38e40c16d0 0x7f38e41eba30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:14.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 >> 172.21.15.194:0/410448853 conn(0x7f38e40c70f0 msgr2=0x7f38e406cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:14.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 shutdown_connections 2024-03-07T10:21:14.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:14.779+0000 7f38e3e00640 1 -- 172.21.15.194:0/410448853 wait complete. 2024-03-07T10:21:14.800 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-07T10:21:14.416276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":366,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.161824"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681952+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:10.681952+0000","last_peered":"2024-03-07T10:21:10.681952+0000","last_clean":"2024-03-07T10:21:10.681952+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:10.681952+0000","last_undegraded":"2024-03-07T10:21:10.681952+0000","last_fullsized":"2024-03-07T10:21:10.681952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325792+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:10.325792+0000","last_peered":"2024-03-07T10:21:10.325792+0000","last_clean":"2024-03-07T10:21:10.325792+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:10.325792+0000","last_undegraded":"2024-03-07T10:21:10.325792+0000","last_fullsized":"2024-03-07T10:21:10.325792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286432+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:10.286432+0000","last_peered":"2024-03-07T10:21:10.286432+0000","last_clean":"2024-03-07T10:21:10.286432+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:10.286432+0000","last_undegraded":"2024-03-07T10:21:10.286432+0000","last_fullsized":"2024-03-07T10:21:10.286432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284469+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:10.284469+0000","last_peered":"2024-03-07T10:21:10.284469+0000","last_clean":"2024-03-07T10:21:10.284469+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:10.284469+0000","last_undegraded":"2024-03-07T10:21:10.284469+0000","last_fullsized":"2024-03-07T10:21:10.284469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286865+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:10.286865+0000","last_peered":"2024-03-07T10:21:10.286865+0000","last_clean":"2024-03-07T10:21:10.286865+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:10.286865+0000","last_undegraded":"2024-03-07T10:21:10.286865+0000","last_fullsized":"2024-03-07T10:21:10.286865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286551+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:10.286551+0000","last_peered":"2024-03-07T10:21:10.286551+0000","last_clean":"2024-03-07T10:21:10.286551+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:10.286551+0000","last_undegraded":"2024-03-07T10:21:10.286551+0000","last_fullsized":"2024-03-07T10:21:10.286551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325568+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:10.325568+0000","last_peered":"2024-03-07T10:21:10.325568+0000","last_clean":"2024-03-07T10:21:10.325568+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:10.325568+0000","last_undegraded":"2024-03-07T10:21:10.325568+0000","last_fullsized":"2024-03-07T10:21:10.325568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684538+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:10.684538+0000","last_peered":"2024-03-07T10:21:10.684538+0000","last_clean":"2024-03-07T10:21:10.684538+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:10.684538+0000","last_undegraded":"2024-03-07T10:21:10.684538+0000","last_fullsized":"2024-03-07T10:21:10.684538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682332+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:10.682332+0000","last_peered":"2024-03-07T10:21:10.682332+0000","last_clean":"2024-03-07T10:21:10.682332+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:10.682332+0000","last_undegraded":"2024-03-07T10:21:10.682332+0000","last_fullsized":"2024-03-07T10:21:10.682332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685302+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:10.685302+0000","last_peered":"2024-03-07T10:21:10.685302+0000","last_clean":"2024-03-07T10:21:10.685302+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:10.685302+0000","last_undegraded":"2024-03-07T10:21:10.685302+0000","last_fullsized":"2024-03-07T10:21:10.685302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685091+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:10.685091+0000","last_peered":"2024-03-07T10:21:10.685091+0000","last_clean":"2024-03-07T10:21:10.685091+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:10.685091+0000","last_undegraded":"2024-03-07T10:21:10.685091+0000","last_fullsized":"2024-03-07T10:21:10.685091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684372+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:10.684372+0000","last_peered":"2024-03-07T10:21:10.684372+0000","last_clean":"2024-03-07T10:21:10.684372+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:10.684372+0000","last_undegraded":"2024-03-07T10:21:10.684372+0000","last_fullsized":"2024-03-07T10:21:10.684372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684343+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:10.684343+0000","last_peered":"2024-03-07T10:21:10.684343+0000","last_clean":"2024-03-07T10:21:10.684343+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:10.684343+0000","last_undegraded":"2024-03-07T10:21:10.684343+0000","last_fullsized":"2024-03-07T10:21:10.684343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684183+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:10.684183+0000","last_peered":"2024-03-07T10:21:10.684183+0000","last_clean":"2024-03-07T10:21:10.684183+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:10.684183+0000","last_undegraded":"2024-03-07T10:21:10.684183+0000","last_fullsized":"2024-03-07T10:21:10.684183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685884+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:10.685884+0000","last_peered":"2024-03-07T10:21:10.685884+0000","last_clean":"2024-03-07T10:21:10.685884+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:10.685884+0000","last_undegraded":"2024-03-07T10:21:10.685884+0000","last_fullsized":"2024-03-07T10:21:10.685884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684425+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:10.684425+0000","last_peered":"2024-03-07T10:21:10.684425+0000","last_clean":"2024-03-07T10:21:10.684425+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:10.684425+0000","last_undegraded":"2024-03-07T10:21:10.684425+0000","last_fullsized":"2024-03-07T10:21:10.684425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286489+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:10.286489+0000","last_peered":"2024-03-07T10:21:10.286489+0000","last_clean":"2024-03-07T10:21:10.286489+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:10.286489+0000","last_undegraded":"2024-03-07T10:21:10.286489+0000","last_fullsized":"2024-03-07T10:21:10.286489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683354+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:10.683354+0000","last_peered":"2024-03-07T10:21:10.683354+0000","last_clean":"2024-03-07T10:21:10.683354+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:10.683354+0000","last_undegraded":"2024-03-07T10:21:10.683354+0000","last_fullsized":"2024-03-07T10:21:10.683354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684552+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:10.684552+0000","last_peered":"2024-03-07T10:21:10.684552+0000","last_clean":"2024-03-07T10:21:10.684552+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:10.684552+0000","last_undegraded":"2024-03-07T10:21:10.684552+0000","last_fullsized":"2024-03-07T10:21:10.684552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679906+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:10.679906+0000","last_peered":"2024-03-07T10:21:10.679906+0000","last_clean":"2024-03-07T10:21:10.679906+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:10.679906+0000","last_undegraded":"2024-03-07T10:21:10.679906+0000","last_fullsized":"2024-03-07T10:21:10.679906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285306+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:10.285306+0000","last_peered":"2024-03-07T10:21:10.285306+0000","last_clean":"2024-03-07T10:21:10.285306+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:10.285306+0000","last_undegraded":"2024-03-07T10:21:10.285306+0000","last_fullsized":"2024-03-07T10:21:10.285306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288869+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:10.288869+0000","last_peered":"2024-03-07T10:21:10.288869+0000","last_clean":"2024-03-07T10:21:10.288869+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:10.288869+0000","last_undegraded":"2024-03-07T10:21:10.288869+0000","last_fullsized":"2024-03-07T10:21:10.288869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683532+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:10.683532+0000","last_peered":"2024-03-07T10:21:10.683532+0000","last_clean":"2024-03-07T10:21:10.683532+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:10.683532+0000","last_undegraded":"2024-03-07T10:21:10.683532+0000","last_fullsized":"2024-03-07T10:21:10.683532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686187+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:10.686187+0000","last_peered":"2024-03-07T10:21:10.686187+0000","last_clean":"2024-03-07T10:21:10.686187+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:10.686187+0000","last_undegraded":"2024-03-07T10:21:10.686187+0000","last_fullsized":"2024-03-07T10:21:10.686187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284191+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:10.284191+0000","last_peered":"2024-03-07T10:21:10.284191+0000","last_clean":"2024-03-07T10:21:10.284191+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:10.284191+0000","last_undegraded":"2024-03-07T10:21:10.284191+0000","last_fullsized":"2024-03-07T10:21:10.284191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287480+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:10.287480+0000","last_peered":"2024-03-07T10:21:10.287480+0000","last_clean":"2024-03-07T10:21:10.287480+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:10.287480+0000","last_undegraded":"2024-03-07T10:21:10.287480+0000","last_fullsized":"2024-03-07T10:21:10.287480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288170+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:10.288170+0000","last_peered":"2024-03-07T10:21:10.288170+0000","last_clean":"2024-03-07T10:21:10.288170+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:10.288170+0000","last_undegraded":"2024-03-07T10:21:10.288170+0000","last_fullsized":"2024-03-07T10:21:10.288170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686667+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:10.686667+0000","last_peered":"2024-03-07T10:21:10.686667+0000","last_clean":"2024-03-07T10:21:10.686667+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:10.686667+0000","last_undegraded":"2024-03-07T10:21:10.686667+0000","last_fullsized":"2024-03-07T10:21:10.686667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683628+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:10.683628+0000","last_peered":"2024-03-07T10:21:10.683628+0000","last_clean":"2024-03-07T10:21:10.683628+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:10.683628+0000","last_undegraded":"2024-03-07T10:21:10.683628+0000","last_fullsized":"2024-03-07T10:21:10.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682871+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:10.682871+0000","last_peered":"2024-03-07T10:21:10.682871+0000","last_clean":"2024-03-07T10:21:10.682871+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:10.682871+0000","last_undegraded":"2024-03-07T10:21:10.682871+0000","last_fullsized":"2024-03-07T10:21:10.682871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686358+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:10.686358+0000","last_peered":"2024-03-07T10:21:10.686358+0000","last_clean":"2024-03-07T10:21:10.686358+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:10.686358+0000","last_undegraded":"2024-03-07T10:21:10.686358+0000","last_fullsized":"2024-03-07T10:21:10.686358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283827+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:10.283827+0000","last_peered":"2024-03-07T10:21:10.283827+0000","last_clean":"2024-03-07T10:21:10.283827+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:10.283827+0000","last_undegraded":"2024-03-07T10:21:10.283827+0000","last_fullsized":"2024-03-07T10:21:10.283827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325741+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:10.325741+0000","last_peered":"2024-03-07T10:21:10.325741+0000","last_clean":"2024-03-07T10:21:10.325741+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:10.325741+0000","last_undegraded":"2024-03-07T10:21:10.325741+0000","last_fullsized":"2024-03-07T10:21:10.325741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287317+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:10.287317+0000","last_peered":"2024-03-07T10:21:10.287317+0000","last_clean":"2024-03-07T10:21:10.287317+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:10.287317+0000","last_undegraded":"2024-03-07T10:21:10.287317+0000","last_fullsized":"2024-03-07T10:21:10.287317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683398+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:10.683398+0000","last_peered":"2024-03-07T10:21:10.683398+0000","last_clean":"2024-03-07T10:21:10.683398+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:10.683398+0000","last_undegraded":"2024-03-07T10:21:10.683398+0000","last_fullsized":"2024-03-07T10:21:10.683398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682936+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:10.682936+0000","last_peered":"2024-03-07T10:21:10.682936+0000","last_clean":"2024-03-07T10:21:10.682936+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:10.682936+0000","last_undegraded":"2024-03-07T10:21:10.682936+0000","last_fullsized":"2024-03-07T10:21:10.682936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288774+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:10.288774+0000","last_peered":"2024-03-07T10:21:10.288774+0000","last_clean":"2024-03-07T10:21:10.288774+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:10.288774+0000","last_undegraded":"2024-03-07T10:21:10.288774+0000","last_fullsized":"2024-03-07T10:21:10.288774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289710+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:10.289710+0000","last_peered":"2024-03-07T10:21:10.289710+0000","last_clean":"2024-03-07T10:21:10.289710+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:10.289710+0000","last_undegraded":"2024-03-07T10:21:10.289710+0000","last_fullsized":"2024-03-07T10:21:10.289710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283722+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:10.283722+0000","last_peered":"2024-03-07T10:21:10.283722+0000","last_clean":"2024-03-07T10:21:10.283722+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:10.283722+0000","last_undegraded":"2024-03-07T10:21:10.283722+0000","last_fullsized":"2024-03-07T10:21:10.283722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286315+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:10.286315+0000","last_peered":"2024-03-07T10:21:10.286315+0000","last_clean":"2024-03-07T10:21:10.286315+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:10.286315+0000","last_undegraded":"2024-03-07T10:21:10.286315+0000","last_fullsized":"2024-03-07T10:21:10.286315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287699+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:10.287699+0000","last_peered":"2024-03-07T10:21:10.287699+0000","last_clean":"2024-03-07T10:21:10.287699+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:10.287699+0000","last_undegraded":"2024-03-07T10:21:10.287699+0000","last_fullsized":"2024-03-07T10:21:10.287699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685644+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:10.685644+0000","last_peered":"2024-03-07T10:21:10.685644+0000","last_clean":"2024-03-07T10:21:10.685644+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:10.685644+0000","last_undegraded":"2024-03-07T10:21:10.685644+0000","last_fullsized":"2024-03-07T10:21:10.685644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325736+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:10.325736+0000","last_peered":"2024-03-07T10:21:10.325736+0000","last_clean":"2024-03-07T10:21:10.325736+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:10.325736+0000","last_undegraded":"2024-03-07T10:21:10.325736+0000","last_fullsized":"2024-03-07T10:21:10.325736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326342+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:10.326342+0000","last_peered":"2024-03-07T10:21:10.326342+0000","last_clean":"2024-03-07T10:21:10.326342+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:10.326342+0000","last_undegraded":"2024-03-07T10:21:10.326342+0000","last_fullsized":"2024-03-07T10:21:10.326342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685900+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:10.685900+0000","last_peered":"2024-03-07T10:21:10.685900+0000","last_clean":"2024-03-07T10:21:10.685900+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:10.685900+0000","last_undegraded":"2024-03-07T10:21:10.685900+0000","last_fullsized":"2024-03-07T10:21:10.685900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287824+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:10.287824+0000","last_peered":"2024-03-07T10:21:10.287824+0000","last_clean":"2024-03-07T10:21:10.287824+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:10.287824+0000","last_undegraded":"2024-03-07T10:21:10.287824+0000","last_fullsized":"2024-03-07T10:21:10.287824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288576+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:10.288576+0000","last_peered":"2024-03-07T10:21:10.288576+0000","last_clean":"2024-03-07T10:21:10.288576+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:10.288576+0000","last_undegraded":"2024-03-07T10:21:10.288576+0000","last_fullsized":"2024-03-07T10:21:10.288576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325290+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:10.325290+0000","last_peered":"2024-03-07T10:21:10.325290+0000","last_clean":"2024-03-07T10:21:10.325290+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:10.325290+0000","last_undegraded":"2024-03-07T10:21:10.325290+0000","last_fullsized":"2024-03-07T10:21:10.325290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685706+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:10.685706+0000","last_peered":"2024-03-07T10:21:10.685706+0000","last_clean":"2024-03-07T10:21:10.685706+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:10.685706+0000","last_undegraded":"2024-03-07T10:21:10.685706+0000","last_fullsized":"2024-03-07T10:21:10.685706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685126+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:10.685126+0000","last_peered":"2024-03-07T10:21:10.685126+0000","last_clean":"2024-03-07T10:21:10.685126+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:10.685126+0000","last_undegraded":"2024-03-07T10:21:10.685126+0000","last_fullsized":"2024-03-07T10:21:10.685126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287637+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:10.287637+0000","last_peered":"2024-03-07T10:21:10.287637+0000","last_clean":"2024-03-07T10:21:10.287637+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:10.287637+0000","last_undegraded":"2024-03-07T10:21:10.287637+0000","last_fullsized":"2024-03-07T10:21:10.287637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679879+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:10.679879+0000","last_peered":"2024-03-07T10:21:10.679879+0000","last_clean":"2024-03-07T10:21:10.679879+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:10.679879+0000","last_undegraded":"2024-03-07T10:21:10.679879+0000","last_fullsized":"2024-03-07T10:21:10.679879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287054+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:10.287054+0000","last_peered":"2024-03-07T10:21:10.287054+0000","last_clean":"2024-03-07T10:21:10.287054+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:10.287054+0000","last_undegraded":"2024-03-07T10:21:10.287054+0000","last_fullsized":"2024-03-07T10:21:10.287054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679803+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:10.679803+0000","last_peered":"2024-03-07T10:21:10.679803+0000","last_clean":"2024-03-07T10:21:10.679803+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:10.679803+0000","last_undegraded":"2024-03-07T10:21:10.679803+0000","last_fullsized":"2024-03-07T10:21:10.679803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288300+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:10.288300+0000","last_peered":"2024-03-07T10:21:10.288300+0000","last_clean":"2024-03-07T10:21:10.288300+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:10.288300+0000","last_undegraded":"2024-03-07T10:21:10.288300+0000","last_fullsized":"2024-03-07T10:21:10.288300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686885+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:10.686885+0000","last_peered":"2024-03-07T10:21:10.686885+0000","last_clean":"2024-03-07T10:21:10.686885+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:10.686885+0000","last_undegraded":"2024-03-07T10:21:10.686885+0000","last_fullsized":"2024-03-07T10:21:10.686885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324971+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:10.324971+0000","last_peered":"2024-03-07T10:21:10.324971+0000","last_clean":"2024-03-07T10:21:10.324971+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:10.324971+0000","last_undegraded":"2024-03-07T10:21:10.324971+0000","last_fullsized":"2024-03-07T10:21:10.324971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683051+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:10.683051+0000","last_peered":"2024-03-07T10:21:10.683051+0000","last_clean":"2024-03-07T10:21:10.683051+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:10.683051+0000","last_undegraded":"2024-03-07T10:21:10.683051+0000","last_fullsized":"2024-03-07T10:21:10.683051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.328523+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:10.328523+0000","last_peered":"2024-03-07T10:21:10.328523+0000","last_clean":"2024-03-07T10:21:10.328523+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:10.328523+0000","last_undegraded":"2024-03-07T10:21:10.328523+0000","last_fullsized":"2024-03-07T10:21:10.328523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683818+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:10.683818+0000","last_peered":"2024-03-07T10:21:10.683818+0000","last_clean":"2024-03-07T10:21:10.683818+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:10.683818+0000","last_undegraded":"2024-03-07T10:21:10.683818+0000","last_fullsized":"2024-03-07T10:21:10.683818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284681+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:10.284681+0000","last_peered":"2024-03-07T10:21:10.284681+0000","last_clean":"2024-03-07T10:21:10.284681+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:10.284681+0000","last_undegraded":"2024-03-07T10:21:10.284681+0000","last_fullsized":"2024-03-07T10:21:10.284681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684415+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:10.684415+0000","last_peered":"2024-03-07T10:21:10.684415+0000","last_clean":"2024-03-07T10:21:10.684415+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:10.684415+0000","last_undegraded":"2024-03-07T10:21:10.684415+0000","last_fullsized":"2024-03-07T10:21:10.684415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683520+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:10.683520+0000","last_peered":"2024-03-07T10:21:10.683520+0000","last_clean":"2024-03-07T10:21:10.683520+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:10.683520+0000","last_undegraded":"2024-03-07T10:21:10.683520+0000","last_fullsized":"2024-03-07T10:21:10.683520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286588+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:10.286588+0000","last_peered":"2024-03-07T10:21:10.286588+0000","last_clean":"2024-03-07T10:21:10.286588+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:10.286588+0000","last_undegraded":"2024-03-07T10:21:10.286588+0000","last_fullsized":"2024-03-07T10:21:10.286588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681084+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:10.681084+0000","last_peered":"2024-03-07T10:21:10.681084+0000","last_clean":"2024-03-07T10:21:10.681084+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:10.681084+0000","last_undegraded":"2024-03-07T10:21:10.681084+0000","last_fullsized":"2024-03-07T10:21:10.681084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685123+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:10.685123+0000","last_peered":"2024-03-07T10:21:10.685123+0000","last_clean":"2024-03-07T10:21:10.685123+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:10.685123+0000","last_undegraded":"2024-03-07T10:21:10.685123+0000","last_fullsized":"2024-03-07T10:21:10.685123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680116+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:10.680116+0000","last_peered":"2024-03-07T10:21:10.680116+0000","last_clean":"2024-03-07T10:21:10.680116+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:10.680116+0000","last_undegraded":"2024-03-07T10:21:10.680116+0000","last_fullsized":"2024-03-07T10:21:10.680116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286346+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:10.286346+0000","last_peered":"2024-03-07T10:21:10.286346+0000","last_clean":"2024-03-07T10:21:10.286346+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:10.286346+0000","last_undegraded":"2024-03-07T10:21:10.286346+0000","last_fullsized":"2024-03-07T10:21:10.286346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679853+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:10.679853+0000","last_peered":"2024-03-07T10:21:10.679853+0000","last_clean":"2024-03-07T10:21:10.679853+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:10.679853+0000","last_undegraded":"2024-03-07T10:21:10.679853+0000","last_fullsized":"2024-03-07T10:21:10.679853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685331+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:10.685331+0000","last_peered":"2024-03-07T10:21:10.685331+0000","last_clean":"2024-03-07T10:21:10.685331+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:10.685331+0000","last_undegraded":"2024-03-07T10:21:10.685331+0000","last_fullsized":"2024-03-07T10:21:10.685331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288324+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:10.288324+0000","last_peered":"2024-03-07T10:21:10.288324+0000","last_clean":"2024-03-07T10:21:10.288324+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:10.288324+0000","last_undegraded":"2024-03-07T10:21:10.288324+0000","last_fullsized":"2024-03-07T10:21:10.288324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325430+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:10.325430+0000","last_peered":"2024-03-07T10:21:10.325430+0000","last_clean":"2024-03-07T10:21:10.325430+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:10.325430+0000","last_undegraded":"2024-03-07T10:21:10.325430+0000","last_fullsized":"2024-03-07T10:21:10.325430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683114+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:10.683114+0000","last_peered":"2024-03-07T10:21:10.683114+0000","last_clean":"2024-03-07T10:21:10.683114+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:10.683114+0000","last_undegraded":"2024-03-07T10:21:10.683114+0000","last_fullsized":"2024-03-07T10:21:10.683114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686525+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:10.686525+0000","last_peered":"2024-03-07T10:21:10.686525+0000","last_clean":"2024-03-07T10:21:10.686525+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:10.686525+0000","last_undegraded":"2024-03-07T10:21:10.686525+0000","last_fullsized":"2024-03-07T10:21:10.686525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680173+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:10.680173+0000","last_peered":"2024-03-07T10:21:10.680173+0000","last_clean":"2024-03-07T10:21:10.680173+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:10.680173+0000","last_undegraded":"2024-03-07T10:21:10.680173+0000","last_fullsized":"2024-03-07T10:21:10.680173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681801+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:10.681801+0000","last_peered":"2024-03-07T10:21:10.681801+0000","last_clean":"2024-03-07T10:21:10.681801+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:10.681801+0000","last_undegraded":"2024-03-07T10:21:10.681801+0000","last_fullsized":"2024-03-07T10:21:10.681801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679626+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:10.679626+0000","last_peered":"2024-03-07T10:21:10.679626+0000","last_clean":"2024-03-07T10:21:10.679626+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:10.679626+0000","last_undegraded":"2024-03-07T10:21:10.679626+0000","last_fullsized":"2024-03-07T10:21:10.679626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683746+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:10.683746+0000","last_peered":"2024-03-07T10:21:10.683746+0000","last_clean":"2024-03-07T10:21:10.683746+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:10.683746+0000","last_undegraded":"2024-03-07T10:21:10.683746+0000","last_fullsized":"2024-03-07T10:21:10.683746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685507+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:10.685507+0000","last_peered":"2024-03-07T10:21:10.685507+0000","last_clean":"2024-03-07T10:21:10.685507+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:10.685507+0000","last_undegraded":"2024-03-07T10:21:10.685507+0000","last_fullsized":"2024-03-07T10:21:10.685507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683092+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:10.683092+0000","last_peered":"2024-03-07T10:21:10.683092+0000","last_clean":"2024-03-07T10:21:10.683092+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:10.683092+0000","last_undegraded":"2024-03-07T10:21:10.683092+0000","last_fullsized":"2024-03-07T10:21:10.683092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288351+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:10.288351+0000","last_peered":"2024-03-07T10:21:10.288351+0000","last_clean":"2024-03-07T10:21:10.288351+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:10.288351+0000","last_undegraded":"2024-03-07T10:21:10.288351+0000","last_fullsized":"2024-03-07T10:21:10.288351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682905+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:10.682905+0000","last_peered":"2024-03-07T10:21:10.682905+0000","last_clean":"2024-03-07T10:21:10.682905+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:10.682905+0000","last_undegraded":"2024-03-07T10:21:10.682905+0000","last_fullsized":"2024-03-07T10:21:10.682905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679685+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:10.679685+0000","last_peered":"2024-03-07T10:21:10.679685+0000","last_clean":"2024-03-07T10:21:10.679685+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:10.679685+0000","last_undegraded":"2024-03-07T10:21:10.679685+0000","last_fullsized":"2024-03-07T10:21:10.679685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325673+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:10.325673+0000","last_peered":"2024-03-07T10:21:10.325673+0000","last_clean":"2024-03-07T10:21:10.325673+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:10.325673+0000","last_undegraded":"2024-03-07T10:21:10.325673+0000","last_fullsized":"2024-03-07T10:21:10.325673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686280+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:10.686280+0000","last_peered":"2024-03-07T10:21:10.686280+0000","last_clean":"2024-03-07T10:21:10.686280+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:10.686280+0000","last_undegraded":"2024-03-07T10:21:10.686280+0000","last_fullsized":"2024-03-07T10:21:10.686280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285582+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:10.285582+0000","last_peered":"2024-03-07T10:21:10.285582+0000","last_clean":"2024-03-07T10:21:10.285582+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:10.285582+0000","last_undegraded":"2024-03-07T10:21:10.285582+0000","last_fullsized":"2024-03-07T10:21:10.285582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286158+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:10.286158+0000","last_peered":"2024-03-07T10:21:10.286158+0000","last_clean":"2024-03-07T10:21:10.286158+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:10.286158+0000","last_undegraded":"2024-03-07T10:21:10.286158+0000","last_fullsized":"2024-03-07T10:21:10.286158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288602+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:10.288602+0000","last_peered":"2024-03-07T10:21:10.288602+0000","last_clean":"2024-03-07T10:21:10.288602+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:10.288602+0000","last_undegraded":"2024-03-07T10:21:10.288602+0000","last_fullsized":"2024-03-07T10:21:10.288602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685483+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:10.685483+0000","last_peered":"2024-03-07T10:21:10.685483+0000","last_clean":"2024-03-07T10:21:10.685483+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:10.685483+0000","last_undegraded":"2024-03-07T10:21:10.685483+0000","last_fullsized":"2024-03-07T10:21:10.685483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682452+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:10.682452+0000","last_peered":"2024-03-07T10:21:10.682452+0000","last_clean":"2024-03-07T10:21:10.682452+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:10.682452+0000","last_undegraded":"2024-03-07T10:21:10.682452+0000","last_fullsized":"2024-03-07T10:21:10.682452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684988+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:10.684988+0000","last_peered":"2024-03-07T10:21:10.684988+0000","last_clean":"2024-03-07T10:21:10.684988+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:10.684988+0000","last_undegraded":"2024-03-07T10:21:10.684988+0000","last_fullsized":"2024-03-07T10:21:10.684988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285957+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:10.285957+0000","last_peered":"2024-03-07T10:21:10.285957+0000","last_clean":"2024-03-07T10:21:10.285957+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:10.285957+0000","last_undegraded":"2024-03-07T10:21:10.285957+0000","last_fullsized":"2024-03-07T10:21:10.285957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287780+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:10.287780+0000","last_peered":"2024-03-07T10:21:10.287780+0000","last_clean":"2024-03-07T10:21:10.287780+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:10.287780+0000","last_undegraded":"2024-03-07T10:21:10.287780+0000","last_fullsized":"2024-03-07T10:21:10.287780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324945+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:10.324945+0000","last_peered":"2024-03-07T10:21:10.324945+0000","last_clean":"2024-03-07T10:21:10.324945+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:10.324945+0000","last_undegraded":"2024-03-07T10:21:10.324945+0000","last_fullsized":"2024-03-07T10:21:10.324945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326639+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:10.326639+0000","last_peered":"2024-03-07T10:21:10.326639+0000","last_clean":"2024-03-07T10:21:10.326639+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:10.326639+0000","last_undegraded":"2024-03-07T10:21:10.326639+0000","last_fullsized":"2024-03-07T10:21:10.326639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685807+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:10.685807+0000","last_peered":"2024-03-07T10:21:10.685807+0000","last_clean":"2024-03-07T10:21:10.685807+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:10.685807+0000","last_undegraded":"2024-03-07T10:21:10.685807+0000","last_fullsized":"2024-03-07T10:21:10.685807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285236+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:10.285236+0000","last_peered":"2024-03-07T10:21:10.285236+0000","last_clean":"2024-03-07T10:21:10.285236+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:10.285236+0000","last_undegraded":"2024-03-07T10:21:10.285236+0000","last_fullsized":"2024-03-07T10:21:10.285236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684937+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:10.684937+0000","last_peered":"2024-03-07T10:21:10.684937+0000","last_clean":"2024-03-07T10:21:10.684937+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:10.684937+0000","last_undegraded":"2024-03-07T10:21:10.684937+0000","last_fullsized":"2024-03-07T10:21:10.684937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286416+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:10.286416+0000","last_peered":"2024-03-07T10:21:10.286416+0000","last_clean":"2024-03-07T10:21:10.286416+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:10.286416+0000","last_undegraded":"2024-03-07T10:21:10.286416+0000","last_fullsized":"2024-03-07T10:21:10.286416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288375+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:10.288375+0000","last_peered":"2024-03-07T10:21:10.288375+0000","last_clean":"2024-03-07T10:21:10.288375+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:10.288375+0000","last_undegraded":"2024-03-07T10:21:10.288375+0000","last_fullsized":"2024-03-07T10:21:10.288375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288996+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:10.288996+0000","last_peered":"2024-03-07T10:21:10.288996+0000","last_clean":"2024-03-07T10:21:10.288996+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:10.288996+0000","last_undegraded":"2024-03-07T10:21:10.288996+0000","last_fullsized":"2024-03-07T10:21:10.288996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683910+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:10.683910+0000","last_peered":"2024-03-07T10:21:10.683910+0000","last_clean":"2024-03-07T10:21:10.683910+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:10.683910+0000","last_undegraded":"2024-03-07T10:21:10.683910+0000","last_fullsized":"2024-03-07T10:21:10.683910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288186+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:10.288186+0000","last_peered":"2024-03-07T10:21:10.288186+0000","last_clean":"2024-03-07T10:21:10.288186+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:10.288186+0000","last_undegraded":"2024-03-07T10:21:10.288186+0000","last_fullsized":"2024-03-07T10:21:10.288186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687163+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:10.687163+0000","last_peered":"2024-03-07T10:21:10.687163+0000","last_clean":"2024-03-07T10:21:10.687163+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:10.687163+0000","last_undegraded":"2024-03-07T10:21:10.687163+0000","last_fullsized":"2024-03-07T10:21:10.687163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286227+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:10.286227+0000","last_peered":"2024-03-07T10:21:10.286227+0000","last_clean":"2024-03-07T10:21:10.286227+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:10.286227+0000","last_undegraded":"2024-03-07T10:21:10.286227+0000","last_fullsized":"2024-03-07T10:21:10.286227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325604+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:10.325604+0000","last_peered":"2024-03-07T10:21:10.325604+0000","last_clean":"2024-03-07T10:21:10.325604+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:10.325604+0000","last_undegraded":"2024-03-07T10:21:10.325604+0000","last_fullsized":"2024-03-07T10:21:10.325604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686797+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:10.686797+0000","last_peered":"2024-03-07T10:21:10.686797+0000","last_clean":"2024-03-07T10:21:10.686797+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:10.686797+0000","last_undegraded":"2024-03-07T10:21:10.686797+0000","last_fullsized":"2024-03-07T10:21:10.686797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283947+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:10.283947+0000","last_peered":"2024-03-07T10:21:10.283947+0000","last_clean":"2024-03-07T10:21:10.283947+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:10.283947+0000","last_undegraded":"2024-03-07T10:21:10.283947+0000","last_fullsized":"2024-03-07T10:21:10.283947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682584+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:10.682584+0000","last_peered":"2024-03-07T10:21:10.682584+0000","last_clean":"2024-03-07T10:21:10.682584+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:10.682584+0000","last_undegraded":"2024-03-07T10:21:10.682584+0000","last_fullsized":"2024-03-07T10:21:10.682584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686634+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:21:10.686634+0000","last_peered":"2024-03-07T10:21:10.686634+0000","last_clean":"2024-03-07T10:21:10.686634+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:21:10.686634+0000","last_undegraded":"2024-03-07T10:21:10.686634+0000","last_fullsized":"2024-03-07T10:21:10.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287237+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:10.287237+0000","last_peered":"2024-03-07T10:21:10.287237+0000","last_clean":"2024-03-07T10:21:10.287237+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:10.287237+0000","last_undegraded":"2024-03-07T10:21:10.287237+0000","last_fullsized":"2024-03-07T10:21:10.287237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284075+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:10.284075+0000","last_peered":"2024-03-07T10:21:10.284075+0000","last_clean":"2024-03-07T10:21:10.284075+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:10.284075+0000","last_undegraded":"2024-03-07T10:21:10.284075+0000","last_fullsized":"2024-03-07T10:21:10.284075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287179+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:10.287179+0000","last_peered":"2024-03-07T10:21:10.287179+0000","last_clean":"2024-03-07T10:21:10.287179+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:10.287179+0000","last_undegraded":"2024-03-07T10:21:10.287179+0000","last_fullsized":"2024-03-07T10:21:10.287179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326678+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:10.326678+0000","last_peered":"2024-03-07T10:21:10.326678+0000","last_clean":"2024-03-07T10:21:10.326678+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:10.326678+0000","last_undegraded":"2024-03-07T10:21:10.326678+0000","last_fullsized":"2024-03-07T10:21:10.326678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287143+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:10.287143+0000","last_peered":"2024-03-07T10:21:10.287143+0000","last_clean":"2024-03-07T10:21:10.287143+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:10.287143+0000","last_undegraded":"2024-03-07T10:21:10.287143+0000","last_fullsized":"2024-03-07T10:21:10.287143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682184+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:10.682184+0000","last_peered":"2024-03-07T10:21:10.682184+0000","last_clean":"2024-03-07T10:21:10.682184+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:10.682184+0000","last_undegraded":"2024-03-07T10:21:10.682184+0000","last_fullsized":"2024-03-07T10:21:10.682184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325459+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:10.325459+0000","last_peered":"2024-03-07T10:21:10.325459+0000","last_clean":"2024-03-07T10:21:10.325459+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:10.325459+0000","last_undegraded":"2024-03-07T10:21:10.325459+0000","last_fullsized":"2024-03-07T10:21:10.325459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287094+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:10.287094+0000","last_peered":"2024-03-07T10:21:10.287094+0000","last_clean":"2024-03-07T10:21:10.287094+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:10.287094+0000","last_undegraded":"2024-03-07T10:21:10.287094+0000","last_fullsized":"2024-03-07T10:21:10.287094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284128+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:10.284128+0000","last_peered":"2024-03-07T10:21:10.284128+0000","last_clean":"2024-03-07T10:21:10.284128+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:10.284128+0000","last_undegraded":"2024-03-07T10:21:10.284128+0000","last_fullsized":"2024-03-07T10:21:10.284128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284918+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:10.284918+0000","last_peered":"2024-03-07T10:21:10.284918+0000","last_clean":"2024-03-07T10:21:10.284918+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:10.284918+0000","last_undegraded":"2024-03-07T10:21:10.284918+0000","last_fullsized":"2024-03-07T10:21:10.284918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287904+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:10.287904+0000","last_peered":"2024-03-07T10:21:10.287904+0000","last_clean":"2024-03-07T10:21:10.287904+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:10.287904+0000","last_undegraded":"2024-03-07T10:21:10.287904+0000","last_fullsized":"2024-03-07T10:21:10.287904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286516+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:10.286516+0000","last_peered":"2024-03-07T10:21:10.286516+0000","last_clean":"2024-03-07T10:21:10.286516+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:10.286516+0000","last_undegraded":"2024-03-07T10:21:10.286516+0000","last_fullsized":"2024-03-07T10:21:10.286516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326452+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:10.326452+0000","last_peered":"2024-03-07T10:21:10.326452+0000","last_clean":"2024-03-07T10:21:10.326452+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:10.326452+0000","last_undegraded":"2024-03-07T10:21:10.326452+0000","last_fullsized":"2024-03-07T10:21:10.326452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680031+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:10.680031+0000","last_peered":"2024-03-07T10:21:10.680031+0000","last_clean":"2024-03-07T10:21:10.680031+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:10.680031+0000","last_undegraded":"2024-03-07T10:21:10.680031+0000","last_fullsized":"2024-03-07T10:21:10.680031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683202+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:10.683202+0000","last_peered":"2024-03-07T10:21:10.683202+0000","last_clean":"2024-03-07T10:21:10.683202+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:10.683202+0000","last_undegraded":"2024-03-07T10:21:10.683202+0000","last_fullsized":"2024-03-07T10:21:10.683202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285522+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:10.285522+0000","last_peered":"2024-03-07T10:21:10.285522+0000","last_clean":"2024-03-07T10:21:10.285522+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:10.285522+0000","last_undegraded":"2024-03-07T10:21:10.285522+0000","last_fullsized":"2024-03-07T10:21:10.285522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684573+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:10.684573+0000","last_peered":"2024-03-07T10:21:10.684573+0000","last_clean":"2024-03-07T10:21:10.684573+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:10.684573+0000","last_undegraded":"2024-03-07T10:21:10.684573+0000","last_fullsized":"2024-03-07T10:21:10.684573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285803+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:10.285803+0000","last_peered":"2024-03-07T10:21:10.285803+0000","last_clean":"2024-03-07T10:21:10.285803+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:10.285803+0000","last_undegraded":"2024-03-07T10:21:10.285803+0000","last_fullsized":"2024-03-07T10:21:10.285803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286194+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:10.286194+0000","last_peered":"2024-03-07T10:21:10.286194+0000","last_clean":"2024-03-07T10:21:10.286194+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:10.286194+0000","last_undegraded":"2024-03-07T10:21:10.286194+0000","last_fullsized":"2024-03-07T10:21:10.286194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285576+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:10.285576+0000","last_peered":"2024-03-07T10:21:10.285576+0000","last_clean":"2024-03-07T10:21:10.285576+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:10.285576+0000","last_undegraded":"2024-03-07T10:21:10.285576+0000","last_fullsized":"2024-03-07T10:21:10.285576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288264+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:10.288264+0000","last_peered":"2024-03-07T10:21:10.288264+0000","last_clean":"2024-03-07T10:21:10.288264+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:10.288264+0000","last_undegraded":"2024-03-07T10:21:10.288264+0000","last_fullsized":"2024-03-07T10:21:10.288264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679567+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:10.679567+0000","last_peered":"2024-03-07T10:21:10.679567+0000","last_clean":"2024-03-07T10:21:10.679567+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:10.679567+0000","last_undegraded":"2024-03-07T10:21:10.679567+0000","last_fullsized":"2024-03-07T10:21:10.679567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684568+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:10.684568+0000","last_peered":"2024-03-07T10:21:10.684568+0000","last_clean":"2024-03-07T10:21:10.684568+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:10.684568+0000","last_undegraded":"2024-03-07T10:21:10.684568+0000","last_fullsized":"2024-03-07T10:21:10.684568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684863+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:10.684863+0000","last_peered":"2024-03-07T10:21:10.684863+0000","last_clean":"2024-03-07T10:21:10.684863+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:10.684863+0000","last_undegraded":"2024-03-07T10:21:10.684863+0000","last_fullsized":"2024-03-07T10:21:10.684863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287708+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:10.287708+0000","last_peered":"2024-03-07T10:21:10.287708+0000","last_clean":"2024-03-07T10:21:10.287708+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:10.287708+0000","last_undegraded":"2024-03-07T10:21:10.287708+0000","last_fullsized":"2024-03-07T10:21:10.287708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326210+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:10.326210+0000","last_peered":"2024-03-07T10:21:10.326210+0000","last_clean":"2024-03-07T10:21:10.326210+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:10.326210+0000","last_undegraded":"2024-03-07T10:21:10.326210+0000","last_fullsized":"2024-03-07T10:21:10.326210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686265+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:10.686265+0000","last_peered":"2024-03-07T10:21:10.686265+0000","last_clean":"2024-03-07T10:21:10.686265+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:10.686265+0000","last_undegraded":"2024-03-07T10:21:10.686265+0000","last_fullsized":"2024-03-07T10:21:10.686265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287200+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:10.287200+0000","last_peered":"2024-03-07T10:21:10.287200+0000","last_clean":"2024-03-07T10:21:10.287200+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:10.287200+0000","last_undegraded":"2024-03-07T10:21:10.287200+0000","last_fullsized":"2024-03-07T10:21:10.287200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684228+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:10.684228+0000","last_peered":"2024-03-07T10:21:10.684228+0000","last_clean":"2024-03-07T10:21:10.684228+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:10.684228+0000","last_undegraded":"2024-03-07T10:21:10.684228+0000","last_fullsized":"2024-03-07T10:21:10.684228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288057+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:10.288057+0000","last_peered":"2024-03-07T10:21:10.288057+0000","last_clean":"2024-03-07T10:21:10.288057+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:10.288057+0000","last_undegraded":"2024-03-07T10:21:10.288057+0000","last_fullsized":"2024-03-07T10:21:10.288057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682253+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:10.682253+0000","last_peered":"2024-03-07T10:21:10.682253+0000","last_clean":"2024-03-07T10:21:10.682253+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:10.682253+0000","last_undegraded":"2024-03-07T10:21:10.682253+0000","last_fullsized":"2024-03-07T10:21:10.682253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287258+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:10.287258+0000","last_peered":"2024-03-07T10:21:10.287258+0000","last_clean":"2024-03-07T10:21:10.287258+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:10.287258+0000","last_undegraded":"2024-03-07T10:21:10.287258+0000","last_fullsized":"2024-03-07T10:21:10.287258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285886+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:10.285886+0000","last_peered":"2024-03-07T10:21:10.285886+0000","last_clean":"2024-03-07T10:21:10.285886+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:10.285886+0000","last_undegraded":"2024-03-07T10:21:10.285886+0000","last_fullsized":"2024-03-07T10:21:10.285886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289513+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:10.289513+0000","last_peered":"2024-03-07T10:21:10.289513+0000","last_clean":"2024-03-07T10:21:10.289513+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:10.289513+0000","last_undegraded":"2024-03-07T10:21:10.289513+0000","last_fullsized":"2024-03-07T10:21:10.289513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286013+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:10.286013+0000","last_peered":"2024-03-07T10:21:10.286013+0000","last_clean":"2024-03-07T10:21:10.286013+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:10.286013+0000","last_undegraded":"2024-03-07T10:21:10.286013+0000","last_fullsized":"2024-03-07T10:21:10.286013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682028+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:21:10.682028+0000","last_peered":"2024-03-07T10:21:10.682028+0000","last_clean":"2024-03-07T10:21:10.682028+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:21:10.682028+0000","last_undegraded":"2024-03-07T10:21:10.682028+0000","last_fullsized":"2024-03-07T10:21:10.682028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683779+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:10.683779+0000","last_peered":"2024-03-07T10:21:10.683779+0000","last_clean":"2024-03-07T10:21:10.683779+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:10.683779+0000","last_undegraded":"2024-03-07T10:21:10.683779+0000","last_fullsized":"2024-03-07T10:21:10.683779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284741+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:10.284741+0000","last_peered":"2024-03-07T10:21:10.284741+0000","last_clean":"2024-03-07T10:21:10.284741+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:10.284741+0000","last_undegraded":"2024-03-07T10:21:10.284741+0000","last_fullsized":"2024-03-07T10:21:10.284741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679954+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:10.679954+0000","last_peered":"2024-03-07T10:21:10.679954+0000","last_clean":"2024-03-07T10:21:10.679954+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:10.679954+0000","last_undegraded":"2024-03-07T10:21:10.679954+0000","last_fullsized":"2024-03-07T10:21:10.679954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684730+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:21:10.684730+0000","last_peered":"2024-03-07T10:21:10.684730+0000","last_clean":"2024-03-07T10:21:10.684730+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:21:10.684730+0000","last_undegraded":"2024-03-07T10:21:10.684730+0000","last_fullsized":"2024-03-07T10:21:10.684730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285569+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:10.285569+0000","last_peered":"2024-03-07T10:21:10.285569+0000","last_clean":"2024-03-07T10:21:10.285569+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:10.285569+0000","last_undegraded":"2024-03-07T10:21:10.285569+0000","last_fullsized":"2024-03-07T10:21:10.285569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325987+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:10.325987+0000","last_peered":"2024-03-07T10:21:10.325987+0000","last_clean":"2024-03-07T10:21:10.325987+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:10.325987+0000","last_undegraded":"2024-03-07T10:21:10.325987+0000","last_fullsized":"2024-03-07T10:21:10.325987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684286+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:10.684286+0000","last_peered":"2024-03-07T10:21:10.684286+0000","last_clean":"2024-03-07T10:21:10.684286+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:10.684286+0000","last_undegraded":"2024-03-07T10:21:10.684286+0000","last_fullsized":"2024-03-07T10:21:10.684286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286334+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:10.286334+0000","last_peered":"2024-03-07T10:21:10.286334+0000","last_clean":"2024-03-07T10:21:10.286334+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:10.286334+0000","last_undegraded":"2024-03-07T10:21:10.286334+0000","last_fullsized":"2024-03-07T10:21:10.286334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684011+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:10.684011+0000","last_peered":"2024-03-07T10:21:10.684011+0000","last_clean":"2024-03-07T10:21:10.684011+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:10.684011+0000","last_undegraded":"2024-03-07T10:21:10.684011+0000","last_fullsized":"2024-03-07T10:21:10.684011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685485+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:10.685485+0000","last_peered":"2024-03-07T10:21:10.685485+0000","last_clean":"2024-03-07T10:21:10.685485+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:10.685485+0000","last_undegraded":"2024-03-07T10:21:10.685485+0000","last_fullsized":"2024-03-07T10:21:10.685485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683901+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:10.683901+0000","last_peered":"2024-03-07T10:21:10.683901+0000","last_clean":"2024-03-07T10:21:10.683901+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:10.683901+0000","last_undegraded":"2024-03-07T10:21:10.683901+0000","last_fullsized":"2024-03-07T10:21:10.683901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680027+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:10.680027+0000","last_peered":"2024-03-07T10:21:10.680027+0000","last_clean":"2024-03-07T10:21:10.680027+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:10.680027+0000","last_undegraded":"2024-03-07T10:21:10.680027+0000","last_fullsized":"2024-03-07T10:21:10.680027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324794+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:10.324794+0000","last_peered":"2024-03-07T10:21:10.324794+0000","last_clean":"2024-03-07T10:21:10.324794+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:10.324794+0000","last_undegraded":"2024-03-07T10:21:10.324794+0000","last_fullsized":"2024-03-07T10:21:10.324794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687014+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:21:10.687014+0000","last_peered":"2024-03-07T10:21:10.687014+0000","last_clean":"2024-03-07T10:21:10.687014+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:21:10.687014+0000","last_undegraded":"2024-03-07T10:21:10.687014+0000","last_fullsized":"2024-03-07T10:21:10.687014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289400+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:10.289400+0000","last_peered":"2024-03-07T10:21:10.289400+0000","last_clean":"2024-03-07T10:21:10.289400+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:10.289400+0000","last_undegraded":"2024-03-07T10:21:10.289400+0000","last_fullsized":"2024-03-07T10:21:10.289400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681886+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:10.681886+0000","last_peered":"2024-03-07T10:21:10.681886+0000","last_clean":"2024-03-07T10:21:10.681886+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:10.681886+0000","last_undegraded":"2024-03-07T10:21:10.681886+0000","last_fullsized":"2024-03-07T10:21:10.681886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684951+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:10.684951+0000","last_peered":"2024-03-07T10:21:10.684951+0000","last_clean":"2024-03-07T10:21:10.684951+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:10.684951+0000","last_undegraded":"2024-03-07T10:21:10.684951+0000","last_fullsized":"2024-03-07T10:21:10.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684310+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:10.684310+0000","last_peered":"2024-03-07T10:21:10.684310+0000","last_clean":"2024-03-07T10:21:10.684310+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:10.684310+0000","last_undegraded":"2024-03-07T10:21:10.684310+0000","last_fullsized":"2024-03-07T10:21:10.684310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324787+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:10.324787+0000","last_peered":"2024-03-07T10:21:10.324787+0000","last_clean":"2024-03-07T10:21:10.324787+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:10.324787+0000","last_undegraded":"2024-03-07T10:21:10.324787+0000","last_fullsized":"2024-03-07T10:21:10.324787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684852+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:10.684852+0000","last_peered":"2024-03-07T10:21:10.684852+0000","last_clean":"2024-03-07T10:21:10.684852+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:10.684852+0000","last_undegraded":"2024-03-07T10:21:10.684852+0000","last_fullsized":"2024-03-07T10:21:10.684852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285216+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:10.285216+0000","last_peered":"2024-03-07T10:21:10.285216+0000","last_clean":"2024-03-07T10:21:10.285216+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:10.285216+0000","last_undegraded":"2024-03-07T10:21:10.285216+0000","last_fullsized":"2024-03-07T10:21:10.285216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284392+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:10.284392+0000","last_peered":"2024-03-07T10:21:10.284392+0000","last_clean":"2024-03-07T10:21:10.284392+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:10.284392+0000","last_undegraded":"2024-03-07T10:21:10.284392+0000","last_fullsized":"2024-03-07T10:21:10.284392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683772+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:10.683772+0000","last_peered":"2024-03-07T10:21:10.683772+0000","last_clean":"2024-03-07T10:21:10.683772+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:10.683772+0000","last_undegraded":"2024-03-07T10:21:10.683772+0000","last_fullsized":"2024-03-07T10:21:10.683772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680958+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:10.680958+0000","last_peered":"2024-03-07T10:21:10.680958+0000","last_clean":"2024-03-07T10:21:10.680958+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:10.680958+0000","last_undegraded":"2024-03-07T10:21:10.680958+0000","last_fullsized":"2024-03-07T10:21:10.680958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286746+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:10.286746+0000","last_peered":"2024-03-07T10:21:10.286746+0000","last_clean":"2024-03-07T10:21:10.286746+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:10.286746+0000","last_undegraded":"2024-03-07T10:21:10.286746+0000","last_fullsized":"2024-03-07T10:21:10.286746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683414+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:10.683414+0000","last_peered":"2024-03-07T10:21:10.683414+0000","last_clean":"2024-03-07T10:21:10.683414+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:10.683414+0000","last_undegraded":"2024-03-07T10:21:10.683414+0000","last_fullsized":"2024-03-07T10:21:10.683414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287229+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:10.287229+0000","last_peered":"2024-03-07T10:21:10.287229+0000","last_clean":"2024-03-07T10:21:10.287229+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:10.287229+0000","last_undegraded":"2024-03-07T10:21:10.287229+0000","last_fullsized":"2024-03-07T10:21:10.287229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682287+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:10.682287+0000","last_peered":"2024-03-07T10:21:10.682287+0000","last_clean":"2024-03-07T10:21:10.682287+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:10.682287+0000","last_undegraded":"2024-03-07T10:21:10.682287+0000","last_fullsized":"2024-03-07T10:21:10.682287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686299+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:10.686299+0000","last_peered":"2024-03-07T10:21:10.686299+0000","last_clean":"2024-03-07T10:21:10.686299+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:10.686299+0000","last_undegraded":"2024-03-07T10:21:10.686299+0000","last_fullsized":"2024-03-07T10:21:10.686299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285806+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:10.285806+0000","last_peered":"2024-03-07T10:21:10.285806+0000","last_clean":"2024-03-07T10:21:10.285806+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:10.285806+0000","last_undegraded":"2024-03-07T10:21:10.285806+0000","last_fullsized":"2024-03-07T10:21:10.285806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283983+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:10.283983+0000","last_peered":"2024-03-07T10:21:10.283983+0000","last_clean":"2024-03-07T10:21:10.283983+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:10.283983+0000","last_undegraded":"2024-03-07T10:21:10.283983+0000","last_fullsized":"2024-03-07T10:21:10.283983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286880+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:10.286880+0000","last_peered":"2024-03-07T10:21:10.286880+0000","last_clean":"2024-03-07T10:21:10.286880+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:10.286880+0000","last_undegraded":"2024-03-07T10:21:10.286880+0000","last_fullsized":"2024-03-07T10:21:10.286880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682579+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:10.682579+0000","last_peered":"2024-03-07T10:21:10.682579+0000","last_clean":"2024-03-07T10:21:10.682579+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:10.682579+0000","last_undegraded":"2024-03-07T10:21:10.682579+0000","last_fullsized":"2024-03-07T10:21:10.682579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287145+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:10.287145+0000","last_peered":"2024-03-07T10:21:10.287145+0000","last_clean":"2024-03-07T10:21:10.287145+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:10.287145+0000","last_undegraded":"2024-03-07T10:21:10.287145+0000","last_fullsized":"2024-03-07T10:21:10.287145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684595+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:10.684595+0000","last_peered":"2024-03-07T10:21:10.684595+0000","last_clean":"2024-03-07T10:21:10.684595+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:10.684595+0000","last_undegraded":"2024-03-07T10:21:10.684595+0000","last_fullsized":"2024-03-07T10:21:10.684595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685825+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:10.685825+0000","last_peered":"2024-03-07T10:21:10.685825+0000","last_clean":"2024-03-07T10:21:10.685825+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:10.685825+0000","last_undegraded":"2024-03-07T10:21:10.685825+0000","last_fullsized":"2024-03-07T10:21:10.685825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682261+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:10.682261+0000","last_peered":"2024-03-07T10:21:10.682261+0000","last_clean":"2024-03-07T10:21:10.682261+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:10.682261+0000","last_undegraded":"2024-03-07T10:21:10.682261+0000","last_fullsized":"2024-03-07T10:21:10.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284788+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:10.284788+0000","last_peered":"2024-03-07T10:21:10.284788+0000","last_clean":"2024-03-07T10:21:10.284788+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:10.284788+0000","last_undegraded":"2024-03-07T10:21:10.284788+0000","last_fullsized":"2024-03-07T10:21:10.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684796+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:10.684796+0000","last_peered":"2024-03-07T10:21:10.684796+0000","last_clean":"2024-03-07T10:21:10.684796+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:10.684796+0000","last_undegraded":"2024-03-07T10:21:10.684796+0000","last_fullsized":"2024-03-07T10:21:10.684796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679707+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:10.679707+0000","last_peered":"2024-03-07T10:21:10.679707+0000","last_clean":"2024-03-07T10:21:10.679707+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:10.679707+0000","last_undegraded":"2024-03-07T10:21:10.679707+0000","last_fullsized":"2024-03-07T10:21:10.679707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326644+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:10.326644+0000","last_peered":"2024-03-07T10:21:10.326644+0000","last_clean":"2024-03-07T10:21:10.326644+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:10.326644+0000","last_undegraded":"2024-03-07T10:21:10.326644+0000","last_fullsized":"2024-03-07T10:21:10.326644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681923+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:10.681923+0000","last_peered":"2024-03-07T10:21:10.681923+0000","last_clean":"2024-03-07T10:21:10.681923+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:10.681923+0000","last_undegraded":"2024-03-07T10:21:10.681923+0000","last_fullsized":"2024-03-07T10:21:10.681923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289526+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:10.289526+0000","last_peered":"2024-03-07T10:21:10.289526+0000","last_clean":"2024-03-07T10:21:10.289526+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:10.289526+0000","last_undegraded":"2024-03-07T10:21:10.289526+0000","last_fullsized":"2024-03-07T10:21:10.289526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682347+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:10.682347+0000","last_peered":"2024-03-07T10:21:10.682347+0000","last_clean":"2024-03-07T10:21:10.682347+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:10.682347+0000","last_undegraded":"2024-03-07T10:21:10.682347+0000","last_fullsized":"2024-03-07T10:21:10.682347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686295+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:10.686295+0000","last_peered":"2024-03-07T10:21:10.686295+0000","last_clean":"2024-03-07T10:21:10.686295+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:10.686295+0000","last_undegraded":"2024-03-07T10:21:10.686295+0000","last_fullsized":"2024-03-07T10:21:10.686295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:14.810 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:14.906 INFO:tasks.ceph.mds.c.smithi194.stderr:2024-03-07T10:21:14.904+0000 7f9483400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:21:15.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.045+0000 7f40ee800640 1 Processor -- start 2024-03-07T10:21:15.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.046+0000 7f40ee800640 1 -- start start 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f40e80c4130 0x7f40e80c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40e80c2690 0x7f40e80c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e8072b50 con 0x7f40e80c2690 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e8150e70 con 0x7f40e80c4130 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ee800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8071cf0 con 0x7f40e8150a90 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40e80c2690 0x7f40e80c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40e80c2690 0x7f40e80c1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50802/0 (socket says 172.21.15.194:50802) 2024-03-07T10:21:15.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ede00640 1 -- 172.21.15.194:0/2231810720 learned_addr learned my addr 172.21.15.194:0/2231810720 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40ed400640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.047+0000 7f40eca00640 1 --2- 172.21.15.194:0/2231810720 >> v2:172.21.15.196:3300/0 conn(0x7f40e80c4130 0x7f40e80c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.048+0000 7f40ede00640 1 -- 172.21.15.194:0/2231810720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 msgr2=0x7f40e80c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.048+0000 7f40ede00640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e80c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.048+0000 7f40ede00640 1 -- 172.21.15.194:0/2231810720 >> v2:172.21.15.196:3300/0 conn(0x7f40e80c4130 msgr2=0x7f40e80c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.048+0000 7f40ede00640 1 --2- 172.21.15.194:0/2231810720 >> v2:172.21.15.196:3300/0 conn(0x7f40e80c4130 0x7f40e80c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.048+0000 7f40ede00640 1 -- 172.21.15.194:0/2231810720 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80c33b0 con 0x7f40e80c2690 2024-03-07T10:21:15.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.049+0000 7f40ede00640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c2690 0x7f40e80c1c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c6c30 tx=0x7f40e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6b50a6b74de4c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.049+0000 7f40e7e00640 1 -- 172.21.15.194:0/2231810720 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e002ca70 con 0x7f40e80c2690 2024-03-07T10:21:15.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.049+0000 7f40e7e00640 1 -- 172.21.15.194:0/2231810720 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e002cc10 con 0x7f40e80c2690 2024-03-07T10:21:15.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.049+0000 7f40e7e00640 1 -- 172.21.15.194:0/2231810720 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00343f0 con 0x7f40e80c2690 2024-03-07T10:21:15.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 -- 172.21.15.194:0/2231810720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c2690 msgr2=0x7f40e80c1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c2690 0x7f40e80c1c10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40e80c6c30 tx=0x7f40e002bed0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 -- 172.21.15.194:0/2231810720 shutdown_connections 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c2690 0x7f40e80c1c10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 --2- 172.21.15.194:0/2231810720 >> v2:172.21.15.196:3300/0 conn(0x7f40e80c4130 0x7f40e80c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 --2- 172.21.15.194:0/2231810720 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e80c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 -- 172.21.15.194:0/2231810720 >> 172.21.15.194:0/2231810720 conn(0x7f40e80c70f0 msgr2=0x7f40e80c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 -- 172.21.15.194:0/2231810720 shutdown_connections 2024-03-07T10:21:15.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.050+0000 7f40ee800640 1 -- 172.21.15.194:0/2231810720 wait complete. 2024-03-07T10:21:15.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.052+0000 7f40ee800640 1 Processor -- start 2024-03-07T10:21:15.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.052+0000 7f40ee800640 1 -- start start 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e80c2690 0x7f40e80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e81eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8073340 con 0x7f40e80c4130 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8073060 con 0x7f40e80c2690 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ee800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e8071520 con 0x7f40e8150a90 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50804/0 (socket says 172.21.15.194:50804) 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 -- 172.21.15.194:0/563763854 learned_addr learned my addr 172.21.15.194:0/563763854 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:15.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ede00640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e81eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40ed400640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e80c2690 0x7f40e80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 -- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 msgr2=0x7f40e81eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e81eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 -- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e80c2690 msgr2=0x7f40e80abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e80c2690 0x7f40e80abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.053+0000 7f40eca00640 1 -- 172.21.15.194:0/563763854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e806ec10 con 0x7f40e80c4130 2024-03-07T10:21:15.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40eca00640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40d400d800 tx=0x7f40d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400b6c0 con 0x7f40e80c4130 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d4019070 con 0x7f40e80c4130 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e81536b0 con 0x7f40e80c4130 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400ba80 con 0x7f40e80c4130 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.054+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e8153c70 con 0x7f40e80c4130 2024-03-07T10:21:15.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.056+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e8068170 con 0x7f40e80c4130 2024-03-07T10:21:15.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.056+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f40d400bc20 con 0x7f40e80c4130 2024-03-07T10:21:15.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.057+0000 7f40e5600640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 0x7f40c806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.057+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f40d408aa20 con 0x7f40e80c4130 2024-03-07T10:21:15.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.057+0000 7f40ed400640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 0x7f40c806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.059+0000 7f40ed400640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 0x7f40c806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006fd0 tx=0x7f40dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.061+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f40d401c360 con 0x7f40e80c4130 2024-03-07T10:21:15.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.253+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40e80c69f0 con 0x7f40c806b4d0 2024-03-07T10:21:15.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.288+0000 7f40e5600640 1 -- 172.21.15.194:0/563763854 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490417 (secure 0 0 0) 0x7f40e80c69f0 con 0x7f40c806b4d0 2024-03-07T10:21:15.296 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:15.299 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:15.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 msgr2=0x7f40c806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 0x7f40c806d990 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f40dc006fd0 tx=0x7f40dc008040 comp rx=0 tx=0).stop 2024-03-07T10:21:15.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 msgr2=0x7f40e81eaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f40d400d800 tx=0x7f40d400dcc0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 shutdown_connections 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f40c806b4d0 0x7f40c806d990 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f40e8150a90 0x7f40e81eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40e80c4130 0x7f40e81eaf70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 --2- 172.21.15.194:0/563763854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f40e80c2690 0x7f40e80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 >> 172.21.15.194:0/563763854 conn(0x7f40e80c70f0 msgr2=0x7f40e80c74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 shutdown_connections 2024-03-07T10:21:15.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.296+0000 7f40ee800640 1 -- 172.21.15.194:0/563763854 wait complete. 2024-03-07T10:21:15.317 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-03-07T10:21:14.416276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":366,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.161824"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681952+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:10.681952+0000","last_peered":"2024-03-07T10:21:10.681952+0000","last_clean":"2024-03-07T10:21:10.681952+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:10.681952+0000","last_undegraded":"2024-03-07T10:21:10.681952+0000","last_fullsized":"2024-03-07T10:21:10.681952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325792+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:10.325792+0000","last_peered":"2024-03-07T10:21:10.325792+0000","last_clean":"2024-03-07T10:21:10.325792+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:10.325792+0000","last_undegraded":"2024-03-07T10:21:10.325792+0000","last_fullsized":"2024-03-07T10:21:10.325792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286432+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:10.286432+0000","last_peered":"2024-03-07T10:21:10.286432+0000","last_clean":"2024-03-07T10:21:10.286432+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:10.286432+0000","last_undegraded":"2024-03-07T10:21:10.286432+0000","last_fullsized":"2024-03-07T10:21:10.286432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284469+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:10.284469+0000","last_peered":"2024-03-07T10:21:10.284469+0000","last_clean":"2024-03-07T10:21:10.284469+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:10.284469+0000","last_undegraded":"2024-03-07T10:21:10.284469+0000","last_fullsized":"2024-03-07T10:21:10.284469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286865+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:10.286865+0000","last_peered":"2024-03-07T10:21:10.286865+0000","last_clean":"2024-03-07T10:21:10.286865+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:10.286865+0000","last_undegraded":"2024-03-07T10:21:10.286865+0000","last_fullsized":"2024-03-07T10:21:10.286865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286551+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:10.286551+0000","last_peered":"2024-03-07T10:21:10.286551+0000","last_clean":"2024-03-07T10:21:10.286551+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:10.286551+0000","last_undegraded":"2024-03-07T10:21:10.286551+0000","last_fullsized":"2024-03-07T10:21:10.286551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325568+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:10.325568+0000","last_peered":"2024-03-07T10:21:10.325568+0000","last_clean":"2024-03-07T10:21:10.325568+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:10.325568+0000","last_undegraded":"2024-03-07T10:21:10.325568+0000","last_fullsized":"2024-03-07T10:21:10.325568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684538+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:10.684538+0000","last_peered":"2024-03-07T10:21:10.684538+0000","last_clean":"2024-03-07T10:21:10.684538+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:10.684538+0000","last_undegraded":"2024-03-07T10:21:10.684538+0000","last_fullsized":"2024-03-07T10:21:10.684538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682332+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:10.682332+0000","last_peered":"2024-03-07T10:21:10.682332+0000","last_clean":"2024-03-07T10:21:10.682332+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:10.682332+0000","last_undegraded":"2024-03-07T10:21:10.682332+0000","last_fullsized":"2024-03-07T10:21:10.682332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685302+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:10.685302+0000","last_peered":"2024-03-07T10:21:10.685302+0000","last_clean":"2024-03-07T10:21:10.685302+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:10.685302+0000","last_undegraded":"2024-03-07T10:21:10.685302+0000","last_fullsized":"2024-03-07T10:21:10.685302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685091+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:10.685091+0000","last_peered":"2024-03-07T10:21:10.685091+0000","last_clean":"2024-03-07T10:21:10.685091+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:10.685091+0000","last_undegraded":"2024-03-07T10:21:10.685091+0000","last_fullsized":"2024-03-07T10:21:10.685091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684372+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:10.684372+0000","last_peered":"2024-03-07T10:21:10.684372+0000","last_clean":"2024-03-07T10:21:10.684372+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:10.684372+0000","last_undegraded":"2024-03-07T10:21:10.684372+0000","last_fullsized":"2024-03-07T10:21:10.684372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684343+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:10.684343+0000","last_peered":"2024-03-07T10:21:10.684343+0000","last_clean":"2024-03-07T10:21:10.684343+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:10.684343+0000","last_undegraded":"2024-03-07T10:21:10.684343+0000","last_fullsized":"2024-03-07T10:21:10.684343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684183+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:10.684183+0000","last_peered":"2024-03-07T10:21:10.684183+0000","last_clean":"2024-03-07T10:21:10.684183+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:10.684183+0000","last_undegraded":"2024-03-07T10:21:10.684183+0000","last_fullsized":"2024-03-07T10:21:10.684183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685884+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:10.685884+0000","last_peered":"2024-03-07T10:21:10.685884+0000","last_clean":"2024-03-07T10:21:10.685884+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:10.685884+0000","last_undegraded":"2024-03-07T10:21:10.685884+0000","last_fullsized":"2024-03-07T10:21:10.685884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684425+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:10.684425+0000","last_peered":"2024-03-07T10:21:10.684425+0000","last_clean":"2024-03-07T10:21:10.684425+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:10.684425+0000","last_undegraded":"2024-03-07T10:21:10.684425+0000","last_fullsized":"2024-03-07T10:21:10.684425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286489+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:10.286489+0000","last_peered":"2024-03-07T10:21:10.286489+0000","last_clean":"2024-03-07T10:21:10.286489+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:10.286489+0000","last_undegraded":"2024-03-07T10:21:10.286489+0000","last_fullsized":"2024-03-07T10:21:10.286489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683354+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:10.683354+0000","last_peered":"2024-03-07T10:21:10.683354+0000","last_clean":"2024-03-07T10:21:10.683354+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:10.683354+0000","last_undegraded":"2024-03-07T10:21:10.683354+0000","last_fullsized":"2024-03-07T10:21:10.683354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684552+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:10.684552+0000","last_peered":"2024-03-07T10:21:10.684552+0000","last_clean":"2024-03-07T10:21:10.684552+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:10.684552+0000","last_undegraded":"2024-03-07T10:21:10.684552+0000","last_fullsized":"2024-03-07T10:21:10.684552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679906+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:10.679906+0000","last_peered":"2024-03-07T10:21:10.679906+0000","last_clean":"2024-03-07T10:21:10.679906+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:10.679906+0000","last_undegraded":"2024-03-07T10:21:10.679906+0000","last_fullsized":"2024-03-07T10:21:10.679906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285306+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:10.285306+0000","last_peered":"2024-03-07T10:21:10.285306+0000","last_clean":"2024-03-07T10:21:10.285306+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:10.285306+0000","last_undegraded":"2024-03-07T10:21:10.285306+0000","last_fullsized":"2024-03-07T10:21:10.285306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288869+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:10.288869+0000","last_peered":"2024-03-07T10:21:10.288869+0000","last_clean":"2024-03-07T10:21:10.288869+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:10.288869+0000","last_undegraded":"2024-03-07T10:21:10.288869+0000","last_fullsized":"2024-03-07T10:21:10.288869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683532+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:10.683532+0000","last_peered":"2024-03-07T10:21:10.683532+0000","last_clean":"2024-03-07T10:21:10.683532+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:10.683532+0000","last_undegraded":"2024-03-07T10:21:10.683532+0000","last_fullsized":"2024-03-07T10:21:10.683532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686187+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:10.686187+0000","last_peered":"2024-03-07T10:21:10.686187+0000","last_clean":"2024-03-07T10:21:10.686187+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:10.686187+0000","last_undegraded":"2024-03-07T10:21:10.686187+0000","last_fullsized":"2024-03-07T10:21:10.686187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284191+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:10.284191+0000","last_peered":"2024-03-07T10:21:10.284191+0000","last_clean":"2024-03-07T10:21:10.284191+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:10.284191+0000","last_undegraded":"2024-03-07T10:21:10.284191+0000","last_fullsized":"2024-03-07T10:21:10.284191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287480+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:10.287480+0000","last_peered":"2024-03-07T10:21:10.287480+0000","last_clean":"2024-03-07T10:21:10.287480+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:10.287480+0000","last_undegraded":"2024-03-07T10:21:10.287480+0000","last_fullsized":"2024-03-07T10:21:10.287480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288170+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:10.288170+0000","last_peered":"2024-03-07T10:21:10.288170+0000","last_clean":"2024-03-07T10:21:10.288170+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:10.288170+0000","last_undegraded":"2024-03-07T10:21:10.288170+0000","last_fullsized":"2024-03-07T10:21:10.288170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686667+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:10.686667+0000","last_peered":"2024-03-07T10:21:10.686667+0000","last_clean":"2024-03-07T10:21:10.686667+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:10.686667+0000","last_undegraded":"2024-03-07T10:21:10.686667+0000","last_fullsized":"2024-03-07T10:21:10.686667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683628+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:10.683628+0000","last_peered":"2024-03-07T10:21:10.683628+0000","last_clean":"2024-03-07T10:21:10.683628+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:10.683628+0000","last_undegraded":"2024-03-07T10:21:10.683628+0000","last_fullsized":"2024-03-07T10:21:10.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682871+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:10.682871+0000","last_peered":"2024-03-07T10:21:10.682871+0000","last_clean":"2024-03-07T10:21:10.682871+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:10.682871+0000","last_undegraded":"2024-03-07T10:21:10.682871+0000","last_fullsized":"2024-03-07T10:21:10.682871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686358+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:10.686358+0000","last_peered":"2024-03-07T10:21:10.686358+0000","last_clean":"2024-03-07T10:21:10.686358+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:10.686358+0000","last_undegraded":"2024-03-07T10:21:10.686358+0000","last_fullsized":"2024-03-07T10:21:10.686358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283827+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:10.283827+0000","last_peered":"2024-03-07T10:21:10.283827+0000","last_clean":"2024-03-07T10:21:10.283827+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:10.283827+0000","last_undegraded":"2024-03-07T10:21:10.283827+0000","last_fullsized":"2024-03-07T10:21:10.283827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325741+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:10.325741+0000","last_peered":"2024-03-07T10:21:10.325741+0000","last_clean":"2024-03-07T10:21:10.325741+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:10.325741+0000","last_undegraded":"2024-03-07T10:21:10.325741+0000","last_fullsized":"2024-03-07T10:21:10.325741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287317+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:10.287317+0000","last_peered":"2024-03-07T10:21:10.287317+0000","last_clean":"2024-03-07T10:21:10.287317+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:10.287317+0000","last_undegraded":"2024-03-07T10:21:10.287317+0000","last_fullsized":"2024-03-07T10:21:10.287317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683398+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:10.683398+0000","last_peered":"2024-03-07T10:21:10.683398+0000","last_clean":"2024-03-07T10:21:10.683398+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:10.683398+0000","last_undegraded":"2024-03-07T10:21:10.683398+0000","last_fullsized":"2024-03-07T10:21:10.683398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682936+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:10.682936+0000","last_peered":"2024-03-07T10:21:10.682936+0000","last_clean":"2024-03-07T10:21:10.682936+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:10.682936+0000","last_undegraded":"2024-03-07T10:21:10.682936+0000","last_fullsized":"2024-03-07T10:21:10.682936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288774+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:10.288774+0000","last_peered":"2024-03-07T10:21:10.288774+0000","last_clean":"2024-03-07T10:21:10.288774+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:10.288774+0000","last_undegraded":"2024-03-07T10:21:10.288774+0000","last_fullsized":"2024-03-07T10:21:10.288774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289710+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:10.289710+0000","last_peered":"2024-03-07T10:21:10.289710+0000","last_clean":"2024-03-07T10:21:10.289710+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:10.289710+0000","last_undegraded":"2024-03-07T10:21:10.289710+0000","last_fullsized":"2024-03-07T10:21:10.289710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283722+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:10.283722+0000","last_peered":"2024-03-07T10:21:10.283722+0000","last_clean":"2024-03-07T10:21:10.283722+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:10.283722+0000","last_undegraded":"2024-03-07T10:21:10.283722+0000","last_fullsized":"2024-03-07T10:21:10.283722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286315+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:10.286315+0000","last_peered":"2024-03-07T10:21:10.286315+0000","last_clean":"2024-03-07T10:21:10.286315+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:10.286315+0000","last_undegraded":"2024-03-07T10:21:10.286315+0000","last_fullsized":"2024-03-07T10:21:10.286315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287699+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:10.287699+0000","last_peered":"2024-03-07T10:21:10.287699+0000","last_clean":"2024-03-07T10:21:10.287699+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:10.287699+0000","last_undegraded":"2024-03-07T10:21:10.287699+0000","last_fullsized":"2024-03-07T10:21:10.287699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685644+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:10.685644+0000","last_peered":"2024-03-07T10:21:10.685644+0000","last_clean":"2024-03-07T10:21:10.685644+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:10.685644+0000","last_undegraded":"2024-03-07T10:21:10.685644+0000","last_fullsized":"2024-03-07T10:21:10.685644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325736+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:10.325736+0000","last_peered":"2024-03-07T10:21:10.325736+0000","last_clean":"2024-03-07T10:21:10.325736+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:10.325736+0000","last_undegraded":"2024-03-07T10:21:10.325736+0000","last_fullsized":"2024-03-07T10:21:10.325736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326342+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:10.326342+0000","last_peered":"2024-03-07T10:21:10.326342+0000","last_clean":"2024-03-07T10:21:10.326342+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:10.326342+0000","last_undegraded":"2024-03-07T10:21:10.326342+0000","last_fullsized":"2024-03-07T10:21:10.326342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685900+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:10.685900+0000","last_peered":"2024-03-07T10:21:10.685900+0000","last_clean":"2024-03-07T10:21:10.685900+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:10.685900+0000","last_undegraded":"2024-03-07T10:21:10.685900+0000","last_fullsized":"2024-03-07T10:21:10.685900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287824+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:10.287824+0000","last_peered":"2024-03-07T10:21:10.287824+0000","last_clean":"2024-03-07T10:21:10.287824+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:10.287824+0000","last_undegraded":"2024-03-07T10:21:10.287824+0000","last_fullsized":"2024-03-07T10:21:10.287824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288576+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:10.288576+0000","last_peered":"2024-03-07T10:21:10.288576+0000","last_clean":"2024-03-07T10:21:10.288576+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:10.288576+0000","last_undegraded":"2024-03-07T10:21:10.288576+0000","last_fullsized":"2024-03-07T10:21:10.288576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325290+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:10.325290+0000","last_peered":"2024-03-07T10:21:10.325290+0000","last_clean":"2024-03-07T10:21:10.325290+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:10.325290+0000","last_undegraded":"2024-03-07T10:21:10.325290+0000","last_fullsized":"2024-03-07T10:21:10.325290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685706+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:10.685706+0000","last_peered":"2024-03-07T10:21:10.685706+0000","last_clean":"2024-03-07T10:21:10.685706+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:10.685706+0000","last_undegraded":"2024-03-07T10:21:10.685706+0000","last_fullsized":"2024-03-07T10:21:10.685706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685126+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:10.685126+0000","last_peered":"2024-03-07T10:21:10.685126+0000","last_clean":"2024-03-07T10:21:10.685126+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:10.685126+0000","last_undegraded":"2024-03-07T10:21:10.685126+0000","last_fullsized":"2024-03-07T10:21:10.685126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287637+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:10.287637+0000","last_peered":"2024-03-07T10:21:10.287637+0000","last_clean":"2024-03-07T10:21:10.287637+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:10.287637+0000","last_undegraded":"2024-03-07T10:21:10.287637+0000","last_fullsized":"2024-03-07T10:21:10.287637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679879+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:10.679879+0000","last_peered":"2024-03-07T10:21:10.679879+0000","last_clean":"2024-03-07T10:21:10.679879+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:10.679879+0000","last_undegraded":"2024-03-07T10:21:10.679879+0000","last_fullsized":"2024-03-07T10:21:10.679879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287054+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:10.287054+0000","last_peered":"2024-03-07T10:21:10.287054+0000","last_clean":"2024-03-07T10:21:10.287054+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:10.287054+0000","last_undegraded":"2024-03-07T10:21:10.287054+0000","last_fullsized":"2024-03-07T10:21:10.287054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679803+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:10.679803+0000","last_peered":"2024-03-07T10:21:10.679803+0000","last_clean":"2024-03-07T10:21:10.679803+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:10.679803+0000","last_undegraded":"2024-03-07T10:21:10.679803+0000","last_fullsized":"2024-03-07T10:21:10.679803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288300+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:10.288300+0000","last_peered":"2024-03-07T10:21:10.288300+0000","last_clean":"2024-03-07T10:21:10.288300+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:10.288300+0000","last_undegraded":"2024-03-07T10:21:10.288300+0000","last_fullsized":"2024-03-07T10:21:10.288300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686885+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:10.686885+0000","last_peered":"2024-03-07T10:21:10.686885+0000","last_clean":"2024-03-07T10:21:10.686885+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:10.686885+0000","last_undegraded":"2024-03-07T10:21:10.686885+0000","last_fullsized":"2024-03-07T10:21:10.686885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324971+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:10.324971+0000","last_peered":"2024-03-07T10:21:10.324971+0000","last_clean":"2024-03-07T10:21:10.324971+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:10.324971+0000","last_undegraded":"2024-03-07T10:21:10.324971+0000","last_fullsized":"2024-03-07T10:21:10.324971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683051+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:10.683051+0000","last_peered":"2024-03-07T10:21:10.683051+0000","last_clean":"2024-03-07T10:21:10.683051+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:10.683051+0000","last_undegraded":"2024-03-07T10:21:10.683051+0000","last_fullsized":"2024-03-07T10:21:10.683051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.328523+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:10.328523+0000","last_peered":"2024-03-07T10:21:10.328523+0000","last_clean":"2024-03-07T10:21:10.328523+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:10.328523+0000","last_undegraded":"2024-03-07T10:21:10.328523+0000","last_fullsized":"2024-03-07T10:21:10.328523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683818+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:10.683818+0000","last_peered":"2024-03-07T10:21:10.683818+0000","last_clean":"2024-03-07T10:21:10.683818+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:10.683818+0000","last_undegraded":"2024-03-07T10:21:10.683818+0000","last_fullsized":"2024-03-07T10:21:10.683818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284681+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:10.284681+0000","last_peered":"2024-03-07T10:21:10.284681+0000","last_clean":"2024-03-07T10:21:10.284681+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:10.284681+0000","last_undegraded":"2024-03-07T10:21:10.284681+0000","last_fullsized":"2024-03-07T10:21:10.284681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684415+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:10.684415+0000","last_peered":"2024-03-07T10:21:10.684415+0000","last_clean":"2024-03-07T10:21:10.684415+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:10.684415+0000","last_undegraded":"2024-03-07T10:21:10.684415+0000","last_fullsized":"2024-03-07T10:21:10.684415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683520+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:10.683520+0000","last_peered":"2024-03-07T10:21:10.683520+0000","last_clean":"2024-03-07T10:21:10.683520+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:10.683520+0000","last_undegraded":"2024-03-07T10:21:10.683520+0000","last_fullsized":"2024-03-07T10:21:10.683520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286588+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:10.286588+0000","last_peered":"2024-03-07T10:21:10.286588+0000","last_clean":"2024-03-07T10:21:10.286588+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:10.286588+0000","last_undegraded":"2024-03-07T10:21:10.286588+0000","last_fullsized":"2024-03-07T10:21:10.286588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681084+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:10.681084+0000","last_peered":"2024-03-07T10:21:10.681084+0000","last_clean":"2024-03-07T10:21:10.681084+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:10.681084+0000","last_undegraded":"2024-03-07T10:21:10.681084+0000","last_fullsized":"2024-03-07T10:21:10.681084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685123+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:10.685123+0000","last_peered":"2024-03-07T10:21:10.685123+0000","last_clean":"2024-03-07T10:21:10.685123+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:10.685123+0000","last_undegraded":"2024-03-07T10:21:10.685123+0000","last_fullsized":"2024-03-07T10:21:10.685123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680116+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:10.680116+0000","last_peered":"2024-03-07T10:21:10.680116+0000","last_clean":"2024-03-07T10:21:10.680116+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:10.680116+0000","last_undegraded":"2024-03-07T10:21:10.680116+0000","last_fullsized":"2024-03-07T10:21:10.680116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286346+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:10.286346+0000","last_peered":"2024-03-07T10:21:10.286346+0000","last_clean":"2024-03-07T10:21:10.286346+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:10.286346+0000","last_undegraded":"2024-03-07T10:21:10.286346+0000","last_fullsized":"2024-03-07T10:21:10.286346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679853+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:10.679853+0000","last_peered":"2024-03-07T10:21:10.679853+0000","last_clean":"2024-03-07T10:21:10.679853+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:10.679853+0000","last_undegraded":"2024-03-07T10:21:10.679853+0000","last_fullsized":"2024-03-07T10:21:10.679853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685331+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:10.685331+0000","last_peered":"2024-03-07T10:21:10.685331+0000","last_clean":"2024-03-07T10:21:10.685331+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:10.685331+0000","last_undegraded":"2024-03-07T10:21:10.685331+0000","last_fullsized":"2024-03-07T10:21:10.685331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288324+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:10.288324+0000","last_peered":"2024-03-07T10:21:10.288324+0000","last_clean":"2024-03-07T10:21:10.288324+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:10.288324+0000","last_undegraded":"2024-03-07T10:21:10.288324+0000","last_fullsized":"2024-03-07T10:21:10.288324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325430+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:10.325430+0000","last_peered":"2024-03-07T10:21:10.325430+0000","last_clean":"2024-03-07T10:21:10.325430+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:10.325430+0000","last_undegraded":"2024-03-07T10:21:10.325430+0000","last_fullsized":"2024-03-07T10:21:10.325430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683114+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:10.683114+0000","last_peered":"2024-03-07T10:21:10.683114+0000","last_clean":"2024-03-07T10:21:10.683114+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:10.683114+0000","last_undegraded":"2024-03-07T10:21:10.683114+0000","last_fullsized":"2024-03-07T10:21:10.683114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686525+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:10.686525+0000","last_peered":"2024-03-07T10:21:10.686525+0000","last_clean":"2024-03-07T10:21:10.686525+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:10.686525+0000","last_undegraded":"2024-03-07T10:21:10.686525+0000","last_fullsized":"2024-03-07T10:21:10.686525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680173+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:10.680173+0000","last_peered":"2024-03-07T10:21:10.680173+0000","last_clean":"2024-03-07T10:21:10.680173+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:10.680173+0000","last_undegraded":"2024-03-07T10:21:10.680173+0000","last_fullsized":"2024-03-07T10:21:10.680173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681801+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:10.681801+0000","last_peered":"2024-03-07T10:21:10.681801+0000","last_clean":"2024-03-07T10:21:10.681801+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:10.681801+0000","last_undegraded":"2024-03-07T10:21:10.681801+0000","last_fullsized":"2024-03-07T10:21:10.681801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679626+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:10.679626+0000","last_peered":"2024-03-07T10:21:10.679626+0000","last_clean":"2024-03-07T10:21:10.679626+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:10.679626+0000","last_undegraded":"2024-03-07T10:21:10.679626+0000","last_fullsized":"2024-03-07T10:21:10.679626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683746+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:10.683746+0000","last_peered":"2024-03-07T10:21:10.683746+0000","last_clean":"2024-03-07T10:21:10.683746+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:10.683746+0000","last_undegraded":"2024-03-07T10:21:10.683746+0000","last_fullsized":"2024-03-07T10:21:10.683746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685507+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:10.685507+0000","last_peered":"2024-03-07T10:21:10.685507+0000","last_clean":"2024-03-07T10:21:10.685507+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:10.685507+0000","last_undegraded":"2024-03-07T10:21:10.685507+0000","last_fullsized":"2024-03-07T10:21:10.685507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683092+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:10.683092+0000","last_peered":"2024-03-07T10:21:10.683092+0000","last_clean":"2024-03-07T10:21:10.683092+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:10.683092+0000","last_undegraded":"2024-03-07T10:21:10.683092+0000","last_fullsized":"2024-03-07T10:21:10.683092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288351+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:10.288351+0000","last_peered":"2024-03-07T10:21:10.288351+0000","last_clean":"2024-03-07T10:21:10.288351+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:10.288351+0000","last_undegraded":"2024-03-07T10:21:10.288351+0000","last_fullsized":"2024-03-07T10:21:10.288351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682905+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:10.682905+0000","last_peered":"2024-03-07T10:21:10.682905+0000","last_clean":"2024-03-07T10:21:10.682905+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:10.682905+0000","last_undegraded":"2024-03-07T10:21:10.682905+0000","last_fullsized":"2024-03-07T10:21:10.682905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679685+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:10.679685+0000","last_peered":"2024-03-07T10:21:10.679685+0000","last_clean":"2024-03-07T10:21:10.679685+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:10.679685+0000","last_undegraded":"2024-03-07T10:21:10.679685+0000","last_fullsized":"2024-03-07T10:21:10.679685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325673+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:10.325673+0000","last_peered":"2024-03-07T10:21:10.325673+0000","last_clean":"2024-03-07T10:21:10.325673+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:10.325673+0000","last_undegraded":"2024-03-07T10:21:10.325673+0000","last_fullsized":"2024-03-07T10:21:10.325673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686280+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:10.686280+0000","last_peered":"2024-03-07T10:21:10.686280+0000","last_clean":"2024-03-07T10:21:10.686280+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:10.686280+0000","last_undegraded":"2024-03-07T10:21:10.686280+0000","last_fullsized":"2024-03-07T10:21:10.686280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285582+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:10.285582+0000","last_peered":"2024-03-07T10:21:10.285582+0000","last_clean":"2024-03-07T10:21:10.285582+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:10.285582+0000","last_undegraded":"2024-03-07T10:21:10.285582+0000","last_fullsized":"2024-03-07T10:21:10.285582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286158+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:10.286158+0000","last_peered":"2024-03-07T10:21:10.286158+0000","last_clean":"2024-03-07T10:21:10.286158+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:10.286158+0000","last_undegraded":"2024-03-07T10:21:10.286158+0000","last_fullsized":"2024-03-07T10:21:10.286158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288602+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:10.288602+0000","last_peered":"2024-03-07T10:21:10.288602+0000","last_clean":"2024-03-07T10:21:10.288602+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:10.288602+0000","last_undegraded":"2024-03-07T10:21:10.288602+0000","last_fullsized":"2024-03-07T10:21:10.288602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685483+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:10.685483+0000","last_peered":"2024-03-07T10:21:10.685483+0000","last_clean":"2024-03-07T10:21:10.685483+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:10.685483+0000","last_undegraded":"2024-03-07T10:21:10.685483+0000","last_fullsized":"2024-03-07T10:21:10.685483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682452+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:10.682452+0000","last_peered":"2024-03-07T10:21:10.682452+0000","last_clean":"2024-03-07T10:21:10.682452+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:10.682452+0000","last_undegraded":"2024-03-07T10:21:10.682452+0000","last_fullsized":"2024-03-07T10:21:10.682452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684988+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:10.684988+0000","last_peered":"2024-03-07T10:21:10.684988+0000","last_clean":"2024-03-07T10:21:10.684988+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:10.684988+0000","last_undegraded":"2024-03-07T10:21:10.684988+0000","last_fullsized":"2024-03-07T10:21:10.684988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285957+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:10.285957+0000","last_peered":"2024-03-07T10:21:10.285957+0000","last_clean":"2024-03-07T10:21:10.285957+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:10.285957+0000","last_undegraded":"2024-03-07T10:21:10.285957+0000","last_fullsized":"2024-03-07T10:21:10.285957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287780+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:10.287780+0000","last_peered":"2024-03-07T10:21:10.287780+0000","last_clean":"2024-03-07T10:21:10.287780+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:10.287780+0000","last_undegraded":"2024-03-07T10:21:10.287780+0000","last_fullsized":"2024-03-07T10:21:10.287780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324945+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:10.324945+0000","last_peered":"2024-03-07T10:21:10.324945+0000","last_clean":"2024-03-07T10:21:10.324945+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:10.324945+0000","last_undegraded":"2024-03-07T10:21:10.324945+0000","last_fullsized":"2024-03-07T10:21:10.324945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326639+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:10.326639+0000","last_peered":"2024-03-07T10:21:10.326639+0000","last_clean":"2024-03-07T10:21:10.326639+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:10.326639+0000","last_undegraded":"2024-03-07T10:21:10.326639+0000","last_fullsized":"2024-03-07T10:21:10.326639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685807+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:10.685807+0000","last_peered":"2024-03-07T10:21:10.685807+0000","last_clean":"2024-03-07T10:21:10.685807+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:10.685807+0000","last_undegraded":"2024-03-07T10:21:10.685807+0000","last_fullsized":"2024-03-07T10:21:10.685807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285236+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:10.285236+0000","last_peered":"2024-03-07T10:21:10.285236+0000","last_clean":"2024-03-07T10:21:10.285236+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:10.285236+0000","last_undegraded":"2024-03-07T10:21:10.285236+0000","last_fullsized":"2024-03-07T10:21:10.285236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684937+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:10.684937+0000","last_peered":"2024-03-07T10:21:10.684937+0000","last_clean":"2024-03-07T10:21:10.684937+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:10.684937+0000","last_undegraded":"2024-03-07T10:21:10.684937+0000","last_fullsized":"2024-03-07T10:21:10.684937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286416+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:10.286416+0000","last_peered":"2024-03-07T10:21:10.286416+0000","last_clean":"2024-03-07T10:21:10.286416+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:10.286416+0000","last_undegraded":"2024-03-07T10:21:10.286416+0000","last_fullsized":"2024-03-07T10:21:10.286416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288375+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:10.288375+0000","last_peered":"2024-03-07T10:21:10.288375+0000","last_clean":"2024-03-07T10:21:10.288375+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:10.288375+0000","last_undegraded":"2024-03-07T10:21:10.288375+0000","last_fullsized":"2024-03-07T10:21:10.288375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288996+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:10.288996+0000","last_peered":"2024-03-07T10:21:10.288996+0000","last_clean":"2024-03-07T10:21:10.288996+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:10.288996+0000","last_undegraded":"2024-03-07T10:21:10.288996+0000","last_fullsized":"2024-03-07T10:21:10.288996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683910+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:10.683910+0000","last_peered":"2024-03-07T10:21:10.683910+0000","last_clean":"2024-03-07T10:21:10.683910+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:10.683910+0000","last_undegraded":"2024-03-07T10:21:10.683910+0000","last_fullsized":"2024-03-07T10:21:10.683910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288186+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:10.288186+0000","last_peered":"2024-03-07T10:21:10.288186+0000","last_clean":"2024-03-07T10:21:10.288186+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:10.288186+0000","last_undegraded":"2024-03-07T10:21:10.288186+0000","last_fullsized":"2024-03-07T10:21:10.288186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687163+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:10.687163+0000","last_peered":"2024-03-07T10:21:10.687163+0000","last_clean":"2024-03-07T10:21:10.687163+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:10.687163+0000","last_undegraded":"2024-03-07T10:21:10.687163+0000","last_fullsized":"2024-03-07T10:21:10.687163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286227+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:10.286227+0000","last_peered":"2024-03-07T10:21:10.286227+0000","last_clean":"2024-03-07T10:21:10.286227+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:10.286227+0000","last_undegraded":"2024-03-07T10:21:10.286227+0000","last_fullsized":"2024-03-07T10:21:10.286227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325604+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:10.325604+0000","last_peered":"2024-03-07T10:21:10.325604+0000","last_clean":"2024-03-07T10:21:10.325604+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:10.325604+0000","last_undegraded":"2024-03-07T10:21:10.325604+0000","last_fullsized":"2024-03-07T10:21:10.325604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686797+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:10.686797+0000","last_peered":"2024-03-07T10:21:10.686797+0000","last_clean":"2024-03-07T10:21:10.686797+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:10.686797+0000","last_undegraded":"2024-03-07T10:21:10.686797+0000","last_fullsized":"2024-03-07T10:21:10.686797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283947+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:10.283947+0000","last_peered":"2024-03-07T10:21:10.283947+0000","last_clean":"2024-03-07T10:21:10.283947+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:10.283947+0000","last_undegraded":"2024-03-07T10:21:10.283947+0000","last_fullsized":"2024-03-07T10:21:10.283947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682584+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:10.682584+0000","last_peered":"2024-03-07T10:21:10.682584+0000","last_clean":"2024-03-07T10:21:10.682584+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:10.682584+0000","last_undegraded":"2024-03-07T10:21:10.682584+0000","last_fullsized":"2024-03-07T10:21:10.682584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686634+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:21:10.686634+0000","last_peered":"2024-03-07T10:21:10.686634+0000","last_clean":"2024-03-07T10:21:10.686634+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:21:10.686634+0000","last_undegraded":"2024-03-07T10:21:10.686634+0000","last_fullsized":"2024-03-07T10:21:10.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287237+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:10.287237+0000","last_peered":"2024-03-07T10:21:10.287237+0000","last_clean":"2024-03-07T10:21:10.287237+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:10.287237+0000","last_undegraded":"2024-03-07T10:21:10.287237+0000","last_fullsized":"2024-03-07T10:21:10.287237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284075+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:10.284075+0000","last_peered":"2024-03-07T10:21:10.284075+0000","last_clean":"2024-03-07T10:21:10.284075+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:10.284075+0000","last_undegraded":"2024-03-07T10:21:10.284075+0000","last_fullsized":"2024-03-07T10:21:10.284075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287179+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:10.287179+0000","last_peered":"2024-03-07T10:21:10.287179+0000","last_clean":"2024-03-07T10:21:10.287179+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:10.287179+0000","last_undegraded":"2024-03-07T10:21:10.287179+0000","last_fullsized":"2024-03-07T10:21:10.287179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326678+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:10.326678+0000","last_peered":"2024-03-07T10:21:10.326678+0000","last_clean":"2024-03-07T10:21:10.326678+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:10.326678+0000","last_undegraded":"2024-03-07T10:21:10.326678+0000","last_fullsized":"2024-03-07T10:21:10.326678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287143+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:10.287143+0000","last_peered":"2024-03-07T10:21:10.287143+0000","last_clean":"2024-03-07T10:21:10.287143+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:10.287143+0000","last_undegraded":"2024-03-07T10:21:10.287143+0000","last_fullsized":"2024-03-07T10:21:10.287143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682184+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:10.682184+0000","last_peered":"2024-03-07T10:21:10.682184+0000","last_clean":"2024-03-07T10:21:10.682184+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:10.682184+0000","last_undegraded":"2024-03-07T10:21:10.682184+0000","last_fullsized":"2024-03-07T10:21:10.682184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325459+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:10.325459+0000","last_peered":"2024-03-07T10:21:10.325459+0000","last_clean":"2024-03-07T10:21:10.325459+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:10.325459+0000","last_undegraded":"2024-03-07T10:21:10.325459+0000","last_fullsized":"2024-03-07T10:21:10.325459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287094+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:10.287094+0000","last_peered":"2024-03-07T10:21:10.287094+0000","last_clean":"2024-03-07T10:21:10.287094+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:10.287094+0000","last_undegraded":"2024-03-07T10:21:10.287094+0000","last_fullsized":"2024-03-07T10:21:10.287094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284128+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:10.284128+0000","last_peered":"2024-03-07T10:21:10.284128+0000","last_clean":"2024-03-07T10:21:10.284128+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:10.284128+0000","last_undegraded":"2024-03-07T10:21:10.284128+0000","last_fullsized":"2024-03-07T10:21:10.284128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284918+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:10.284918+0000","last_peered":"2024-03-07T10:21:10.284918+0000","last_clean":"2024-03-07T10:21:10.284918+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:10.284918+0000","last_undegraded":"2024-03-07T10:21:10.284918+0000","last_fullsized":"2024-03-07T10:21:10.284918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287904+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:10.287904+0000","last_peered":"2024-03-07T10:21:10.287904+0000","last_clean":"2024-03-07T10:21:10.287904+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:10.287904+0000","last_undegraded":"2024-03-07T10:21:10.287904+0000","last_fullsized":"2024-03-07T10:21:10.287904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286516+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:10.286516+0000","last_peered":"2024-03-07T10:21:10.286516+0000","last_clean":"2024-03-07T10:21:10.286516+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:10.286516+0000","last_undegraded":"2024-03-07T10:21:10.286516+0000","last_fullsized":"2024-03-07T10:21:10.286516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326452+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:10.326452+0000","last_peered":"2024-03-07T10:21:10.326452+0000","last_clean":"2024-03-07T10:21:10.326452+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:10.326452+0000","last_undegraded":"2024-03-07T10:21:10.326452+0000","last_fullsized":"2024-03-07T10:21:10.326452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680031+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:10.680031+0000","last_peered":"2024-03-07T10:21:10.680031+0000","last_clean":"2024-03-07T10:21:10.680031+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:10.680031+0000","last_undegraded":"2024-03-07T10:21:10.680031+0000","last_fullsized":"2024-03-07T10:21:10.680031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683202+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:10.683202+0000","last_peered":"2024-03-07T10:21:10.683202+0000","last_clean":"2024-03-07T10:21:10.683202+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:10.683202+0000","last_undegraded":"2024-03-07T10:21:10.683202+0000","last_fullsized":"2024-03-07T10:21:10.683202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285522+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:10.285522+0000","last_peered":"2024-03-07T10:21:10.285522+0000","last_clean":"2024-03-07T10:21:10.285522+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:10.285522+0000","last_undegraded":"2024-03-07T10:21:10.285522+0000","last_fullsized":"2024-03-07T10:21:10.285522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684573+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:10.684573+0000","last_peered":"2024-03-07T10:21:10.684573+0000","last_clean":"2024-03-07T10:21:10.684573+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:10.684573+0000","last_undegraded":"2024-03-07T10:21:10.684573+0000","last_fullsized":"2024-03-07T10:21:10.684573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285803+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:10.285803+0000","last_peered":"2024-03-07T10:21:10.285803+0000","last_clean":"2024-03-07T10:21:10.285803+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:10.285803+0000","last_undegraded":"2024-03-07T10:21:10.285803+0000","last_fullsized":"2024-03-07T10:21:10.285803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286194+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:10.286194+0000","last_peered":"2024-03-07T10:21:10.286194+0000","last_clean":"2024-03-07T10:21:10.286194+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:10.286194+0000","last_undegraded":"2024-03-07T10:21:10.286194+0000","last_fullsized":"2024-03-07T10:21:10.286194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285576+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:10.285576+0000","last_peered":"2024-03-07T10:21:10.285576+0000","last_clean":"2024-03-07T10:21:10.285576+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:10.285576+0000","last_undegraded":"2024-03-07T10:21:10.285576+0000","last_fullsized":"2024-03-07T10:21:10.285576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288264+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:10.288264+0000","last_peered":"2024-03-07T10:21:10.288264+0000","last_clean":"2024-03-07T10:21:10.288264+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:10.288264+0000","last_undegraded":"2024-03-07T10:21:10.288264+0000","last_fullsized":"2024-03-07T10:21:10.288264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679567+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:10.679567+0000","last_peered":"2024-03-07T10:21:10.679567+0000","last_clean":"2024-03-07T10:21:10.679567+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:10.679567+0000","last_undegraded":"2024-03-07T10:21:10.679567+0000","last_fullsized":"2024-03-07T10:21:10.679567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684568+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:10.684568+0000","last_peered":"2024-03-07T10:21:10.684568+0000","last_clean":"2024-03-07T10:21:10.684568+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:10.684568+0000","last_undegraded":"2024-03-07T10:21:10.684568+0000","last_fullsized":"2024-03-07T10:21:10.684568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684863+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:10.684863+0000","last_peered":"2024-03-07T10:21:10.684863+0000","last_clean":"2024-03-07T10:21:10.684863+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:10.684863+0000","last_undegraded":"2024-03-07T10:21:10.684863+0000","last_fullsized":"2024-03-07T10:21:10.684863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287708+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:10.287708+0000","last_peered":"2024-03-07T10:21:10.287708+0000","last_clean":"2024-03-07T10:21:10.287708+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:10.287708+0000","last_undegraded":"2024-03-07T10:21:10.287708+0000","last_fullsized":"2024-03-07T10:21:10.287708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326210+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:10.326210+0000","last_peered":"2024-03-07T10:21:10.326210+0000","last_clean":"2024-03-07T10:21:10.326210+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:10.326210+0000","last_undegraded":"2024-03-07T10:21:10.326210+0000","last_fullsized":"2024-03-07T10:21:10.326210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686265+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:10.686265+0000","last_peered":"2024-03-07T10:21:10.686265+0000","last_clean":"2024-03-07T10:21:10.686265+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:10.686265+0000","last_undegraded":"2024-03-07T10:21:10.686265+0000","last_fullsized":"2024-03-07T10:21:10.686265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287200+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:10.287200+0000","last_peered":"2024-03-07T10:21:10.287200+0000","last_clean":"2024-03-07T10:21:10.287200+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:10.287200+0000","last_undegraded":"2024-03-07T10:21:10.287200+0000","last_fullsized":"2024-03-07T10:21:10.287200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684228+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:10.684228+0000","last_peered":"2024-03-07T10:21:10.684228+0000","last_clean":"2024-03-07T10:21:10.684228+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:10.684228+0000","last_undegraded":"2024-03-07T10:21:10.684228+0000","last_fullsized":"2024-03-07T10:21:10.684228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288057+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:10.288057+0000","last_peered":"2024-03-07T10:21:10.288057+0000","last_clean":"2024-03-07T10:21:10.288057+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:10.288057+0000","last_undegraded":"2024-03-07T10:21:10.288057+0000","last_fullsized":"2024-03-07T10:21:10.288057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682253+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:10.682253+0000","last_peered":"2024-03-07T10:21:10.682253+0000","last_clean":"2024-03-07T10:21:10.682253+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:10.682253+0000","last_undegraded":"2024-03-07T10:21:10.682253+0000","last_fullsized":"2024-03-07T10:21:10.682253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287258+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:10.287258+0000","last_peered":"2024-03-07T10:21:10.287258+0000","last_clean":"2024-03-07T10:21:10.287258+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:10.287258+0000","last_undegraded":"2024-03-07T10:21:10.287258+0000","last_fullsized":"2024-03-07T10:21:10.287258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285886+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:10.285886+0000","last_peered":"2024-03-07T10:21:10.285886+0000","last_clean":"2024-03-07T10:21:10.285886+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:10.285886+0000","last_undegraded":"2024-03-07T10:21:10.285886+0000","last_fullsized":"2024-03-07T10:21:10.285886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289513+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:10.289513+0000","last_peered":"2024-03-07T10:21:10.289513+0000","last_clean":"2024-03-07T10:21:10.289513+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:10.289513+0000","last_undegraded":"2024-03-07T10:21:10.289513+0000","last_fullsized":"2024-03-07T10:21:10.289513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286013+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:10.286013+0000","last_peered":"2024-03-07T10:21:10.286013+0000","last_clean":"2024-03-07T10:21:10.286013+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:10.286013+0000","last_undegraded":"2024-03-07T10:21:10.286013+0000","last_fullsized":"2024-03-07T10:21:10.286013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682028+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:21:10.682028+0000","last_peered":"2024-03-07T10:21:10.682028+0000","last_clean":"2024-03-07T10:21:10.682028+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:21:10.682028+0000","last_undegraded":"2024-03-07T10:21:10.682028+0000","last_fullsized":"2024-03-07T10:21:10.682028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683779+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:10.683779+0000","last_peered":"2024-03-07T10:21:10.683779+0000","last_clean":"2024-03-07T10:21:10.683779+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:10.683779+0000","last_undegraded":"2024-03-07T10:21:10.683779+0000","last_fullsized":"2024-03-07T10:21:10.683779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284741+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:10.284741+0000","last_peered":"2024-03-07T10:21:10.284741+0000","last_clean":"2024-03-07T10:21:10.284741+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:10.284741+0000","last_undegraded":"2024-03-07T10:21:10.284741+0000","last_fullsized":"2024-03-07T10:21:10.284741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679954+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:10.679954+0000","last_peered":"2024-03-07T10:21:10.679954+0000","last_clean":"2024-03-07T10:21:10.679954+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:10.679954+0000","last_undegraded":"2024-03-07T10:21:10.679954+0000","last_fullsized":"2024-03-07T10:21:10.679954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684730+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:21:10.684730+0000","last_peered":"2024-03-07T10:21:10.684730+0000","last_clean":"2024-03-07T10:21:10.684730+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:21:10.684730+0000","last_undegraded":"2024-03-07T10:21:10.684730+0000","last_fullsized":"2024-03-07T10:21:10.684730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285569+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:10.285569+0000","last_peered":"2024-03-07T10:21:10.285569+0000","last_clean":"2024-03-07T10:21:10.285569+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:10.285569+0000","last_undegraded":"2024-03-07T10:21:10.285569+0000","last_fullsized":"2024-03-07T10:21:10.285569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325987+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:10.325987+0000","last_peered":"2024-03-07T10:21:10.325987+0000","last_clean":"2024-03-07T10:21:10.325987+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:10.325987+0000","last_undegraded":"2024-03-07T10:21:10.325987+0000","last_fullsized":"2024-03-07T10:21:10.325987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684286+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:10.684286+0000","last_peered":"2024-03-07T10:21:10.684286+0000","last_clean":"2024-03-07T10:21:10.684286+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:10.684286+0000","last_undegraded":"2024-03-07T10:21:10.684286+0000","last_fullsized":"2024-03-07T10:21:10.684286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286334+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:10.286334+0000","last_peered":"2024-03-07T10:21:10.286334+0000","last_clean":"2024-03-07T10:21:10.286334+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:10.286334+0000","last_undegraded":"2024-03-07T10:21:10.286334+0000","last_fullsized":"2024-03-07T10:21:10.286334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684011+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:10.684011+0000","last_peered":"2024-03-07T10:21:10.684011+0000","last_clean":"2024-03-07T10:21:10.684011+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:10.684011+0000","last_undegraded":"2024-03-07T10:21:10.684011+0000","last_fullsized":"2024-03-07T10:21:10.684011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685485+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:10.685485+0000","last_peered":"2024-03-07T10:21:10.685485+0000","last_clean":"2024-03-07T10:21:10.685485+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:10.685485+0000","last_undegraded":"2024-03-07T10:21:10.685485+0000","last_fullsized":"2024-03-07T10:21:10.685485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683901+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:10.683901+0000","last_peered":"2024-03-07T10:21:10.683901+0000","last_clean":"2024-03-07T10:21:10.683901+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:10.683901+0000","last_undegraded":"2024-03-07T10:21:10.683901+0000","last_fullsized":"2024-03-07T10:21:10.683901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680027+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:10.680027+0000","last_peered":"2024-03-07T10:21:10.680027+0000","last_clean":"2024-03-07T10:21:10.680027+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:10.680027+0000","last_undegraded":"2024-03-07T10:21:10.680027+0000","last_fullsized":"2024-03-07T10:21:10.680027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324794+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:10.324794+0000","last_peered":"2024-03-07T10:21:10.324794+0000","last_clean":"2024-03-07T10:21:10.324794+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:10.324794+0000","last_undegraded":"2024-03-07T10:21:10.324794+0000","last_fullsized":"2024-03-07T10:21:10.324794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687014+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:21:10.687014+0000","last_peered":"2024-03-07T10:21:10.687014+0000","last_clean":"2024-03-07T10:21:10.687014+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:21:10.687014+0000","last_undegraded":"2024-03-07T10:21:10.687014+0000","last_fullsized":"2024-03-07T10:21:10.687014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289400+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:10.289400+0000","last_peered":"2024-03-07T10:21:10.289400+0000","last_clean":"2024-03-07T10:21:10.289400+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:10.289400+0000","last_undegraded":"2024-03-07T10:21:10.289400+0000","last_fullsized":"2024-03-07T10:21:10.289400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681886+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:10.681886+0000","last_peered":"2024-03-07T10:21:10.681886+0000","last_clean":"2024-03-07T10:21:10.681886+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:10.681886+0000","last_undegraded":"2024-03-07T10:21:10.681886+0000","last_fullsized":"2024-03-07T10:21:10.681886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684951+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:10.684951+0000","last_peered":"2024-03-07T10:21:10.684951+0000","last_clean":"2024-03-07T10:21:10.684951+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:10.684951+0000","last_undegraded":"2024-03-07T10:21:10.684951+0000","last_fullsized":"2024-03-07T10:21:10.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684310+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:10.684310+0000","last_peered":"2024-03-07T10:21:10.684310+0000","last_clean":"2024-03-07T10:21:10.684310+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:10.684310+0000","last_undegraded":"2024-03-07T10:21:10.684310+0000","last_fullsized":"2024-03-07T10:21:10.684310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324787+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:10.324787+0000","last_peered":"2024-03-07T10:21:10.324787+0000","last_clean":"2024-03-07T10:21:10.324787+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:10.324787+0000","last_undegraded":"2024-03-07T10:21:10.324787+0000","last_fullsized":"2024-03-07T10:21:10.324787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684852+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:10.684852+0000","last_peered":"2024-03-07T10:21:10.684852+0000","last_clean":"2024-03-07T10:21:10.684852+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:10.684852+0000","last_undegraded":"2024-03-07T10:21:10.684852+0000","last_fullsized":"2024-03-07T10:21:10.684852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285216+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:10.285216+0000","last_peered":"2024-03-07T10:21:10.285216+0000","last_clean":"2024-03-07T10:21:10.285216+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:10.285216+0000","last_undegraded":"2024-03-07T10:21:10.285216+0000","last_fullsized":"2024-03-07T10:21:10.285216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284392+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:10.284392+0000","last_peered":"2024-03-07T10:21:10.284392+0000","last_clean":"2024-03-07T10:21:10.284392+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:10.284392+0000","last_undegraded":"2024-03-07T10:21:10.284392+0000","last_fullsized":"2024-03-07T10:21:10.284392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683772+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:10.683772+0000","last_peered":"2024-03-07T10:21:10.683772+0000","last_clean":"2024-03-07T10:21:10.683772+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:10.683772+0000","last_undegraded":"2024-03-07T10:21:10.683772+0000","last_fullsized":"2024-03-07T10:21:10.683772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680958+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:10.680958+0000","last_peered":"2024-03-07T10:21:10.680958+0000","last_clean":"2024-03-07T10:21:10.680958+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:10.680958+0000","last_undegraded":"2024-03-07T10:21:10.680958+0000","last_fullsized":"2024-03-07T10:21:10.680958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286746+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:10.286746+0000","last_peered":"2024-03-07T10:21:10.286746+0000","last_clean":"2024-03-07T10:21:10.286746+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:10.286746+0000","last_undegraded":"2024-03-07T10:21:10.286746+0000","last_fullsized":"2024-03-07T10:21:10.286746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683414+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:10.683414+0000","last_peered":"2024-03-07T10:21:10.683414+0000","last_clean":"2024-03-07T10:21:10.683414+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:10.683414+0000","last_undegraded":"2024-03-07T10:21:10.683414+0000","last_fullsized":"2024-03-07T10:21:10.683414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287229+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:10.287229+0000","last_peered":"2024-03-07T10:21:10.287229+0000","last_clean":"2024-03-07T10:21:10.287229+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:10.287229+0000","last_undegraded":"2024-03-07T10:21:10.287229+0000","last_fullsized":"2024-03-07T10:21:10.287229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682287+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:10.682287+0000","last_peered":"2024-03-07T10:21:10.682287+0000","last_clean":"2024-03-07T10:21:10.682287+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:10.682287+0000","last_undegraded":"2024-03-07T10:21:10.682287+0000","last_fullsized":"2024-03-07T10:21:10.682287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686299+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:10.686299+0000","last_peered":"2024-03-07T10:21:10.686299+0000","last_clean":"2024-03-07T10:21:10.686299+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:10.686299+0000","last_undegraded":"2024-03-07T10:21:10.686299+0000","last_fullsized":"2024-03-07T10:21:10.686299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285806+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:10.285806+0000","last_peered":"2024-03-07T10:21:10.285806+0000","last_clean":"2024-03-07T10:21:10.285806+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:10.285806+0000","last_undegraded":"2024-03-07T10:21:10.285806+0000","last_fullsized":"2024-03-07T10:21:10.285806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283983+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:10.283983+0000","last_peered":"2024-03-07T10:21:10.283983+0000","last_clean":"2024-03-07T10:21:10.283983+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:10.283983+0000","last_undegraded":"2024-03-07T10:21:10.283983+0000","last_fullsized":"2024-03-07T10:21:10.283983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286880+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:10.286880+0000","last_peered":"2024-03-07T10:21:10.286880+0000","last_clean":"2024-03-07T10:21:10.286880+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:10.286880+0000","last_undegraded":"2024-03-07T10:21:10.286880+0000","last_fullsized":"2024-03-07T10:21:10.286880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682579+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:10.682579+0000","last_peered":"2024-03-07T10:21:10.682579+0000","last_clean":"2024-03-07T10:21:10.682579+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:10.682579+0000","last_undegraded":"2024-03-07T10:21:10.682579+0000","last_fullsized":"2024-03-07T10:21:10.682579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287145+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:10.287145+0000","last_peered":"2024-03-07T10:21:10.287145+0000","last_clean":"2024-03-07T10:21:10.287145+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:10.287145+0000","last_undegraded":"2024-03-07T10:21:10.287145+0000","last_fullsized":"2024-03-07T10:21:10.287145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684595+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:10.684595+0000","last_peered":"2024-03-07T10:21:10.684595+0000","last_clean":"2024-03-07T10:21:10.684595+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:10.684595+0000","last_undegraded":"2024-03-07T10:21:10.684595+0000","last_fullsized":"2024-03-07T10:21:10.684595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685825+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:10.685825+0000","last_peered":"2024-03-07T10:21:10.685825+0000","last_clean":"2024-03-07T10:21:10.685825+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:10.685825+0000","last_undegraded":"2024-03-07T10:21:10.685825+0000","last_fullsized":"2024-03-07T10:21:10.685825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682261+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:10.682261+0000","last_peered":"2024-03-07T10:21:10.682261+0000","last_clean":"2024-03-07T10:21:10.682261+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:10.682261+0000","last_undegraded":"2024-03-07T10:21:10.682261+0000","last_fullsized":"2024-03-07T10:21:10.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284788+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:10.284788+0000","last_peered":"2024-03-07T10:21:10.284788+0000","last_clean":"2024-03-07T10:21:10.284788+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:10.284788+0000","last_undegraded":"2024-03-07T10:21:10.284788+0000","last_fullsized":"2024-03-07T10:21:10.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684796+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:10.684796+0000","last_peered":"2024-03-07T10:21:10.684796+0000","last_clean":"2024-03-07T10:21:10.684796+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:10.684796+0000","last_undegraded":"2024-03-07T10:21:10.684796+0000","last_fullsized":"2024-03-07T10:21:10.684796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679707+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:10.679707+0000","last_peered":"2024-03-07T10:21:10.679707+0000","last_clean":"2024-03-07T10:21:10.679707+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:10.679707+0000","last_undegraded":"2024-03-07T10:21:10.679707+0000","last_fullsized":"2024-03-07T10:21:10.679707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326644+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:10.326644+0000","last_peered":"2024-03-07T10:21:10.326644+0000","last_clean":"2024-03-07T10:21:10.326644+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:10.326644+0000","last_undegraded":"2024-03-07T10:21:10.326644+0000","last_fullsized":"2024-03-07T10:21:10.326644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681923+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:10.681923+0000","last_peered":"2024-03-07T10:21:10.681923+0000","last_clean":"2024-03-07T10:21:10.681923+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:10.681923+0000","last_undegraded":"2024-03-07T10:21:10.681923+0000","last_fullsized":"2024-03-07T10:21:10.681923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289526+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:10.289526+0000","last_peered":"2024-03-07T10:21:10.289526+0000","last_clean":"2024-03-07T10:21:10.289526+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:10.289526+0000","last_undegraded":"2024-03-07T10:21:10.289526+0000","last_fullsized":"2024-03-07T10:21:10.289526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682347+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:10.682347+0000","last_peered":"2024-03-07T10:21:10.682347+0000","last_clean":"2024-03-07T10:21:10.682347+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:10.682347+0000","last_undegraded":"2024-03-07T10:21:10.682347+0000","last_fullsized":"2024-03-07T10:21:10.682347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686295+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:10.686295+0000","last_peered":"2024-03-07T10:21:10.686295+0000","last_clean":"2024-03-07T10:21:10.686295+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:10.686295+0000","last_undegraded":"2024-03-07T10:21:10.686295+0000","last_fullsized":"2024-03-07T10:21:10.686295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:15.325 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-07T10:21:15.325 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-07T10:21:15.325 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-07T10:21:15.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-07T10:21:15.326 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-07T10:21:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.560+0000 7fcf6fc00640 1 Processor -- start 2024-03-07T10:21:15.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.560+0000 7fcf6fc00640 1 -- start start 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf68148f40 0x7fcf681539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 0x7fcf68153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf68155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf68073240 con 0x7fcf68148f40 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6806e000 con 0x7fcf680c19c0 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf681568e0 con 0x7fcf68155af0 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6d200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf68148f40 0x7fcf681539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6d200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf68148f40 0x7fcf681539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50812/0 (socket says 172.21.15.194:50812) 2024-03-07T10:21:15.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.561+0000 7fcf6d200640 1 -- 172.21.15.194:0/142583503 learned_addr learned my addr 172.21.15.194:0/142583503 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6dc00640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf68155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6d200640 1 -- 172.21.15.194:0/142583503 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 msgr2=0x7fcf68155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:15.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/142583503 >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 0x7fcf68153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6d200640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf68155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6d200640 1 -- 172.21.15.194:0/142583503 >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 msgr2=0x7fcf68153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6d200640 1 --2- 172.21.15.194:0/142583503 >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 0x7fcf68153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6d200640 1 -- 172.21.15.194:0/142583503 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6806d6d0 con 0x7fcf68148f40 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/142583503 >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 0x7fcf68153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.562+0000 7fcf6dc00640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf68155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:15.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.563+0000 7fcf6d200640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf68148f40 0x7fcf681539f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ee50 tx=0x7fcf5802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658af8df7787ff82 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.563+0000 7fcf67e00640 1 -- 172.21.15.194:0/142583503 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5802ca80 con 0x7fcf68148f40 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.563+0000 7fcf67e00640 1 -- 172.21.15.194:0/142583503 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5802cc20 con 0x7fcf68148f40 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.563+0000 7fcf67e00640 1 -- 172.21.15.194:0/142583503 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580343f0 con 0x7fcf68148f40 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 -- 172.21.15.194:0/142583503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf68148f40 msgr2=0x7fcf681539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf68148f40 0x7fcf681539f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806ee50 tx=0x7fcf5802bee0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 -- 172.21.15.194:0/142583503 shutdown_connections 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf68155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/142583503 >> v2:172.21.15.196:3300/0 conn(0x7fcf680c19c0 0x7fcf68153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/142583503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf68148f40 0x7fcf681539f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 -- 172.21.15.194:0/142583503 >> 172.21.15.194:0/142583503 conn(0x7fcf6806b840 msgr2=0x7fcf680c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:15.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 -- 172.21.15.194:0/142583503 shutdown_connections 2024-03-07T10:21:15.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.564+0000 7fcf6fc00640 1 -- 172.21.15.194:0/142583503 wait complete. 2024-03-07T10:21:15.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.566+0000 7fcf6fc00640 1 Processor -- start 2024-03-07T10:21:15.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.566+0000 7fcf6fc00640 1 -- start start 2024-03-07T10:21:15.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 0x7fcf681ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf681535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf68149320 con 0x7fcf680c19c0 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6806dc90 con 0x7fcf68148f40 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6806e490 con 0x7fcf68155af0 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50828/0 (socket says 172.21.15.194:50828) 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 -- 172.21.15.194:0/990188620 learned_addr learned my addr 172.21.15.194:0/990188620 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6dc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf681535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 -- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 msgr2=0x7fcf681535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 0x7fcf681ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf681535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 -- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 msgr2=0x7fcf681ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 0x7fcf681ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf6d200640 1 -- 172.21.15.194:0/990188620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf68153fa0 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.568+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 0x7fcf681ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf6d200640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f80 tx=0x7fcf58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58043020 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5803e450 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf680c6ad0 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5803e840 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.569+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf680727a0 con 0x7fcf680c19c0 2024-03-07T10:21:15.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.570+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf68068170 con 0x7fcf680c19c0 2024-03-07T10:21:15.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.571+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcf58046020 con 0x7fcf680c19c0 2024-03-07T10:21:15.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.572+0000 7fcf65600640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 0x7fcf4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:15.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.572+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fcf580ace80 con 0x7fcf680c19c0 2024-03-07T10:21:15.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.573+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 0x7fcf4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:15.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.574+0000 7fcf5fe00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 0x7fcf4406d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006fd0 tx=0x7fcf50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:15.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.578+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcf5804d030 con 0x7fcf680c19c0 2024-03-07T10:21:15.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.820+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcf680c2030 con 0x7fcf680c19c0 2024-03-07T10:21:15.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.826+0000 7fcf65600640 1 -- 172.21.15.194:0/990188620 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171788 (secure 0 0 0) 0x7fcf5807b9c0 con 0x7fcf680c19c0 2024-03-07T10:21:15.831 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:15.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 msgr2=0x7fcf4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 0x7fcf4406d990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006fd0 tx=0x7fcf50008040 comp rx=0 tx=0).stop 2024-03-07T10:21:15.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 msgr2=0x7fcf680715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:15.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f80 tx=0x7fcf58004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:15.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 shutdown_connections 2024-03-07T10:21:15.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcf4406b4d0 0x7fcf4406d990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf68155af0 0x7fcf681535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf68148f40 0x7fcf681ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 --2- 172.21.15.194:0/990188620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf680c19c0 0x7fcf680715b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.831+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 >> 172.21.15.194:0/990188620 conn(0x7fcf6806b840 msgr2=0x7fcf681481b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.832+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 shutdown_connections 2024-03-07T10:21:15.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:15.832+0000 7fcf6fc00640 1 -- 172.21.15.194:0/990188620 wait complete. 2024-03-07T10:21:15.852 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6832","nonce":3213558195},{"type":"v1","addr":"172.21.15.196:6833","nonce":3213558195}]},"active_addr":"172.21.15.196:6833/3213558195","active_change":"2024-03-07T10:20:38.388657+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":309093382}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":2548237702}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":1554083003}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.196:0","nonce":760101812}]}]} 2024-03-07T10:21:15.856 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-07T10:21:15.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-07T10:21:15.857 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:16.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.055+0000 7fd6aa800640 1 Processor -- start 2024-03-07T10:21:16.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.055+0000 7fd6aa800640 1 -- start start 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.056+0000 7fd6aa800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6a4150b70 0x7fd6a40a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.056+0000 7fd6aa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a40a9a10 0x7fd6a406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6aa800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a4153980 con 0x7fd6a4156c20 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6aa800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a406e550 con 0x7fd6a4150b70 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6aa800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4153c60 con 0x7fd6a40a9a10 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6a4150b70 0x7fd6a40a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6a4150b70 0x7fd6a40a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50832/0 (socket says 172.21.15.194:50832) 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 -- 172.21.15.194:0/461895990 learned_addr learned my addr 172.21.15.194:0/461895990 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:16.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3e00640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a40a9a10 0x7fd6a406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 -- 172.21.15.194:0/461895990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a40a9a10 msgr2=0x7fd6a406e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a40a9a10 0x7fd6a406e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 -- 172.21.15.194:0/461895990 >> v1:172.21.15.196:6789/0 conn(0x7fd6a4156c20 legacy=0x7fd6a406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.057+0000 7fd6a3400640 1 -- 172.21.15.194:0/461895990 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a4153f40 con 0x7fd6a4150b70 2024-03-07T10:21:16.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.059+0000 7fd6a3400640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a4150b70 0x7fd6a40a94d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd694009870 tx=0x7fd69402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f733dee38010a7f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.059+0000 7fd6a2a00640 1 -- 172.21.15.194:0/461895990 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6940317c0 con 0x7fd6a4150b70 2024-03-07T10:21:16.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6a2a00640 1 -- 172.21.15.194:0/461895990 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd694037070 con 0x7fd6a4150b70 2024-03-07T10:21:16.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6a2a00640 1 -- 172.21.15.194:0/461895990 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694031b80 con 0x7fd6a4150b70 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 -- 172.21.15.194:0/461895990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a4150b70 msgr2=0x7fd6a40a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a4150b70 0x7fd6a40a94d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd694009870 tx=0x7fd69402b860 comp rx=0 tx=0).stop 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 -- 172.21.15.194:0/461895990 shutdown_connections 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a40a9a10 0x7fd6a406e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 --2- 172.21.15.194:0/461895990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a4150b70 0x7fd6a40a94d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 -- 172.21.15.194:0/461895990 >> 172.21.15.194:0/461895990 conn(0x7fd6a406b840 msgr2=0x7fd6a40c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.060+0000 7fd6aa800640 1 -- 172.21.15.194:0/461895990 shutdown_connections 2024-03-07T10:21:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.061+0000 7fd6aa800640 1 -- 172.21.15.194:0/461895990 wait complete. 2024-03-07T10:21:16.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.063+0000 7fd6aa800640 1 Processor -- start 2024-03-07T10:21:16.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.063+0000 7fd6aa800640 1 -- start start 2024-03-07T10:21:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a4150b70 0x7fd6a41ec6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6a4156c20 0x7fd6a41ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4153630 con 0x7fd6a40a9a10 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a40c7a30 con 0x7fd6a4156c20 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6aa800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a40ac460 con 0x7fd6a4150b70 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.064+0000 7fd6a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50844/0 (socket says 172.21.15.194:50844) 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 -- 172.21.15.194:0/3937053076 learned_addr learned my addr 172.21.15.194:0/3937053076 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 -- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a4150b70 msgr2=0x7fd6a41ec6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a4150b70 0x7fd6a41ec6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 -- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6a4156c20 msgr2=0x7fd6a41ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6a4156c20 0x7fd6a41ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 -- 172.21.15.194:0/3937053076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a41496d0 con 0x7fd6a40a9a10 2024-03-07T10:21:16.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.065+0000 7fd6a3400640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd694000c00 tx=0x7fd6940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.066+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694032650 con 0x7fd6a40a9a10 2024-03-07T10:21:16.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.066+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6940327f0 con 0x7fd6a40a9a10 2024-03-07T10:21:16.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.066+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694032be0 con 0x7fd6a40a9a10 2024-03-07T10:21:16.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.066+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a41440b0 con 0x7fd6a40a9a10 2024-03-07T10:21:16.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.066+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a414bf10 con 0x7fd6a40a9a10 2024-03-07T10:21:16.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.067+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a4068170 con 0x7fd6a40a9a10 2024-03-07T10:21:16.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.068+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd69404c060 con 0x7fd6a40a9a10 2024-03-07T10:21:16.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.069+0000 7fd69b400640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 0x7fd68006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.069+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fd6940ac020 con 0x7fd6a40a9a10 2024-03-07T10:21:16.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.069+0000 7fd69be00640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 0x7fd68006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.070+0000 7fd69be00640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 0x7fd68006d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6a414e890 tx=0x7fd68c0079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.078+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd694040070 con 0x7fd6a40a9a10 2024-03-07T10:21:16.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.274+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6a406dea0 con 0x7fd6a40a9a10 2024-03-07T10:21:16.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.278+0000 7fd69b400640 1 -- 172.21.15.194:0/3937053076 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7fd69407ac00 con 0x7fd6a40a9a10 2024-03-07T10:21:16.280 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:16.280 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:16.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 msgr2=0x7fd68006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 0x7fd68006d990 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd6a414e890 tx=0x7fd68c0079d0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 msgr2=0x7fd6a414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd694000c00 tx=0x7fd6940046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 shutdown_connections 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd68006b4d0 0x7fd68006d990 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd6a4156c20 0x7fd6a41ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd6a4150b70 0x7fd6a41ec6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 --2- 172.21.15.194:0/3937053076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6a40a9a10 0x7fd6a414b9d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 >> 172.21.15.194:0/3937053076 conn(0x7fd6a406b840 msgr2=0x7fd6a40abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 shutdown_connections 2024-03-07T10:21:16.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.281+0000 7fd6aa800640 1 -- 172.21.15.194:0/3937053076 wait complete. 2024-03-07T10:21:16.302 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-07T10:21:16.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:16.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.497+0000 7fce44000640 1 Processor -- start 2024-03-07T10:21:16.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.497+0000 7fce44000640 1 -- start start 2024-03-07T10:21:16.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce44000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce3c154100 0x7fce3c155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce44000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c1568e0 con 0x7fce3c0c19c0 2024-03-07T10:21:16.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce44000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c06d6d0 con 0x7fce3c148f40 2024-03-07T10:21:16.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce44000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c073240 con 0x7fce3c154100 2024-03-07T10:21:16.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce3c154100 0x7fce3c155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce3c154100 0x7fce3c155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50850/0 (socket says 172.21.15.194:50850) 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 -- 172.21.15.194:0/2921400312 learned_addr learned my addr 172.21.15.194:0/2921400312 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce42000640 1 --1- 172.21.15.194:0/2921400312 >> v1:172.21.15.194:6789/0 conn(0x7fce3c0c19c0 0x7fce3c156030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60474/0 (socket says 172.21.15.194:60474) 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 -- 172.21.15.194:0/2921400312 >> v1:172.21.15.196:6789/0 conn(0x7fce3c148f40 legacy=0x7fce3c1539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 -- 172.21.15.194:0/2921400312 >> v1:172.21.15.194:6789/0 conn(0x7fce3c0c19c0 legacy=0x7fce3c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce40c00640 1 -- 172.21.15.194:0/2921400312 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c06d9b0 con 0x7fce3c154100 2024-03-07T10:21:16.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.500+0000 7fce3be00640 1 -- 172.21.15.194:0/2921400312 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394243419 0 0) 0x7fce3c1568e0 con 0x7fce3c0c19c0 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.501+0000 7fce40c00640 1 --2- 172.21.15.194:0/2921400312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c155af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce28009870 tx=0x7fce2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf7f1e7ca78751d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce3be00640 1 -- 172.21.15.194:0/2921400312 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28035020 con 0x7fce3c154100 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce3be00640 1 -- 172.21.15.194:0/2921400312 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28031870 con 0x7fce3c154100 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce3be00640 1 -- 172.21.15.194:0/2921400312 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28031c40 con 0x7fce3c154100 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 -- 172.21.15.194:0/2921400312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 msgr2=0x7fce3c155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 --2- 172.21.15.194:0/2921400312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c155af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce28009870 tx=0x7fce2802b910 comp rx=0 tx=0).stop 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 -- 172.21.15.194:0/2921400312 shutdown_connections 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 --2- 172.21.15.194:0/2921400312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c155af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 -- 172.21.15.194:0/2921400312 >> 172.21.15.194:0/2921400312 conn(0x7fce3c06b840 msgr2=0x7fce3c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:16.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.502+0000 7fce44000640 1 -- 172.21.15.194:0/2921400312 shutdown_connections 2024-03-07T10:21:16.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.503+0000 7fce44000640 1 -- 172.21.15.194:0/2921400312 wait complete. 2024-03-07T10:21:16.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.504+0000 7fce44000640 1 Processor -- start 2024-03-07T10:21:16.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.504+0000 7fce44000640 1 -- start start 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 0x7fce3c0c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 0x7fce3c142030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c149320 con 0x7fce3c154100 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c06e000 con 0x7fce3c0c19c0 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce44000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c06e490 con 0x7fce3c148f40 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce42000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce42000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50856/0 (socket says 172.21.15.194:50856) 2024-03-07T10:21:16.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.505+0000 7fce42000640 1 -- 172.21.15.194:0/4267069998 learned_addr learned my addr 172.21.15.194:0/4267069998 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce40c00640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 0x7fce3c142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce41600640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 0x7fce3c0c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 -- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 msgr2=0x7fce3c142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 0x7fce3c142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 -- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 msgr2=0x7fce3c0c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 0x7fce3c0c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 -- 172.21.15.194:0/4267069998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c1ee7f0 con 0x7fce3c154100 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce40c00640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 0x7fce3c142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce41600640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 0x7fce3c0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce42000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c730 tx=0x7fce3400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34018070 con 0x7fce3c154100 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400ce40 con 0x7fce3c154100 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400a860 con 0x7fce3c154100 2024-03-07T10:21:16.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c141550 con 0x7fce3c154100 2024-03-07T10:21:16.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.506+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c142e70 con 0x7fce3c154100 2024-03-07T10:21:16.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.507+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c141360 con 0x7fce3c154100 2024-03-07T10:21:16.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.508+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fce3400aa00 con 0x7fce3c154100 2024-03-07T10:21:16.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.510+0000 7fce39600640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 0x7fce1c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:16.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.510+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fce34089b40 con 0x7fce3c154100 2024-03-07T10:21:16.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.510+0000 7fce41600640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 0x7fce1c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:16.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.511+0000 7fce41600640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 0x7fce1c06d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce30001690 tx=0x7fce30009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:16.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.514+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fce340585f0 con 0x7fce3c154100 2024-03-07T10:21:16.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.699+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce3c0c2030 con 0x7fce3c154100 2024-03-07T10:21:16.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.701+0000 7fce39600640 1 -- 172.21.15.194:0/4267069998 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7fce34057ef0 con 0x7fce3c154100 2024-03-07T10:21:16.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:16.703 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:16.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 msgr2=0x7fce1c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 0x7fce1c06d9c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fce30001690 tx=0x7fce30009040 comp rx=0 tx=0).stop 2024-03-07T10:21:16.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 msgr2=0x7fce3c0c62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:16.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fce3400c730 tx=0x7fce3400cbf0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 shutdown_connections 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fce1c06b500 0x7fce1c06d9c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce3c154100 0x7fce3c0c62d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fce3c148f40 0x7fce3c142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 --2- 172.21.15.194:0/4267069998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fce3c0c19c0 0x7fce3c0c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 >> 172.21.15.194:0/4267069998 conn(0x7fce3c06b840 msgr2=0x7fce3c153630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 shutdown_connections 2024-03-07T10:21:16.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:16.703+0000 7fce44000640 1 -- 172.21.15.194:0/4267069998 wait complete. 2024-03-07T10:21:16.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-07T10:21:16.723 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-07T10:21:16.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-07T10:21:16.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-07T10:21:16.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-07T10:21:16.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-07T10:21:16.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-07T10:21:16.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-07T10:21:17.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.026+0000 7f3a33200640 1 Processor -- start 2024-03-07T10:21:17.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.026+0000 7f3a33200640 1 -- start start 2024-03-07T10:21:17.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a3414b740 0x7f3a340c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 0x7f3a34152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a34071990 con 0x7f3a3414b740 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a34070e10 con 0x7f3a340c2dc0 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.028+0000 7f3a33200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a340710f0 con 0x7f3a340c4460 2024-03-07T10:21:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.029+0000 7f3a32800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 0x7f3a34152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.029+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.029+0000 7f3a32800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 0x7f3a34152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:34876/0 (socket says 172.21.15.194:34876) 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.029+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58656/0 (socket says 172.21.15.194:58656) 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.029+0000 7f3a31e00640 1 -- 172.21.15.194:0/2089494285 learned_addr learned my addr 172.21.15.194:0/2089494285 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.030+0000 7f3a31e00640 1 -- 172.21.15.194:0/2089494285 >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 msgr2=0x7f3a34152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.030+0000 7f3a31e00640 1 --2- 172.21.15.194:0/2089494285 >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 0x7f3a34152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.030+0000 7f3a31e00640 1 -- 172.21.15.194:0/2089494285 >> v2:172.21.15.194:3300/0 conn(0x7f3a3414b740 msgr2=0x7f3a340c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.030+0000 7f3a31e00640 1 --2- 172.21.15.194:0/2089494285 >> v2:172.21.15.194:3300/0 conn(0x7f3a3414b740 0x7f3a340c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.030+0000 7f3a31e00640 1 -- 172.21.15.194:0/2089494285 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340713d0 con 0x7f3a340c4460 2024-03-07T10:21:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.040+0000 7f3a31e00640 1 --2- 172.21.15.194:0/2089494285 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a3414bbc0 tx=0x7f3a2402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a65f075ab85fbf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.041+0000 7f3a30a00640 1 -- 172.21.15.194:0/2089494285 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24031780 con 0x7f3a340c4460 2024-03-07T10:21:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.041+0000 7f3a30a00640 1 -- 172.21.15.194:0/2089494285 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24037070 con 0x7f3a340c4460 2024-03-07T10:21:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.041+0000 7f3a30a00640 1 -- 172.21.15.194:0/2089494285 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24031b80 con 0x7f3a340c4460 2024-03-07T10:21:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.042+0000 7f3a33200640 1 -- 172.21.15.194:0/2089494285 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 msgr2=0x7f3a34151560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.042+0000 7f3a33200640 1 --2- 172.21.15.194:0/2089494285 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3a3414bbc0 tx=0x7f3a2402b820 comp rx=0 tx=0).stop 2024-03-07T10:21:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.043+0000 7f3a33200640 1 -- 172.21.15.194:0/2089494285 shutdown_connections 2024-03-07T10:21:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.043+0000 7f3a33200640 1 --2- 172.21.15.194:0/2089494285 >> v2:172.21.15.196:3300/0 conn(0x7f3a340c2dc0 0x7f3a34152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.043+0000 7f3a33200640 1 --2- 172.21.15.194:0/2089494285 >> v2:172.21.15.194:3300/0 conn(0x7f3a3414b740 0x7f3a340c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.043+0000 7f3a33200640 1 --2- 172.21.15.194:0/2089494285 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a34151560 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.043+0000 7f3a33200640 1 -- 172.21.15.194:0/2089494285 >> 172.21.15.194:0/2089494285 conn(0x7f3a340c3970 msgr2=0x7f3a340c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.044+0000 7f3a33200640 1 -- 172.21.15.194:0/2089494285 shutdown_connections 2024-03-07T10:21:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.044+0000 7f3a33200640 1 -- 172.21.15.194:0/2089494285 wait complete. 2024-03-07T10:21:17.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.046+0000 7f3a33200640 1 Processor -- start 2024-03-07T10:21:17.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.046+0000 7f3a33200640 1 -- start start 2024-03-07T10:21:17.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.046+0000 7f018ca00640 1 Processor -- start 2024-03-07T10:21:17.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.047+0000 7f018ca00640 1 -- start start 2024-03-07T10:21:17.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f018ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018806ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f018ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0188071520 0x7f0188071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f018ca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018814bdc0 con 0x7f018806e8f0 2024-03-07T10:21:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f018ca00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0188151cf0 con 0x7f0188071520 2024-03-07T10:21:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f018ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0188151fd0 con 0x7f018806ef00 2024-03-07T10:21:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.049+0000 7f0185400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f018806e8f0 0x7f018814b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60476/0 (socket says 172.21.15.194:60476) 2024-03-07T10:21:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f0185400640 1 -- 172.21.15.194:0/2663202449 learned_addr learned my addr 172.21.15.194:0/2663202449 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f8f72c00640 1 Processor -- start 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f8221800640 1 Processor -- start 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a340c2dc0 0x7f3a3414e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a341501e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3414b740 0x7f3a3413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34070bb0 con 0x7f3a3414b740 2024-03-07T10:21:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34070a30 con 0x7f3a340c2dc0 2024-03-07T10:21:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f3a33200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34072ed0 con 0x7f3a340c4460 2024-03-07T10:21:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.050+0000 7f8f72c00640 1 -- start start 2024-03-07T10:21:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f0186800640 1 --2- 172.21.15.194:0/2663202449 >> v2:172.21.15.196:3300/0 conn(0x7f0188071520 0x7f0188071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f0184a00640 1 -- 172.21.15.194:0/2663202449 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2825825966 0 0) 0x7f018814bdc0 con 0x7f018806e8f0 2024-03-07T10:21:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f0184a00640 1 -- 172.21.15.194:0/2663202449 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f016c003520 con 0x7f018806e8f0 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f3a32800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3414b740 0x7f3a3413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a340c2dc0 0x7f3a3414e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f3a31e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a340c2dc0 0x7f3a3414e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:34898/0 (socket says 172.21.15.194:34898) 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f3a31e00640 1 -- 172.21.15.194:0/2523915248 learned_addr learned my addr 172.21.15.194:0/2523915248 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.051+0000 7f3a31400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a341501e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f0185e00640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018806ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f3a32800640 1 -- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 msgr2=0x7f3a341501e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f3a32800640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3a340c4460 0x7f3a341501e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f3a32800640 1 -- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a340c2dc0 msgr2=0x7f3a3414e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f3a32800640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3a340c2dc0 0x7f3a3414e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f3a32800640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a341513a0 con 0x7f3a3414b740 2024-03-07T10:21:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f0186800640 1 -- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 msgr2=0x7f018806ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f0186800640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018806ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f3a32800640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3414b740 0x7f3a3413cbe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00ebd0 tx=0x7f3a2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f0186800640 1 -- 172.21.15.194:0/2663202449 >> v1:172.21.15.194:6789/0 conn(0x7f018806e8f0 legacy=0x7f018814b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.052+0000 7f8221800640 1 -- start start 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 0x7f821c0c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 0x7f821c1556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0cb3c0 con 0x7f821c0be720 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c0cb980 con 0x7f821c152e90 2024-03-07T10:21:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f8221800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c159750 con 0x7f821c0c8f90 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c018020 con 0x7f3a3414b740 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00cd20 con 0x7f3a3414b740 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0146c0 con 0x7f3a3414b740 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f3a33200640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3414f560 con 0x7f3a3414b740 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f3a33200640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a341510c0 con 0x7f3a3414b740 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f821b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f821a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 0x7f821c1556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f821b400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58674/0 (socket says 172.21.15.194:58674) 2024-03-07T10:21:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.054+0000 7f821b400640 1 -- 172.21.15.194:0/749805198 learned_addr learned my addr 172.21.15.194:0/749805198 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.053+0000 7f0186800640 1 -- 172.21.15.194:0/2663202449 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01881522b0 con 0x7f0188071520 2024-03-07T10:21:17.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821aa00640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 0x7f821c0c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821b400640 1 -- 172.21.15.194:0/749805198 >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 msgr2=0x7f821c0c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.056+0000 7f8f72c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8f6c071700 0x7f8f6c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.056+0000 7f8f72c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c06d480 con 0x7f8f6c14ef50 2024-03-07T10:21:17.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.057+0000 7f8f72c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f6c06da30 con 0x7f8f6c070fd0 2024-03-07T10:21:17.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.057+0000 7f8f72c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c1522c0 con 0x7f8f6c071700 2024-03-07T10:21:17.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.056+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a04001030 con 0x7f3a3414b740 2024-03-07T10:21:17.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.057+0000 7f0186800640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0188071520 0x7f0188071990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0180009d90 tx=0x7f018002bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9559e48e2c2edfe server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821b400640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 0x7f821c0c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821b400640 1 -- 172.21.15.194:0/749805198 >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 msgr2=0x7f821c1556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821b400640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 0x7f821c1556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.055+0000 7f821b400640 1 -- 172.21.15.194:0/749805198 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c159a30 con 0x7f821c0c8f90 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.057+0000 7f821a000640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 0x7f821c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f821aa00640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 0x7f821c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f8f6be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8f6c071700 0x7f8f6c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f8f6b400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f8f6c070fd0 0x7f8f6c0c19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49586/0 (socket says 172.21.15.194:49586) 2024-03-07T10:21:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f8f6b400640 1 -- 172.21.15.194:0/4253267187 learned_addr learned my addr 172.21.15.194:0/4253267187 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f0184a00640 1 -- 172.21.15.194:0/2663202449 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180039070 con 0x7f0188071520 2024-03-07T10:21:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f0184a00640 1 -- 172.21.15.194:0/2663202449 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018002c7d0 con 0x7f0188071520 2024-03-07T10:21:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f0184a00640 1 -- 172.21.15.194:0/2663202449 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174001670 con 0x7f0188071520 2024-03-07T10:21:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.058+0000 7f821b400640 1 --2- 172.21.15.194:0/749805198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f821c0c8b20 tx=0x7f821402bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be1f9cc2225da7ef server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8f6aa00640 1 -- 172.21.15.194:0/4253267187 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325154644 0 0) 0x7f8f6c06da30 con 0x7f8f6c070fd0 2024-03-07T10:21:17.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8f6aa00640 1 -- 172.21.15.194:0/4253267187 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f50005730 con 0x7f8f6c070fd0 2024-03-07T10:21:17.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8219600640 1 -- 172.21.15.194:0/749805198 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821402c960 con 0x7f821c0c8f90 2024-03-07T10:21:17.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8219600640 1 -- 172.21.15.194:0/749805198 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821402cb00 con 0x7f821c0c8f90 2024-03-07T10:21:17.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8219600640 1 -- 172.21.15.194:0/749805198 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140343f0 con 0x7f821c0c8f90 2024-03-07T10:21:17.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f9a0c200640 1 Processor -- start 2024-03-07T10:21:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8f6be00640 1 -- 172.21.15.194:0/4253267187 >> v1:172.21.15.196:6789/0 conn(0x7f8f6c070fd0 legacy=0x7f8f6c0c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f018ca00640 1 -- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0188071520 msgr2=0x7f0188071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f018ca00640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0188071520 0x7f0188071990 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0180009d90 tx=0x7f018002bca0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8f6be00640 1 -- 172.21.15.194:0/4253267187 >> v1:172.21.15.194:6789/0 conn(0x7f8f6c14ef50 legacy=0x7f8f6c15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f8221800640 1 -- 172.21.15.194:0/749805198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 msgr2=0x7f821c155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f8221800640 1 --2- 172.21.15.194:0/749805198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f821c0c8b20 tx=0x7f821402bdc0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 -- 172.21.15.194:0/2663202449 shutdown_connections 2024-03-07T10:21:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0188071520 0x7f0188071990 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 --2- 172.21.15.194:0/2663202449 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 -- 172.21.15.194:0/2663202449 >> 172.21.15.194:0/2663202449 conn(0x7f018806b840 msgr2=0x7f01880c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 -- 172.21.15.194:0/2663202449 shutdown_connections 2024-03-07T10:21:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.059+0000 7f8f6be00640 1 -- 172.21.15.194:0/4253267187 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c1527a0 con 0x7f8f6c071700 2024-03-07T10:21:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8221800640 1 -- 172.21.15.194:0/749805198 shutdown_connections 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8221800640 1 --2- 172.21.15.194:0/749805198 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0c8f90 0x7f821c155bf0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8221800640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.194:3300/0 conn(0x7f821c0be720 0x7f821c1556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8221800640 1 --2- 172.21.15.194:0/749805198 >> v2:172.21.15.196:3300/0 conn(0x7f821c152e90 0x7f821c0c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8221800640 1 -- 172.21.15.194:0/749805198 >> 172.21.15.194:0/749805198 conn(0x7f821c066f70 msgr2=0x7f821c067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f9a0c200640 1 -- start start 2024-03-07T10:21:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f8f6be00640 1 --2- 172.21.15.194:0/4253267187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c071700 0x7f8f6c14ea10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f580097a0 tx=0x7f8f5802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a58dc14fe4e8467c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.061+0000 7f018ca00640 1 -- 172.21.15.194:0/2663202449 wait complete. 2024-03-07T10:21:17.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f8221800640 1 -- 172.21.15.194:0/749805198 shutdown_connections 2024-03-07T10:21:17.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f8f6aa00640 1 -- 172.21.15.194:0/4253267187 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58034070 con 0x7f8f6c071700 2024-03-07T10:21:17.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f8f6aa00640 1 -- 172.21.15.194:0/4253267187 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f58030610 con 0x7f8f6c071700 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f9a0c200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9a041571f0 0x7f9a04072bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.060+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3a2c005d10 con 0x7f3a3414b740 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f3a2a000640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3a1006b5a0 0x7f3a1006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3a2c08b060 con 0x7f3a3414b740 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f3a2a000640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f3a10075db0 0x7f3a100781d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a2c01ee50 con 0x7f3a10075db0 2024-03-07T10:21:17.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f8f6aa00640 1 -- 172.21.15.194:0/4253267187 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580309e0 con 0x7f8f6c071700 2024-03-07T10:21:17.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f9a0c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a0c200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a041575d0 con 0x7f9a0415db10 2024-03-07T10:21:17.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f3a31400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f3a10075db0 0x7f3a100781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f3a31e00640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3a1006b5a0 0x7f3a1006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a2c092050 con 0x7f3a3414b740 2024-03-07T10:21:17.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a08e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9a0415db10 0x7f9a040ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49598/0 (socket says 172.21.15.194:49598) 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a0a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a0a200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58688/0 (socket says 172.21.15.194:58688) 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a0a200640 1 -- 172.21.15.194:0/3446720802 learned_addr learned my addr 172.21.15.194:0/3446720802 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.063+0000 7f9a09800640 1 --2- 172.21.15.194:0/3446720802 >> v2:172.21.15.196:3300/0 conn(0x7f9a041571f0 0x7f9a04072bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a040ca870 con 0x7f9a041571f0 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a04072740 con 0x7f9a04071610 2024-03-07T10:21:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f018ca00640 1 Processor -- start 2024-03-07T10:21:17.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.062+0000 7f8221800640 1 -- 172.21.15.194:0/749805198 wait complete. 2024-03-07T10:21:17.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f8221800640 1 Processor -- start 2024-03-07T10:21:17.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f8f72c00640 1 -- 172.21.15.194:0/4253267187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c071700 msgr2=0x7f8f6c14ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f8f72c00640 1 --2- 172.21.15.194:0/4253267187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c071700 0x7f8f6c14ea10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f580097a0 tx=0x7f8f5802b960 comp rx=0 tx=0).stop 2024-03-07T10:21:17.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f8221800640 1 -- start start 2024-03-07T10:21:17.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f9a03e00640 1 -- 172.21.15.194:0/3446720802 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462267402 0 0) 0x7f99f0001110 con 0x7f9a0415db10 2024-03-07T10:21:17.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f9a03e00640 1 -- 172.21.15.194:0/3446720802 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ec003520 con 0x7f9a0415db10 2024-03-07T10:21:17.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f8f72c00640 1 -- 172.21.15.194:0/4253267187 shutdown_connections 2024-03-07T10:21:17.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f3a31e00640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3a1006b5a0 0x7f3a1006da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a2402b860 tx=0x7f3a2403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f8f72c00640 1 --2- 172.21.15.194:0/4253267187 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c071700 0x7f8f6c14ea10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f8f72c00640 1 -- 172.21.15.194:0/4253267187 >> 172.21.15.194:0/4253267187 conn(0x7f8f6c06b470 msgr2=0x7f8f6c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f3a31400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f3a10075db0 0x7f3a100781d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.064+0000 7f018ca00640 1 -- start start 2024-03-07T10:21:17.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f9a0a200640 1 -- 172.21.15.194:0/3446720802 >> v2:172.21.15.196:3300/0 conn(0x7f9a041571f0 msgr2=0x7f9a04072bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f9a0a200640 1 --2- 172.21.15.194:0/3446720802 >> v2:172.21.15.196:3300/0 conn(0x7f9a041571f0 0x7f9a04072bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f9a0a200640 1 -- 172.21.15.194:0/3446720802 >> v1:172.21.15.196:6789/0 conn(0x7f9a0415db10 legacy=0x7f9a040ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.065+0000 7f9a0a200640 1 -- 172.21.15.194:0/3446720802 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0415e010 con 0x7f9a04071610 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.066+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== osd.0 v2:172.21.15.194:6808/1656769343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3a2c01ee50 con 0x7f3a10075db0 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.066+0000 7f8f72c00640 1 -- 172.21.15.194:0/4253267187 shutdown_connections 2024-03-07T10:21:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.066+0000 7f8f72c00640 1 -- 172.21.15.194:0/4253267187 wait complete. 2024-03-07T10:21:17.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.066+0000 7f8221800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 0x7f821c0c0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.066+0000 7f018ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f018806e8f0 0x7f01880abc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f018ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018813b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0f4a800640 1 Processor -- start 2024-03-07T10:21:17.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f8221800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f821c0c8f90 0x7f821c1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f018ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0188071520 0x7f018813bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f018ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880c1b40 con 0x7f0188071520 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0185e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f018806e8f0 0x7f01880abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f018ca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880c19c0 con 0x7f018806e8f0 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f018ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01880c1cc0 con 0x7f018806ef00 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0185400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018813b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0185400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018813b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58714/0 (socket says 172.21.15.194:58714) 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0185400640 1 -- 172.21.15.194:0/2915249893 learned_addr learned my addr 172.21.15.194:0/2915249893 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0188071520 0x7f018813bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f9a0a200640 1 --2- 172.21.15.194:0/3446720802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009870 tx=0x7f99f802b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24cf708e4a8fdc1a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f8f72c00640 1 Processor -- start 2024-03-07T10:21:17.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 -- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 msgr2=0x7f018813b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f8f72c00640 1 -- start start 2024-03-07T10:21:17.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f8221800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f821c152e90 0x7f821c0ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f8221800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c06d9d0 con 0x7f821c0c8f90 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f8221800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c06d850 con 0x7f821c152e90 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f8221800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c156130 con 0x7f821c0be720 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f821a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f821c0c8f90 0x7f821c1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f821aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 0x7f821c0c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.067+0000 7f0f4a800640 1 -- start start 2024-03-07T10:21:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f9a03e00640 1 -- 172.21.15.194:0/3446720802 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8035020 con 0x7f9a04071610 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.069+0000 7f9a03e00640 1 -- 172.21.15.194:0/3446720802 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8031640 con 0x7f9a04071610 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.069+0000 7f9a03e00640 1 -- 172.21.15.194:0/3446720802 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f802d040 con 0x7f9a04071610 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f018806ef00 0x7f018813b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 -- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f018806e8f0 msgr2=0x7f01880abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f018806e8f0 0x7f01880abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.068+0000 7f0186800640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01881557a0 con 0x7f0188071520 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.069+0000 7f821aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 0x7f821c0c0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58700/0 (socket says 172.21.15.194:58700) 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.069+0000 7f821aa00640 1 -- 172.21.15.194:0/1422165600 learned_addr learned my addr 172.21.15.194:0/1422165600 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.069+0000 7f821b400640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f821c152e90 0x7f821c0ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821aa00640 1 -- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f821c152e90 msgr2=0x7f821c0ae1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821aa00640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f821c152e90 0x7f821c0ae1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821aa00640 1 -- 172.21.15.194:0/1422165600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f821c0c8f90 msgr2=0x7f821c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 msgr2=0x7f9a0406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 --2- 172.21.15.194:0/3446720802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009870 tx=0x7f99f802b910 comp rx=0 tx=0).stop 2024-03-07T10:21:17.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f0186800640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0188071520 0x7f018813bd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01880c7b00 tx=0x7f0180004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f0f4a800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0f440c8f70 0x7f0f440c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 shutdown_connections 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 --2- 172.21.15.194:0/3446720802 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a04071610 0x7f9a0406d430 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 --2- 172.21.15.194:0/3446720802 >> v2:172.21.15.196:3300/0 conn(0x7f9a041571f0 0x7f9a04072bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 >> 172.21.15.194:0/3446720802 conn(0x7f9a040cf760 msgr2=0x7f9a040cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f0f4a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f440c59f0 0x7f0f44158e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821aa00640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f821c0c8f90 0x7f821c1588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821aa00640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0bfc80 con 0x7f821c0be720 2024-03-07T10:21:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c070fd0 0x7f8f6c0ab910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f6c071700 0x7f8f6c0c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f821a000640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f821c0c8f90 0x7f821c1588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:17.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f4a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f441597d0 con 0x7f0f44159360 2024-03-07T10:21:17.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f4a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f441561d0 con 0x7f0f440c59f0 2024-03-07T10:21:17.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f4a800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f440c6190 con 0x7f0f440c8f70 2024-03-07T10:21:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f8f72c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f6c14ef50 0x7f8f6c149020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f72c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c06e3c0 con 0x7f8f6c14ef50 2024-03-07T10:21:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f72c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c06dcd0 con 0x7f8f6c070fd0 2024-03-07T10:21:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f72c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c06e540 con 0x7f8f6c071700 2024-03-07T10:21:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 shutdown_connections 2024-03-07T10:21:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.070+0000 7f9a0c200640 1 -- 172.21.15.194:0/3446720802 wait complete. 2024-03-07T10:21:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f42a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f440c59f0 0x7f0f44158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f43e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0f44159360 0x7f0f440c7a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60488/0 (socket says 172.21.15.194:60488) 2024-03-07T10:21:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f43e00640 1 -- 172.21.15.194:0/100762937 learned_addr learned my addr 172.21.15.194:0/100762937 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f0f43400640 1 --2- 172.21.15.194:0/100762937 >> v2:172.21.15.196:3300/0 conn(0x7f0f440c8f70 0x7f0f440c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180039050 con 0x7f0188071520 2024-03-07T10:21:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f821aa00640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 0x7f821c0c0720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c820 tx=0x7f820c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f6be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c070fd0 0x7f8f6c0ab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f6be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c070fd0 0x7f8f6c0ab910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:34970/0 (socket says 172.21.15.194:34970) 2024-03-07T10:21:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f6be00640 1 -- 172.21.15.194:0/364760977 learned_addr learned my addr 172.21.15.194:0/364760977 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.071+0000 7f8f6b400640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f6c071700 0x7f8f6c0c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f8f70c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f6c14ef50 0x7f8f6c149020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f9a0c200640 1 Processor -- start 2024-03-07T10:21:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188155a80 con 0x7f0188071520 2024-03-07T10:21:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0188152e90 con 0x7f0188071520 2024-03-07T10:21:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c015070 con 0x7f821c0be720 2024-03-07T10:21:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c007a30 con 0x7f821c0be720 2024-03-07T10:21:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c007de0 con 0x7f821c0be720 2024-03-07T10:21:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180045070 con 0x7f0188071520 2024-03-07T10:21:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180009450 con 0x7f0188071520 2024-03-07T10:21:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f0f43400640 1 -- 172.21.15.194:0/100762937 >> v2:172.21.15.194:3300/0 conn(0x7f0f440c59f0 msgr2=0x7f0f44158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f0f43400640 1 --2- 172.21.15.194:0/100762937 >> v2:172.21.15.194:3300/0 conn(0x7f0f440c59f0 0x7f0f44158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f0f43400640 1 -- 172.21.15.194:0/100762937 >> v1:172.21.15.194:6789/0 conn(0x7f0f44159360 legacy=0x7f0f440c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f0f42000640 1 -- 172.21.15.194:0/100762937 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033626181 0 0) 0x7f0f441597d0 con 0x7f0f44159360 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.072+0000 7f0f43400640 1 -- 172.21.15.194:0/100762937 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44155b80 con 0x7f0f440c8f70 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8f70c00640 1 -- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f6c071700 msgr2=0x7f8f6c0c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8f70c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8f6c071700 0x7f8f6c0c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8f70c00640 1 -- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c070fd0 msgr2=0x7f8f6c0ab910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8f70c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8f6c070fd0 0x7f8f6c0ab910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8f70c00640 1 -- 172.21.15.194:0/364760977 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c1e7600 con 0x7f8f6c14ef50 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c1ebaf0 con 0x7f821c0be720 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c0c0200 con 0x7f821c0be720 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.073+0000 7f9a0c200640 1 -- start start 2024-03-07T10:21:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f8f70c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f6c14ef50 0x7f8f6c149020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c760 tx=0x7f8f6400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f0f43400640 1 --2- 172.21.15.194:0/100762937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f440c8f70 0x7f0f440c9350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4406cfb0 tx=0x7f0f3402be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6511fe496c54cdaa server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a04071610 0x7f9a040b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 0x7f9a040c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0415db10 0x7f9a040c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040723d0 con 0x7f9a0415db10 2024-03-07T10:21:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a040720f0 con 0x7f9a04071610 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.074+0000 7f9a0c200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0406cc40 con 0x7f9a041571f0 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f9a08e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 0x7f9a040c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64016020 con 0x7f8f6c14ef50 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64006d50 con 0x7f8f6c14ef50 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64003bb0 con 0x7f8f6c14ef50 2024-03-07T10:21:17.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f821c068170 con 0x7f821c0be720 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f9a08e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 0x7f9a040c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58730/0 (socket says 172.21.15.194:58730) 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f9a08e00640 1 -- 172.21.15.194:0/46918590 learned_addr learned my addr 172.21.15.194:0/46918590 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.075+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f6c0c6020 con 0x7f8f6c14ef50 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c1e7290 con 0x7f8f6c14ef50 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a09800640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a04071610 0x7f9a040b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0188155550 con 0x7f0188071520 2024-03-07T10:21:17.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a08e00640 1 -- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a04071610 msgr2=0x7f9a040b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a08e00640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9a04071610 0x7f9a040b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a08e00640 1 -- 172.21.15.194:0/46918590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0415db10 msgr2=0x7f9a040c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a08e00640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9a0415db10 0x7f9a040c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.076+0000 7f9a08e00640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a041f3080 con 0x7f9a041571f0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f9a08e00640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 0x7f9a040c4f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c430 tx=0x7f99f000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00074e0 con 0x7f9a041571f0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f0007680 con 0x7f9a041571f0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00049e0 con 0x7f9a041571f0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a040c4780 con 0x7f9a041571f0 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f0f42000640 1 -- 172.21.15.194:0/100762937 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34039070 con 0x7f0f440c8f70 2024-03-07T10:21:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.077+0000 7f0f42000640 1 -- 172.21.15.194:0/100762937 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3402cc20 con 0x7f0f440c8f70 2024-03-07T10:21:17.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f42000640 1 -- 172.21.15.194:0/100762937 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34034660 con 0x7f0f440c8f70 2024-03-07T10:21:17.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a040b4950 con 0x7f9a041571f0 2024-03-07T10:21:17.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 -- 172.21.15.194:0/100762937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f440c8f70 msgr2=0x7f0f440c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 --2- 172.21.15.194:0/100762937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f440c8f70 0x7f0f440c9350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4406cfb0 tx=0x7f0f3402be70 comp rx=0 tx=0).stop 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 -- 172.21.15.194:0/100762937 shutdown_connections 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 --2- 172.21.15.194:0/100762937 >> v2:172.21.15.194:3300/0 conn(0x7f0f440c59f0 0x7f0f44158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 --2- 172.21.15.194:0/100762937 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f440c8f70 0x7f0f440c9350 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0f4406cfb0 tx=0x7f0f3402be70 comp rx=0 tx=0).stop 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 -- 172.21.15.194:0/100762937 >> 172.21.15.194:0/100762937 conn(0x7f0f440671b0 msgr2=0x7f0f440675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 -- 172.21.15.194:0/100762937 shutdown_connections 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.078+0000 7f0f4a800640 1 -- 172.21.15.194:0/100762937 wait complete. 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.079+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f8f640050d0 con 0x7f8f6c14ef50 2024-03-07T10:21:17.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.080+0000 7f8f63e00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8f4c06b4d0 0x7f8f4c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.080+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99e0001030 con 0x7f9a041571f0 2024-03-07T10:21:17.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.080+0000 7f8f6be00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8f4c06b4d0 0x7f8f4c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.080+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f8f64089f40 con 0x7f8f6c14ef50 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.081+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f99f001a020 con 0x7f9a041571f0 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f9a01600640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99e406b4d0 0x7f99e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f99f0089db0 con 0x7f9a041571f0 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f9a01600640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7f99e4075ce0 0x7f99e4078100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99e40787b0 con 0x7f99e4075ce0 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f008c3d0 con 0x7f9a041571f0 2024-03-07T10:21:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f9a09800640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99e406b4d0 0x7f99e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.081+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f820c018070 con 0x7f821c0be720 2024-03-07T10:21:17.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f8f6be00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8f4c06b4d0 0x7f8f4c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009560 tx=0x7f8f5803b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f8212a00640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f81f806b520 0x7f81f806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f820c08a850 con 0x7f821c0be720 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f8212a00640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f81f8075dc0 0x7f81f80781e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81f8078890 con 0x7f81f8075dc0 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f820c08ac00 con 0x7f821c0be720 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f821a000640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f81f806b520 0x7f81f806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f821b400640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f81f8075dc0 0x7f81f80781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f821b400640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f81f8075dc0 0x7f81f80781e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f821a000640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f81f806b520 0x7f81f806d9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f821c1595a0 tx=0x7f8204009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f8f72c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f8f6c149bb0 0x7f8f6c149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 --> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f6c068170 con 0x7f8f6c149bb0 2024-03-07T10:21:17.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f9a0a200640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7f99e4075ce0 0x7f99e4078100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f8f6b400640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f8f6c149bb0 0x7f8f6c149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.081+0000 7f0f4a800640 1 Processor -- start 2024-03-07T10:21:17.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.081+0000 7f0f4a800640 1 -- start start 2024-03-07T10:21:17.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f0f4a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f440c59f0 0x7f0f44146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.082+0000 7f0f4a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 0x7f0f441f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f0f4a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f441f5e40 0x7f0f44148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f0f4a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4406d440 con 0x7f0f440c59f0 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f0f4a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f440c5ea0 con 0x7f0f44159360 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f0f4a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f44155830 con 0x7f0f441f5e40 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f0f43400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f440c59f0 0x7f0f44146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.083+0000 7f0f42a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 0x7f0f441f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f0f42a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 0x7f0f441f5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:34988/0 (socket says 172.21.15.194:34988) 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f0f42a00640 1 -- 172.21.15.194:0/2074452443 learned_addr learned my addr 172.21.15.194:0/2074452443 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.084+0000 7f0f43e00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f441f5e40 0x7f0f44148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.087+0000 7f8f6b400640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f8f6c149bb0 0x7f8f6c149560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43400640 1 -- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f441f5e40 msgr2=0x7f0f44148580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43400640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f441f5e40 0x7f0f44148580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43400640 1 -- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 msgr2=0x7f0f441f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43400640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 0x7f0f441f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43400640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f441f62f0 con 0x7f0f440c59f0 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f43e00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f441f5e40 0x7f0f44148580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.085+0000 7f0f42a00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f44159360 0x7f0f441f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f0f43400640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f440c59f0 0x7f0f44146910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f34033000 tx=0x7f0f34004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34044020 con 0x7f0f440c59f0 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3403f470 con 0x7f0f440c59f0 2024-03-07T10:21:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.086+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34039040 con 0x7f0f440c59f0 2024-03-07T10:21:17.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.087+0000 7f9a0a200640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7f99e4075ce0 0x7f99e4078100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.088+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== osd.6 v2:172.21.15.196:6816/2495219852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f81f8078890 con 0x7f81f8075dc0 2024-03-07T10:21:17.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== osd.3 v2:172.21.15.194:6821/1209571580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8f6c068170 con 0x7f8f6c149bb0 2024-03-07T10:21:17.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.087+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0180040670 con 0x7f0188071520 2024-03-07T10:21:17.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f017e000640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f016806b5d0 0x7f016806da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.087+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4414a7e0 con 0x7f0f440c59f0 2024-03-07T10:21:17.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.087+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4414ada0 con 0x7f0f440c59f0 2024-03-07T10:21:17.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f01800acd30 con 0x7f0188071520 2024-03-07T10:21:17.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f017e000640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f0168075e70 0x7f0168078290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0180036ec0 con 0x7f0168075e70 2024-03-07T10:21:17.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01800af390 con 0x7f0188071520 2024-03-07T10:21:17.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.089+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== osd.7 v2:172.21.15.196:6818/311786582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f99e40787b0 con 0x7f99e4075ce0 2024-03-07T10:21:17.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.090+0000 7f1c02e00640 1 Processor -- start 2024-03-07T10:21:17.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.090+0000 7f0185e00640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f016806b5d0 0x7f016806da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.090+0000 7f1c02e00640 1 -- start start 2024-03-07T10:21:17.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.090+0000 7f0185400640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f0168075e70 0x7f0168078290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.090+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f44154880 con 0x7f0f440c59f0 2024-03-07T10:21:17.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.091+0000 7f0185400640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f0168075e70 0x7f0168078290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f1c02e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1bfc070fd0 0x7f1bfc14eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f1c02e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bfc0c3aa0 0x7f1bfc071470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f1c02e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc06d480 con 0x7f1bfc0719b0 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f1c02e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc06da30 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f1c02e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc1522c0 con 0x7f1bfc070fd0 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.093+0000 7f1bfb400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bfc0c3aa0 0x7f1bfc071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.093+0000 7f1bfb400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bfc0c3aa0 0x7f1bfc071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50944/0 (socket says 172.21.15.194:50944) 2024-03-07T10:21:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.093+0000 7f1bfb400640 1 -- 172.21.15.194:0/1620949680 learned_addr learned my addr 172.21.15.194:0/1620949680 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.093+0000 7f9a09800640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99e406b4d0 0x7f99e406d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009a60 tx=0x7f99fc003990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.093+0000 7f1bfbe00640 1 --2- 172.21.15.194:0/1620949680 >> v2:172.21.15.196:3300/0 conn(0x7f1bfc070fd0 0x7f1bfc14eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.125 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== osd.2 v2:172.21.15.194:6816/1248623532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0180036ec0 con 0x7f0168075e70 2024-03-07T10:21:17.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.092+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0f34047020 con 0x7f0f440c59f0 2024-03-07T10:21:17.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f0f3b400640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f2406b4d0 0x7f0f2406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.095+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0f340acff0 con 0x7f0f440c59f0 2024-03-07T10:21:17.126 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.095+0000 7f0f3b400640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7f0f24075d60 0x7f0f24078180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f1bfb400640 1 -- 172.21.15.194:0/1620949680 >> v2:172.21.15.196:3300/0 conn(0x7f1bfc070fd0 msgr2=0x7f1bfc14eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f1bfb400640 1 --2- 172.21.15.194:0/1620949680 >> v2:172.21.15.196:3300/0 conn(0x7f1bfc070fd0 0x7f1bfc14eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.095+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f340352a0 con 0x7f0f24075d60 2024-03-07T10:21:17.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f1bfb400640 1 -- 172.21.15.194:0/1620949680 >> v1:172.21.15.196:6789/0 conn(0x7f1bfc0719b0 legacy=0x7f1bfc0c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.094+0000 7f1bfb400640 1 -- 172.21.15.194:0/1620949680 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc1527a0 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.128 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.095+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f340af5f0 con 0x7f0f440c59f0 2024-03-07T10:21:17.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f1bfb400640 1 --2- 172.21.15.194:0/1620949680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc071470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c36d0 tx=0x7f1be802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7323b92310122b77 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f0f42a00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f2406b4d0 0x7f0f2406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f0f43e00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7f0f24075d60 0x7f0f24078180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f0185e00640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f016806b5d0 0x7f016806da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0178006fd0 tx=0x7f0178008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f1bfaa00640 1 -- 172.21.15.194:0/1620949680 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8035020 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f1bfaa00640 1 -- 172.21.15.194:0/1620949680 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8031870 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.096+0000 7f1bfaa00640 1 -- 172.21.15.194:0/1620949680 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8031c40 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.097+0000 7f0f42a00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f2406b4d0 0x7f0f2406d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006fd0 tx=0x7f0f30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.097+0000 7f1c02e00640 1 -- 172.21.15.194:0/1620949680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0c3aa0 msgr2=0x7f1bfc071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.097+0000 7f1c02e00640 1 --2- 172.21.15.194:0/1620949680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc071470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c36d0 tx=0x7f1be802b930 comp rx=0 tx=0).stop 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.098+0000 7f1c02e00640 1 -- 172.21.15.194:0/1620949680 shutdown_connections 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.098+0000 7f1c02e00640 1 --2- 172.21.15.194:0/1620949680 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc071470 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.098+0000 7f1c02e00640 1 --2- 172.21.15.194:0/1620949680 >> v2:172.21.15.196:3300/0 conn(0x7f1bfc070fd0 0x7f1bfc14eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.098+0000 7f1c02e00640 1 -- 172.21.15.194:0/1620949680 >> 172.21.15.194:0/1620949680 conn(0x7f1bfc06b470 msgr2=0x7f1bfc06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.099+0000 7f0f43e00640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7f0f24075d60 0x7f0f24078180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.101+0000 7f1c02e00640 1 -- 172.21.15.194:0/1620949680 shutdown_connections 2024-03-07T10:21:17.132 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.101+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== osd.5 v2:172.21.15.196:6800/2704867987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0f340352a0 con 0x7f0f24075d60 2024-03-07T10:21:17.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.103+0000 7f1c02e00640 1 -- 172.21.15.194:0/1620949680 wait complete. 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.105+0000 7f1c02e00640 1 Processor -- start 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.105+0000 7f1c02e00640 1 -- start start 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bfc070fd0 0x7f1bfc137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 0x7f1bfc0ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc0ab8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14efe0 con 0x7f1bfc0719b0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc06dcd0 con 0x7f1bfc0c3aa0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1c02e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc06e3c0 con 0x7f1bfc070fd0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.107+0000 7f1bfb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 0x7f1bfc0ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bfc070fd0 0x7f1bfc137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfbe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bfc070fd0 0x7f1bfc137370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58744/0 (socket says 172.21.15.194:58744) 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfbe00640 1 -- 172.21.15.194:0/2119596612 learned_addr learned my addr 172.21.15.194:0/2119596612 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1c00e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc0ab8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 0x7f1bfc0ab3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50948/0 (socket says 172.21.15.194:50948) 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 -- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bfc070fd0 msgr2=0x7f1bfc137370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bfc070fd0 0x7f1bfc137370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 -- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc0c3aa0 msgr2=0x7f1bfc0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bfc0c3aa0 0x7f1bfc0ab8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.108+0000 7f1bfb400640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc153100 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.109+0000 7f1bfb400640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 0x7f1bfc0ab3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c3700 tx=0x7f1be80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.110+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8051070 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.110+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be804ad00 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.110+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8035040 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.111+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc137d20 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.111+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc1536a0 con 0x7f1bfc0719b0 2024-03-07T10:21:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.112+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1bfc0abe30 con 0x7f1bfc0719b0 2024-03-07T10:21:17.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.114+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 --> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f99e0002dd0 con 0x7f99e4075ce0 2024-03-07T10:21:17.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.116+0000 7f9a01600640 1 -- 172.21.15.194:0/46918590 <== osd.7 v2:172.21.15.196:6818/311786582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f99e0002dd0 con 0x7f99e4075ce0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.117+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1be8038020 con 0x7f1bfc0719b0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.118+0000 7f1bf3e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1be006b650 0x7f1be006db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.118+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1be80bd920 con 0x7f1bfc0719b0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.118+0000 7f1bf3e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f1be0075ef0 0x7f1be0078310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.118+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1be8034e90 con 0x7f1be0075ef0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.118+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1be80bdd10 con 0x7f1bfc0719b0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.119+0000 7f1c00e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f1be0075ef0 0x7f1be0078310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.120+0000 7f1c00e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f1be0075ef0 0x7f1be0078310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.121+0000 7f1bfbe00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1be006b650 0x7f1be006db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.121+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== osd.1 v2:172.21.15.194:6800/3579621358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1be8034e90 con 0x7f1be0075ef0 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7f99e4075ce0 msgr2=0x7f99e4078100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7f99e4075ce0 0x7f99e4078100 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99e406b4d0 msgr2=0x7f99e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99e406b4d0 0x7f99e406d990 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009a60 tx=0x7f99fc003990 comp rx=0 tx=0).stop 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 msgr2=0x7f9a040c4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 --2- 172.21.15.194:0/46918590 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9a041571f0 0x7f9a040c4f60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f99f000c430 tx=0x7f99f000c8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0a200640 1 -- 172.21.15.194:0/46918590 reap_dead start 2024-03-07T10:21:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 shutdown_connections 2024-03-07T10:21:17.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.122+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 >> 172.21.15.194:0/46918590 conn(0x7f9a040cf760 msgr2=0x7f9a040ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.123+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 --> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a04002dd0 con 0x7f3a10075db0 2024-03-07T10:21:17.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.124+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 shutdown_connections 2024-03-07T10:21:17.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.124+0000 7f9a0c200640 1 -- 172.21.15.194:0/46918590 wait complete. 2024-03-07T10:21:17.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.126+0000 7f1bfbe00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1be006b650 0x7f1be006db10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009c00 tx=0x7f1bec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.126+0000 7f3a2a000640 1 -- 172.21.15.194:0/2523915248 <== osd.0 v2:172.21.15.194:6808/1656769343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a04002dd0 con 0x7f3a10075db0 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.127+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f3a10075db0 msgr2=0x7f3a100781d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.127+0000 7f3a23400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f3a10075db0 0x7f3a100781d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.128+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3a1006b5a0 msgr2=0x7f3a1006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.128+0000 7f3a23400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3a1006b5a0 0x7f3a1006da60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3a2402b860 tx=0x7f3a2403d040 comp rx=0 tx=0).stop 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.128+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3414b740 msgr2=0x7f3a3413cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.128+0000 7f3a23400640 1 --2- 172.21.15.194:0/2523915248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3414b740 0x7f3a3413cbe0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00ebd0 tx=0x7f3a2c00c490 comp rx=0 tx=0).stop 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.128+0000 7f3a32800640 1 -- 172.21.15.194:0/2523915248 reap_dead start 2024-03-07T10:21:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.129+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 --> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f821c06d580 con 0x7f81f8075dc0 2024-03-07T10:21:17.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.130+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 shutdown_connections 2024-03-07T10:21:17.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.130+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 >> 172.21.15.194:0/2523915248 conn(0x7f3a340c3970 msgr2=0x7f3a34072770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.130+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 --> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f6c06d1c0 con 0x7f8f6c149bb0 2024-03-07T10:21:17.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.130+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 --> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f018814f2b0 con 0x7f0168075e70 2024-03-07T10:21:17.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.130+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 shutdown_connections 2024-03-07T10:21:17.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f8212a00640 1 -- 172.21.15.194:0/1422165600 <== osd.6 v2:172.21.15.196:6816/2495219852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f821c06d580 con 0x7f81f8075dc0 2024-03-07T10:21:17.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f017e000640 1 -- 172.21.15.194:0/2915249893 <== osd.2 v2:172.21.15.194:6816/1248623532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f018814f2b0 con 0x7f0168075e70 2024-03-07T10:21:17.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f3a23400640 1 -- 172.21.15.194:0/2523915248 wait complete. 2024-03-07T10:21:17.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f8f63e00640 1 -- 172.21.15.194:0/364760977 <== osd.3 v2:172.21.15.194:6821/1209571580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f6c06d1c0 con 0x7f8f6c149bb0 2024-03-07T10:21:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f81f8075dc0 msgr2=0x7f81f80781e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.131+0000 7f8221800640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f81f8075dc0 0x7f81f80781e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f81f806b520 msgr2=0x7f81f806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f8221800640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f81f806b520 0x7f81f806d9e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f821c1595a0 tx=0x7f8204009190 comp rx=0 tx=0).stop 2024-03-07T10:21:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 msgr2=0x7f821c0c0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f8221800640 1 --2- 172.21.15.194:0/1422165600 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f821c0be720 0x7f821c0c0720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f820c00c820 tx=0x7f820c00cce0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f821b400640 1 -- 172.21.15.194:0/1422165600 reap_dead start 2024-03-07T10:21:17.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f0168075e70 msgr2=0x7f0168078290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.132+0000 7f018ca00640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f0168075e70 0x7f0168078290 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 shutdown_connections 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 >> 172.21.15.194:0/1422165600 conn(0x7f821c066f70 msgr2=0x7f821c0c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f016806b5d0 msgr2=0x7f016806da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f016806b5d0 0x7f016806da90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0178006fd0 tx=0x7f0178008040 comp rx=0 tx=0).stop 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0188071520 msgr2=0x7f018813bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 --2- 172.21.15.194:0/2915249893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0188071520 0x7f018813bd00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01880c7b00 tx=0x7f0180004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:17.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f0186800640 1 -- 172.21.15.194:0/2915249893 reap_dead start 2024-03-07T10:21:17.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f8f6c149bb0 msgr2=0x7f8f6c149560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 shutdown_connections 2024-03-07T10:21:17.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 >> 172.21.15.194:0/2915249893 conn(0x7f018806b840 msgr2=0x7f01880c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.133+0000 7f8f72c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f8f6c149bb0 0x7f8f6c149560 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 shutdown_connections 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8f4c06b4d0 msgr2=0x7f8f4c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8f4c06b4d0 0x7f8f4c06d990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8f58009560 tx=0x7f8f5803b040 comp rx=0 tx=0).stop 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f6c14ef50 msgr2=0x7f8f6c149020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 --2- 172.21.15.194:0/364760977 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f6c14ef50 0x7f8f6c149020 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c760 tx=0x7f8f6400cc20 comp rx=0 tx=0).stop 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f70c00640 1 -- 172.21.15.194:0/364760977 reap_dead start 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 shutdown_connections 2024-03-07T10:21:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 >> 172.21.15.194:0/364760977 conn(0x7f8f6c06b470 msgr2=0x7f8f6c0c2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8221800640 1 -- 172.21.15.194:0/1422165600 wait complete. 2024-03-07T10:21:17.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 shutdown_connections 2024-03-07T10:21:17.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 shutdown_connections 2024-03-07T10:21:17.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f8f72c00640 1 -- 172.21.15.194:0/364760977 wait complete. 2024-03-07T10:21:17.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.134+0000 7f018ca00640 1 -- 172.21.15.194:0/2915249893 wait complete. 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.138+0000 7f14d5400640 1 Processor -- start 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.138+0000 7f14d5400640 1 -- start start 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 0x7f14c80db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f14c80dbd40 0x7f14c80dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c8007080 con 0x7f14c8046690 2024-03-07T10:21:17.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c8007340 con 0x7f14c80dbd40 2024-03-07T10:21:17.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.140+0000 7f14d5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80da420 con 0x7f14c80d7ad0 2024-03-07T10:21:17.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.141+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 --> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f44068170 con 0x7f0f24075d60 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.141+0000 7f14cfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:58746/0 (socket says 172.21.15.194:58746) 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 -- 172.21.15.194:0/1067135063 learned_addr learned my addr 172.21.15.194:0/1067135063 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14d4a00640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.196:3300/0 conn(0x7f14c80dbd40 0x7f14c80dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cf400640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 0x7f14c80db800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 -- 172.21.15.194:0/1067135063 >> v2:172.21.15.196:3300/0 conn(0x7f14c80dbd40 msgr2=0x7f14c80dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.196:3300/0 conn(0x7f14c80dbd40 0x7f14c80dd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 -- 172.21.15.194:0/1067135063 >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 msgr2=0x7f14c80db800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f14cfe00640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 0x7f14c80db800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.143+0000 7f14cfe00640 1 -- 172.21.15.194:0/1067135063 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80da700 con 0x7f14c80d7ad0 2024-03-07T10:21:17.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.142+0000 7f0f3b400640 1 -- 172.21.15.194:0/2074452443 <== osd.5 v2:172.21.15.196:6800/2704867987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f44068170 con 0x7f0f24075d60 2024-03-07T10:21:17.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.143+0000 7f14cf400640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 0x7f14c80db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:17.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.143+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7f0f24075d60 msgr2=0x7f0f24078180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.143+0000 7f0f4a800640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7f0f24075d60 0x7f0f24078180 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.144+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f2406b4d0 msgr2=0x7f0f2406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.144+0000 7f0f4a800640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f2406b4d0 0x7f0f2406d990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0f30006fd0 tx=0x7f0f30008040 comp rx=0 tx=0).stop 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.144+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f440c59f0 msgr2=0x7f0f44146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.144+0000 7f0f4a800640 1 --2- 172.21.15.194:0/2074452443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f440c59f0 0x7f0f44146910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0f34033000 tx=0x7f0f34004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.144+0000 7f0f43e00640 1 -- 172.21.15.194:0/2074452443 reap_dead start 2024-03-07T10:21:17.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.145+0000 7f14cfe00640 1 --2- 172.21.15.194:0/1067135063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14c8042830 tx=0x7f14c402b880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded8b8ef514b78ce server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.145+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 shutdown_connections 2024-03-07T10:21:17.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.145+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 >> 172.21.15.194:0/2074452443 conn(0x7f0f440671b0 msgr2=0x7f0f44151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.145+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 shutdown_connections 2024-03-07T10:21:17.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.146+0000 7f0f4a800640 1 -- 172.21.15.194:0/2074452443 wait complete. 2024-03-07T10:21:17.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.151+0000 7f14cea00640 1 -- 172.21.15.194:0/1067135063 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c402e070 con 0x7f14c80d7ad0 2024-03-07T10:21:17.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.151+0000 7f14cea00640 1 -- 172.21.15.194:0/1067135063 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c4037070 con 0x7f14c80d7ad0 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.151+0000 7f14cea00640 1 -- 172.21.15.194:0/1067135063 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4031a00 con 0x7f14c80d7ad0 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.152+0000 7f14d5400640 1 -- 172.21.15.194:0/1067135063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 msgr2=0x7f14c8046150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.152+0000 7f14d5400640 1 --2- 172.21.15.194:0/1067135063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14c8042830 tx=0x7f14c402b880 comp rx=0 tx=0).stop 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 --> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1bfc068170 con 0x7f1be0075ef0 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f1bf3e00640 1 -- 172.21.15.194:0/2119596612 <== osd.1 v2:172.21.15.194:6800/3579621358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1bfc068170 con 0x7f1be0075ef0 2024-03-07T10:21:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f14d5400640 1 -- 172.21.15.194:0/1067135063 shutdown_connections 2024-03-07T10:21:17.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f14d5400640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.196:3300/0 conn(0x7f14c80dbd40 0x7f14c80dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f14d5400640 1 --2- 172.21.15.194:0/1067135063 >> v2:172.21.15.194:3300/0 conn(0x7f14c8046690 0x7f14c80db800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.162 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:17.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f14d5400640 1 --2- 172.21.15.194:0/1067135063 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c80d7ad0 0x7f14c8046150 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.157+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f1be0075ef0 msgr2=0x7f1be0078310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.157+0000 7f1c02e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f1be0075ef0 0x7f1be0078310 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.156+0000 7f14d5400640 1 -- 172.21.15.194:0/1067135063 >> 172.21.15.194:0/1067135063 conn(0x7f14c8005e90 msgr2=0x7f14c80062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.164 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-07T10:21:17.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f14d5400640 1 -- 172.21.15.194:0/1067135063 shutdown_connections 2024-03-07T10:21:17.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1be006b650 msgr2=0x7f1be006db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1be006b650 0x7f1be006db10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009c00 tx=0x7f1bec009190 comp rx=0 tx=0).stop 2024-03-07T10:21:17.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 msgr2=0x7f1bfc0ab3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 --2- 172.21.15.194:0/2119596612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bfc0719b0 0x7f1bfc0ab3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0c3700 tx=0x7f1be80046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c00e00640 1 -- 172.21.15.194:0/2119596612 reap_dead start 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 shutdown_connections 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f14d5400640 1 -- 172.21.15.194:0/1067135063 wait complete. 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.158+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 >> 172.21.15.194:0/2119596612 conn(0x7f1bfc06b470 msgr2=0x7f1bfc150660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.159+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 shutdown_connections 2024-03-07T10:21:17.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.159+0000 7f1c02e00640 1 -- 172.21.15.194:0/2119596612 wait complete. 2024-03-07T10:21:17.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.161+0000 7f14d5400640 1 Processor -- start 2024-03-07T10:21:17.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.162+0000 7f14d5400640 1 -- start start 2024-03-07T10:21:17.168 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:17.168 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c8046690 0x7f14c80dd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14c80d7ad0 0x7f14c80dc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 0x7f14c80d6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80dc1d0 con 0x7f14c80dbd40 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80dacc0 con 0x7f14c80d7ad0 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.163+0000 7f14d5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80d7eb0 con 0x7f14c8046690 2024-03-07T10:21:17.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14d4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 0x7f14c80d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14d4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 0x7f14c80d6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50970/0 (socket says 172.21.15.194:50970) 2024-03-07T10:21:17.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14d4a00640 1 -- 172.21.15.194:0/2798781478 learned_addr learned my addr 172.21.15.194:0/2798781478 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14cf400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14c80d7ad0 0x7f14c80dc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.170 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:17.171 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-07T10:21:17.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14d4a00640 1 -- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c8046690 msgr2=0x7f14c80dd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14cfe00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c8046690 0x7f14c80dd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.164+0000 7f14d4a00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c8046690 0x7f14c80dd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14d4a00640 1 -- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14c80d7ad0 msgr2=0x7f14c80dc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14d4a00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14c80d7ad0 0x7f14c80dc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.172 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:17.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14d4a00640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80ce470 con 0x7f14c80dbd40 2024-03-07T10:21:17.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14cfe00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14c8046690 0x7f14c80dd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:17.173 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14d4a00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 0x7f14c80d6520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14d0050ba0 tx=0x7f14d00503f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0096680 con 0x7f14c80dbd40 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d0096820 con 0x7f14c80dbd40 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d0096bd0 con 0x7f14c80dbd40 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.165+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c80ce750 con 0x7f14c80dbd40 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.166+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c80d6000 con 0x7f14c80dbd40 2024-03-07T10:21:17.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.167+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14ac001030 con 0x7f14c80dbd40 2024-03-07T10:21:17.175 INFO:teuthology.orchestra.run.smithi194.stdout:55834574859 2024-03-07T10:21:17.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.169+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f14d00a03f0 con 0x7f14c80dbd40 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.170+0000 7f14c3e00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14b006b4d0 0x7f14b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.170+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f14d0105d20 con 0x7f14c80dbd40 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.171+0000 7f14c3e00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f14b0075ce0 0x7f14b0078100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.171+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14d008ce50 con 0x7f14b0075ce0 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.171+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14d01060d0 con 0x7f14c80dbd40 2024-03-07T10:21:17.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.171+0000 7f14cfe00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14b006b4d0 0x7f14b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.171+0000 7f14cf400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f14b0075ce0 0x7f14b0078100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.172+0000 7f14cfe00640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14b006b4d0 0x7f14b006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c4036000 tx=0x7f14c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.178 INFO:teuthology.orchestra.run.smithi194.stdout:55834574856 2024-03-07T10:21:17.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-07T10:21:17.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.172+0000 7f14cf400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f14b0075ce0 0x7f14b0078100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.175+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== osd.4 v2:172.21.15.196:6806/2284178707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f14d008ce50 con 0x7f14b0075ce0 2024-03-07T10:21:17.184 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:17.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-07T10:21:17.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.204+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 --> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14ac002dd0 con 0x7f14b0075ce0 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.208+0000 7f14c3e00640 1 -- 172.21.15.194:0/2798781478 <== osd.4 v2:172.21.15.196:6806/2284178707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14ac002dd0 con 0x7f14b0075ce0 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.209+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f14b0075ce0 msgr2=0x7f14b0078100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.209+0000 7f14d5400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f14b0075ce0 0x7f14b0078100 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14b006b4d0 msgr2=0x7f14b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14b006b4d0 0x7f14b006d990 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f14c4036000 tx=0x7f14c4008030 comp rx=0 tx=0).stop 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 msgr2=0x7f14c80d6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 --2- 172.21.15.194:0/2798781478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14c80dbd40 0x7f14c80d6520 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f14d0050ba0 tx=0x7f14d00503f0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d4a00640 1 -- 172.21.15.194:0/2798781478 reap_dead start 2024-03-07T10:21:17.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 shutdown_connections 2024-03-07T10:21:17.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 >> 172.21.15.194:0/2798781478 conn(0x7f14c8005e90 msgr2=0x7f14c802bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 shutdown_connections 2024-03-07T10:21:17.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.210+0000 7f14d5400640 1 -- 172.21.15.194:0/2798781478 wait complete. 2024-03-07T10:21:17.237 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:17.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-07T10:21:17.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.467+0000 7efe0c600640 1 Processor -- start 2024-03-07T10:21:17.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.467+0000 7efe0c600640 1 -- start start 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.469+0000 7efe0c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 0x7efe0415a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.469+0000 7efe0c600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 0x7efe04157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.469+0000 7efe0c600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0415acb0 con 0x7efe0406e9c0 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.469+0000 7efe0c600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe0406d7d0 con 0x7efe0406d270 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.469+0000 7efe0c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04071a50 con 0x7efe0406ce90 2024-03-07T10:21:17.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.470+0000 7efe0a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 0x7efe04157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.470+0000 7efe0a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 0x7efe04157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:50982/0 (socket says 172.21.15.194:50982) 2024-03-07T10:21:17.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.471+0000 7efe09200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7efe0406e9c0 0x7efe040c19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49624/0 (socket says 172.21.15.194:49624) 2024-03-07T10:21:17.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.471+0000 7efe09200640 1 -- 172.21.15.194:0/2899593556 learned_addr learned my addr 172.21.15.194:0/2899593556 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.470+0000 7efe09c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 0x7efe0415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.472+0000 7efe09c00640 1 -- 172.21.15.194:0/2899593556 >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 msgr2=0x7efe04157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.472+0000 7efe09c00640 1 --2- 172.21.15.194:0/2899593556 >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 0x7efe04157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.472+0000 7efe09c00640 1 -- 172.21.15.194:0/2899593556 >> v1:172.21.15.196:6789/0 conn(0x7efe0406e9c0 legacy=0x7efe040c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.472+0000 7efe09c00640 1 -- 172.21.15.194:0/2899593556 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04071770 con 0x7efe0406ce90 2024-03-07T10:21:17.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.474+0000 7ff13b200640 1 Processor -- start 2024-03-07T10:21:17.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.474+0000 7ff13b200640 1 -- start start 2024-03-07T10:21:17.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.475+0000 7f5256200640 1 Processor -- start 2024-03-07T10:21:17.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.475+0000 7efe09c00640 1 --2- 172.21.15.194:0/2899593556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 0x7efe0415a770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdf80097a0 tx=0x7efdf802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976c682ebea89174 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7efe03e00640 1 -- 172.21.15.194:0/2899593556 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80315a0 con 0x7efe0406ce90 2024-03-07T10:21:17.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff13b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 0x7ff13c151560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7efe03e00640 1 -- 172.21.15.194:0/2899593556 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8037070 con 0x7efe0406ce90 2024-03-07T10:21:17.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7efe03e00640 1 -- 172.21.15.194:0/2899593556 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80319a0 con 0x7efe0406ce90 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff13b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c070e10 con 0x7ff13c0c4460 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff13b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c0710f0 con 0x7ff13c152dc0 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff13b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c071990 con 0x7ff13c14b740 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff139e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff13c0c4460 0x7ff13c0c2880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60496/0 (socket says 172.21.15.194:60496) 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.476+0000 7ff139e00640 1 -- 172.21.15.194:0/107532855 learned_addr learned my addr 172.21.15.194:0/107532855 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.477+0000 7ff139400640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 0x7ff13c151560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.477+0000 7f5256200640 1 -- start start 2024-03-07T10:21:17.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723434194 0 0) 0x7ff13c070e10 con 0x7ff13c0c4460 2024-03-07T10:21:17.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff120003520 con 0x7ff13c0c4460 2024-03-07T10:21:17.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7efe0c600640 1 -- 172.21.15.194:0/2899593556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 msgr2=0x7efe0415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7f5256200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f52500c8f50 0x7f52500ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7f5256200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52501531a0 con 0x7f5250158cd0 2024-03-07T10:21:17.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7f5256200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52500c6300 con 0x7f525006bbe0 2024-03-07T10:21:17.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7f5256200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52500c94c0 con 0x7f52500c8f50 2024-03-07T10:21:17.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7efe0c600640 1 --2- 172.21.15.194:0/2899593556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 0x7efe0415a770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efdf80097a0 tx=0x7efdf802b840 comp rx=0 tx=0).stop 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1180474028 0 0) 0x7ff120003520 con 0x7ff13c0c4460 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 msgr2=0x7ff13c151560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 0x7ff13c151560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 >> v1:172.21.15.196:6789/0 conn(0x7ff13c152dc0 legacy=0x7ff13c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0713d0 con 0x7ff13c0c4460 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7ff1340019f0 con 0x7ff13c0c4460 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 >> v1:172.21.15.194:6789/0 conn(0x7ff13c0c4460 legacy=0x7ff13c0c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.478+0000 7ff138a00640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1200039e0 0x7ff120003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524f400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f525006bbe0 0x7f52500c5bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49640/0 (socket says 172.21.15.194:49640) 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524f400640 1 -- 172.21.15.194:0/2271388076 learned_addr learned my addr 172.21.15.194:0/2271388076 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524ea00640 1 --2- 172.21.15.194:0/2271388076 >> v2:172.21.15.194:3300/0 conn(0x7f52500c8f50 0x7f52500ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524ea00640 1 -- 172.21.15.194:0/2271388076 >> v1:172.21.15.196:6789/0 conn(0x7f525006bbe0 legacy=0x7f52500c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524ea00640 1 -- 172.21.15.194:0/2271388076 >> v1:172.21.15.194:6789/0 conn(0x7f5250158cd0 legacy=0x7f5250160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7f524ea00640 1 -- 172.21.15.194:0/2271388076 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52500c97a0 con 0x7f52500c8f50 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7ff138a00640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff120004800 0x7ff120004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7ff138a00640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 0x7ff120005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c071990 con 0x7ff120004800 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200143c0 con 0x7ff1200039e0 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.479+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200145c0 con 0x7ff13c14b740 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7ff139400640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff120004800 0x7ff120004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7f524ea00640 1 --2- 172.21.15.194:0/2271388076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52500c8f50 0x7f52500ca560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1baa6da635ef5c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7ff139400640 1 -- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 msgr2=0x7ff120005290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-07T10:21:17.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7efe0c600640 1 -- 172.21.15.194:0/2899593556 shutdown_connections 2024-03-07T10:21:17.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7efe0c600640 1 --2- 172.21.15.194:0/2899593556 >> v2:172.21.15.194:3300/0 conn(0x7efe0406d270 0x7efe04157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7efe0c600640 1 --2- 172.21.15.194:0/2899593556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406ce90 0x7efe0415a770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.480+0000 7efe0c600640 1 -- 172.21.15.194:0/2899593556 >> 172.21.15.194:0/2899593556 conn(0x7efe0406b840 msgr2=0x7efe040c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7ff139400640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c14b740 0x7ff120005290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7ff139400640 1 -- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1200039e0 msgr2=0x7ff120003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7ff139400640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff1200039e0 0x7ff120003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7ff139400640 1 -- 172.21.15.194:0/107532855 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0713d0 con 0x7ff120004800 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7f524e000640 1 -- 172.21.15.194:0/2271388076 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c0315a0 con 0x7f52500c8f50 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7f524e000640 1 -- 172.21.15.194:0/2271388076 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c037070 con 0x7f52500c8f50 2024-03-07T10:21:17.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7f524e000640 1 -- 172.21.15.194:0/2271388076 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031960 con 0x7f52500c8f50 2024-03-07T10:21:17.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7efe0c600640 1 -- 172.21.15.194:0/2899593556 shutdown_connections 2024-03-07T10:21:17.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.483+0000 7f5256200640 1 -- 172.21.15.194:0/2271388076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52500c8f50 msgr2=0x7f52500ca560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.483+0000 7f5256200640 1 --2- 172.21.15.194:0/2271388076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52500c8f50 0x7f52500ca560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b840 comp rx=0 tx=0).stop 2024-03-07T10:21:17.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.481+0000 7efe0c600640 1 -- 172.21.15.194:0/2899593556 wait complete. 2024-03-07T10:21:17.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7f5256200640 1 -- 172.21.15.194:0/2271388076 shutdown_connections 2024-03-07T10:21:17.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7f5256200640 1 --2- 172.21.15.194:0/2271388076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52500c8f50 0x7f52500ca560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7f5256200640 1 -- 172.21.15.194:0/2271388076 >> 172.21.15.194:0/2271388076 conn(0x7f52500cb050 msgr2=0x7f52500cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7efe0c600640 1 Processor -- start 2024-03-07T10:21:17.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.486+0000 7ff139400640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff120004800 0x7ff120004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff128009ac0 tx=0x7ff120005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcce0ce7c42de60b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7f5256200640 1 -- 172.21.15.194:0/2271388076 shutdown_connections 2024-03-07T10:21:17.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7f5256200640 1 -- 172.21.15.194:0/2271388076 wait complete. 2024-03-07T10:21:17.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.487+0000 7f5256200640 1 Processor -- start 2024-03-07T10:21:17.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.487+0000 7f09e5400640 1 Processor -- start 2024-03-07T10:21:17.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.487+0000 7f09e5400640 1 -- start start 2024-03-07T10:21:17.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.484+0000 7efe0c600640 1 -- start start 2024-03-07T10:21:17.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.487+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128039070 con 0x7ff120004800 2024-03-07T10:21:17.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.487+0000 7ff138a00640 1 -- 172.21.15.194:0/107532855 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12802c6d0 con 0x7ff120004800 2024-03-07T10:21:17.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7fb5a2800640 1 Processor -- start 2024-03-07T10:21:17.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7ff13b200640 1 -- 172.21.15.194:0/107532855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff120004800 msgr2=0x7ff120004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7ff13b200640 1 --2- 172.21.15.194:0/107532855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff120004800 0x7ff120004c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff128009ac0 tx=0x7ff120005830 comp rx=0 tx=0).stop 2024-03-07T10:21:17.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7ff13a800640 1 -- 172.21.15.194:0/107532855 reap_dead start 2024-03-07T10:21:17.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7ff13b200640 1 -- 172.21.15.194:0/107532855 shutdown_connections 2024-03-07T10:21:17.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7f09e5400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f09e0152f40 0x7f09e01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f09e5400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e01567e0 con 0x7f09e00c7960 2024-03-07T10:21:17.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f09e5400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e00c5d80 con 0x7f09e00c9430 2024-03-07T10:21:17.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f09e5400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e00c6060 con 0x7f09e0152f40 2024-03-07T10:21:17.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7ff13b200640 1 -- 172.21.15.194:0/107532855 >> 172.21.15.194:0/107532855 conn(0x7ff13c0c3970 msgr2=0x7ff13c0c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7efe0c600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 0x7efe041efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7efe0c600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406d270 0x7efe04152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7efe0c600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 0x7efe040bd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f09d5e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f09e00c9430 0x7f09e006d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49652/0 (socket says 172.21.15.194:49652) 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f09d5e00640 1 -- 172.21.15.194:0/1078970364 learned_addr learned my addr 172.21.15.194:0/1078970364 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7f09de800640 1 --2- 172.21.15.194:0/1078970364 >> v2:172.21.15.196:3300/0 conn(0x7f09e0152f40 0x7f09e01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7efe0c600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe040c20d0 con 0x7efe0406ce90 2024-03-07T10:21:17.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7efe0c600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe04071400 con 0x7efe0406e9c0 2024-03-07T10:21:17.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.488+0000 7fb5a2800640 1 -- start start 2024-03-07T10:21:17.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7fb5a2800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fb59c071700 0x7fb59c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7fb5a2800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb59c070fd0 0x7fb59c0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7fb5a2800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c06d480 con 0x7fb59c14ef50 2024-03-07T10:21:17.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7fb5a2800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c06da30 con 0x7fb59c070fd0 2024-03-07T10:21:17.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7fb5a2800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c1522c0 con 0x7fb59c071700 2024-03-07T10:21:17.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7efe0c600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe04152790 con 0x7efe0406d270 2024-03-07T10:21:17.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.490+0000 7efe0a600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 0x7efe040bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.489+0000 7f5256200640 1 -- start start 2024-03-07T10:21:17.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525006bbe0 0x7f5250154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52500c8f50 0x7f5250146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7efe0a600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 0x7efe040bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:35068/0 (socket says 172.21.15.194:35068) 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7efe0a600640 1 -- 172.21.15.194:0/3826691938 learned_addr learned my addr 172.21.15.194:0/3826691938 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7efe09200640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406d270 0x7efe04152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500cad40 con 0x7f5250158cd0 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52500c9d60 con 0x7f525006bbe0 2024-03-07T10:21:17.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f5256200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525006bfc0 con 0x7f52500c8f50 2024-03-07T10:21:17.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7fb59be00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fb59c14ef50 0x7fb59c0c1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49656/0 (socket says 172.21.15.194:49656) 2024-03-07T10:21:17.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7fb59be00640 1 -- 172.21.15.194:0/1822281765 learned_addr learned my addr 172.21.15.194:0/1822281765 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f09dde00640 1 -- 172.21.15.194:0/1078970364 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255733841 0 0) 0x7f09e01567e0 con 0x7f09e00c7960 2024-03-07T10:21:17.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1822281765 >> v2:172.21.15.194:3300/0 conn(0x7fb59c070fd0 0x7fb59c0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f09dde00640 1 -- 172.21.15.194:0/1078970364 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c4003520 con 0x7f09e00c7960 2024-03-07T10:21:17.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7efe09c00640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 0x7efe041efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f09de800640 1 -- 172.21.15.194:0/1078970364 >> v1:172.21.15.196:6789/0 conn(0x7f09e00c9430 legacy=0x7f09e006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f09de800640 1 -- 172.21.15.194:0/1078970364 >> v1:172.21.15.194:6789/0 conn(0x7f09e00c7960 legacy=0x7f09e01601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f09de800640 1 -- 172.21.15.194:0/1078970364 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e006ca80 con 0x7f09e0152f40 2024-03-07T10:21:17.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.491+0000 7f524fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7fc1f4a00640 1 Processor -- start 2024-03-07T10:21:17.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7efe09c00640 1 -- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406d270 msgr2=0x7efe04152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7efe09c00640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406d270 0x7efe04152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7efe09c00640 1 -- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 msgr2=0x7efe040bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7efe09c00640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 0x7efe040bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7efe09c00640 1 -- 172.21.15.194:0/3826691938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe040bc2f0 con 0x7efe0406ce90 2024-03-07T10:21:17.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7fc1f4a00640 1 -- start start 2024-03-07T10:21:17.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7fb59a000640 1 -- 172.21.15.194:0/1822281765 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783826554 0 0) 0x7fb59c06d480 con 0x7fb59c14ef50 2024-03-07T10:21:17.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7ff13b200640 1 -- 172.21.15.194:0/107532855 shutdown_connections 2024-03-07T10:21:17.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59b400640 1 --2- 172.21.15.194:0/1822281765 >> v2:172.21.15.196:3300/0 conn(0x7fb59c071700 0x7fb59c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7efe09c00640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 0x7efe041efc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdf8033000 tx=0x7efdf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7f524ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52500c8f50 0x7f5250146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.492+0000 7f524f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525006bbe0 0x7f5250154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51020/0 (socket says 172.21.15.194:51020) 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 -- 172.21.15.194:0/944642407 learned_addr learned my addr 172.21.15.194:0/944642407 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 -- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52500c8f50 msgr2=0x7f5250146ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52500c8f50 0x7f5250146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 -- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525006bbe0 msgr2=0x7f5250154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525006bbe0 0x7f5250154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7f524fe00640 1 -- 172.21.15.194:0/944642407 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52501508a0 con 0x7f5250158cd0 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59a000640 1 -- 172.21.15.194:0/1822281765 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb580003520 con 0x7fb59c14ef50 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59aa00640 1 -- 172.21.15.194:0/1822281765 >> v2:172.21.15.196:3300/0 conn(0x7fb59c071700 msgr2=0x7fb59c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1822281765 >> v2:172.21.15.196:3300/0 conn(0x7fb59c071700 0x7fb59c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59aa00640 1 -- 172.21.15.194:0/1822281765 >> v1:172.21.15.196:6789/0 conn(0x7fb59c14ef50 legacy=0x7fb59c0c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.493+0000 7fb59aa00640 1 -- 172.21.15.194:0/1822281765 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c1527a0 con 0x7fb59c070fd0 2024-03-07T10:21:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf804a070 con 0x7efe0406ce90 2024-03-07T10:21:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8032430 con 0x7efe0406ce90 2024-03-07T10:21:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7fc1f4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc1f0151560 0x7fc1f00c2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7fc1f4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00710f0 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7fc1f4a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00713d0 con 0x7fc1f00c4460 2024-03-07T10:21:17.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7fc1f4a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f0071990 con 0x7fc1f0151560 2024-03-07T10:21:17.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8032820 con 0x7efe0406ce90 2024-03-07T10:21:17.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.495+0000 7fc1ef400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fc1f00c4460 0x7fc1f014b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49658/0 (socket says 172.21.15.194:49658) 2024-03-07T10:21:17.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe041529e0 con 0x7efe0406ce90 2024-03-07T10:21:17.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.494+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe040aac50 con 0x7efe0406ce90 2024-03-07T10:21:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.495+0000 7ff13b200640 1 -- 172.21.15.194:0/107532855 wait complete. 2024-03-07T10:21:17.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.495+0000 7fc1ef400640 1 -- 172.21.15.194:0/3538080468 learned_addr learned my addr 172.21.15.194:0/3538080468 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.495+0000 7fc1eea00640 1 --2- 172.21.15.194:0/3538080468 >> v2:172.21.15.194:3300/0 conn(0x7fc1f0151560 0x7fc1f00c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fc1ee000640 1 -- 172.21.15.194:0/3538080468 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96927224 0 0) 0x7fc1f00713d0 con 0x7fc1f00c4460 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fc1ee000640 1 -- 172.21.15.194:0/3538080468 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d4003520 con 0x7fc1f00c4460 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fc1eea00640 1 -- 172.21.15.194:0/3538080468 >> v1:172.21.15.196:6789/0 conn(0x7fc1f00c4460 legacy=0x7fc1f014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fc1eea00640 1 -- 172.21.15.194:0/3538080468 >> v1:172.21.15.194:6789/0 conn(0x7fc1f00c2dc0 legacy=0x7fc1f0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fc1eea00640 1 -- 172.21.15.194:0/3538080468 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00716b0 con 0x7fc1f0151560 2024-03-07T10:21:17.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.495+0000 7f524fe00640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f524800b9c0 tx=0x7f524800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe04068170 con 0x7efe0406ce90 2024-03-07T10:21:17.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.496+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1822281765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c070fd0 0x7fb59c0c19c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0c36d0 tx=0x7fb58c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cee18b57378c6c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248019070 con 0x7f5250158cd0 2024-03-07T10:21:17.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f09de800640 1 --2- 172.21.15.194:0/1078970364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e0152f40 0x7f09e01562a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009d90 tx=0x7f09d002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=191da88fefd4c50a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7fb59a000640 1 -- 172.21.15.194:0/1822281765 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c035020 con 0x7fb59c070fd0 2024-03-07T10:21:17.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f09dde00640 1 -- 172.21.15.194:0/1078970364 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0039070 con 0x7f09e0152f40 2024-03-07T10:21:17.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f09dde00640 1 -- 172.21.15.194:0/1078970364 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d002ccf0 con 0x7f09e0152f40 2024-03-07T10:21:17.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f09dde00640 1 -- 172.21.15.194:0/1078970364 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d0034660 con 0x7f09e0152f40 2024-03-07T10:21:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52501dfd30 con 0x7f5250158cd0 2024-03-07T10:21:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52501e0640 con 0x7f5250158cd0 2024-03-07T10:21:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7fc1eea00640 1 --2- 172.21.15.194:0/3538080468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f0151560 0x7fc1f00c2880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0071b10 tx=0x7fc1e002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9af8e302285093e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7fb59a000640 1 -- 172.21.15.194:0/1822281765 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c031830 con 0x7fb59c070fd0 2024-03-07T10:21:17.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.497+0000 7fb59a000640 1 -- 172.21.15.194:0/1822281765 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c031c00 con 0x7fb59c070fd0 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f09e5400640 1 -- 172.21.15.194:0/1078970364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e0152f40 msgr2=0x7f09e01562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f09e5400640 1 --2- 172.21.15.194:0/1078970364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e0152f40 0x7f09e01562a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009d90 tx=0x7f09d002bf40 comp rx=0 tx=0).stop 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7fb5a2800640 1 -- 172.21.15.194:0/1822281765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c070fd0 msgr2=0x7fb59c0c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1822281765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c070fd0 0x7fb59c0c19c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0c36d0 tx=0x7fb58c02b8d0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f09e5400640 1 -- 172.21.15.194:0/1078970364 shutdown_connections 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f09e5400640 1 --2- 172.21.15.194:0/1078970364 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e0152f40 0x7f09e01562a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f09e5400640 1 -- 172.21.15.194:0/1078970364 >> 172.21.15.194:0/1078970364 conn(0x7f09e00cb200 msgr2=0x7f09e00cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7efdf80329c0 con 0x7efe0406ce90 2024-03-07T10:21:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524800cba0 con 0x7f5250158cd0 2024-03-07T10:21:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.498+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248014440 con 0x7f5250158cd0 2024-03-07T10:21:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7fc1ee000640 1 -- 172.21.15.194:0/3538080468 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0035020 con 0x7fc1f0151560 2024-03-07T10:21:17.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7fc1ee000640 1 -- 172.21.15.194:0/3538080468 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0031810 con 0x7fc1f0151560 2024-03-07T10:21:17.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7fc1ee000640 1 -- 172.21.15.194:0/3538080468 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0031be0 con 0x7fc1f0151560 2024-03-07T10:21:17.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7f09e5400640 1 -- 172.21.15.194:0/1078970364 shutdown_connections 2024-03-07T10:21:17.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.499+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5250068880 con 0x7f5250158cd0 2024-03-07T10:21:17.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7efe01600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 0x7efde406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7efdf802f020 con 0x7efe0406ce90 2024-03-07T10:21:17.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7ff13b200640 1 Processor -- start 2024-03-07T10:21:17.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fc1f4a00640 1 -- 172.21.15.194:0/3538080468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f0151560 msgr2=0x7fc1f00c2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/3538080468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f0151560 0x7fc1f00c2880 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0071b10 tx=0x7fc1e002b8b0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7f09e5400640 1 -- 172.21.15.194:0/1078970364 wait complete. 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7fc1f4a00640 1 -- 172.21.15.194:0/3538080468 shutdown_connections 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/3538080468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f0151560 0x7fc1f00c2880 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7fc1f4a00640 1 -- 172.21.15.194:0/3538080468 >> 172.21.15.194:0/3538080468 conn(0x7fc1f00c3970 msgr2=0x7fc1f00c3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fb5a2800640 1 -- 172.21.15.194:0/1822281765 shutdown_connections 2024-03-07T10:21:17.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1822281765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c070fd0 0x7fb59c0c19c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1822281765 >> v2:172.21.15.196:3300/0 conn(0x7fb59c071700 0x7fb59c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.500+0000 7fb5a2800640 1 -- 172.21.15.194:0/1822281765 >> 172.21.15.194:0/1822281765 conn(0x7fb59c06b470 msgr2=0x7fb59c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7efe09200640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 0x7efde406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.502+0000 7fb5a2800640 1 -- 172.21.15.194:0/1822281765 shutdown_connections 2024-03-07T10:21:17.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.502+0000 7efe09200640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 0x7efde406d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe040ac5e0 tx=0x7efdf0007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.502+0000 7ff13b200640 1 -- start start 2024-03-07T10:21:17.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7f09e5400640 1 Processor -- start 2024-03-07T10:21:17.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120004800 0x7ff13c1dd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c1e7050 0x7ff13c1503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c3110 con 0x7ff13c0abfe0 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0c2f90 con 0x7ff120004800 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7ff13b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c070a30 con 0x7ff13c1e7050 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7fc1f4a00640 1 -- 172.21.15.194:0/3538080468 shutdown_connections 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.501+0000 7fc1f4a00640 1 -- 172.21.15.194:0/3538080468 wait complete. 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7fc1f4a00640 1 Processor -- start 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7fc1f4a00640 1 -- start start 2024-03-07T10:21:17.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7f09e5400640 1 -- start start 2024-03-07T10:21:17.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.503+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f524801c070 con 0x7f5250158cd0 2024-03-07T10:21:17.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.504+0000 7f5247400640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 0x7f523006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.504+0000 7ff13a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.504+0000 7ff13a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51034/0 (socket says 172.21.15.194:51034) 2024-03-07T10:21:17.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.504+0000 7ff13a800640 1 -- 172.21.15.194:0/2498423897 learned_addr learned my addr 172.21.15.194:0/2498423897 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.504+0000 7ff139400640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c1e7050 0x7ff13c1503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1f00c4460 0x7fc1f01e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1f0151560 0x7fc1f0140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0073050 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0072ed0 con 0x7fc1f00c4460 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1f4a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f01534d0 con 0x7fc1f0151560 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff139e00640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120004800 0x7ff13c1dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff13a800640 1 -- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c1e7050 msgr2=0x7ff13c1503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff13a800640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c1e7050 0x7ff13c1503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff13a800640 1 -- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120004800 msgr2=0x7ff13c1dd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff13a800640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120004800 0x7ff13c1dd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7fc1ef400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7ff13a800640 1 -- 172.21.15.194:0/2498423897 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0ac740 con 0x7ff13c0abfe0 2024-03-07T10:21:17.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.505+0000 7f09e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 0x7f09e01f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1efe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1f0151560 0x7fc1f0140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51036/0 (socket says 172.21.15.194:51036) 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 -- 172.21.15.194:0/1949550264 learned_addr learned my addr 172.21.15.194:0/1949550264 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09e5400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09e5400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 0x7f09e01494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09de800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 0x7f09e01f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7ff13a800640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff13c14bbf0 tx=0x7ff12c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 -- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1f0151560 msgr2=0x7fc1f0140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1f0151560 0x7fc1f0140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 -- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1f00c4460 msgr2=0x7fc1f01e8fe0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1f00c4460 0x7fc1f01e8fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7fc1ef400640 1 -- 172.21.15.194:0/1949550264 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f014d700 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09e5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e006db10 con 0x7f09e00c7960 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09e5400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e006d990 con 0x7f09e00c9430 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09e5400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e00c9060 con 0x7f09e0152f40 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09de800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 0x7f09e01f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51044/0 (socket says 172.21.15.194:51044) 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7f524f400640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 0x7f523006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.506+0000 7f09d5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7f09d5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:35124/0 (socket says 172.21.15.194:35124) 2024-03-07T10:21:17.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7f09d5e00640 1 -- 172.21.15.194:0/2614462003 learned_addr learned my addr 172.21.15.194:0/2614462003 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7fb5a2800640 1 -- 172.21.15.194:0/1822281765 wait complete. 2024-03-07T10:21:17.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7f09df200640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 0x7f09e01494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.507+0000 7fc1ef400640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800cbc0 tx=0x7fc1e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09d5e00640 1 -- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 msgr2=0x7f09e01494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09d5e00640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 0x7f09e01494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09d5e00640 1 -- 172.21.15.194:0/2614462003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 msgr2=0x7f09e01f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09d5e00640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 0x7f09e01f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09d5e00640 1 -- 172.21.15.194:0/2614462003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e01f34d0 con 0x7f09e00c9430 2024-03-07T10:21:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7f09df200640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 0x7f09e01494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.508+0000 7fb5a2800640 1 Processor -- start 2024-03-07T10:21:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7fb5a2800640 1 -- start start 2024-03-07T10:21:17.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7f09d5e00640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c400 tx=0x7f09c800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8017070 con 0x7f09e00c9430 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7fb5a2800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb5a2800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb59c071700 0x7fb59c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb5a2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c14ef50 0x7fb59c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb5a2800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c06e3c0 con 0x7fb59c14ef50 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb5a2800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c06dcd0 con 0x7fb59c070fd0 2024-03-07T10:21:17.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb5a2800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c06e540 con 0x7fb59c071700 2024-03-07T10:21:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e00c4750 con 0x7f09e00c9430 2024-03-07T10:21:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.509+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e0159ba0 con 0x7f09e00c9430 2024-03-07T10:21:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5248056890 con 0x7f5250158cd0 2024-03-07T10:21:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb59b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb59b400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:35140/0 (socket says 172.21.15.194:35140) 2024-03-07T10:21:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c0074e0 con 0x7ff13c0abfe0 2024-03-07T10:21:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb59b400640 1 -- 172.21.15.194:0/1897777622 learned_addr learned my addr 172.21.15.194:0/1897777622 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb59c071700 0x7fb59c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0ab530 con 0x7ff13c0abfe0 2024-03-07T10:21:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8017070 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.510+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8005ce0 con 0x7f09e00c9430 2024-03-07T10:21:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c0c12a0 con 0x7ff13c0abfe0 2024-03-07T10:21:17.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f01eae60 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8017070 con 0x7f09e00c9430 2024-03-07T10:21:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.511+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f00c6bd0 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b8005290 con 0x7f09e00c9430 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7efe040bc2f0 con 0x7efe0406ce90 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7fb59b400640 1 -- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb59c071700 msgr2=0x7fb59c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7fb59b400640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb59c071700 0x7fb59c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7fb59b400640 1 -- 172.21.15.194:0/1897777622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c14ef50 msgr2=0x7fb59c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7fb59b400640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c14ef50 0x7fb59c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7fb59b400640 1 -- 172.21.15.194:0/1897777622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c152f80 con 0x7fb59c070fd0 2024-03-07T10:21:17.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.512+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c075600 con 0x7ff13c0abfe0 2024-03-07T10:21:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7fb59b400640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d830 tx=0x7fb58800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800b6c0 con 0x7fb59c070fd0 2024-03-07T10:21:17.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7f524f400640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 0x7f523006d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5240007fd0 tx=0x7f5240007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb588019070 con 0x7fb59c070fd0 2024-03-07T10:21:17.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58800ba80 con 0x7fb59c070fd0 2024-03-07T10:21:17.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.513+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c1f2b60 con 0x7fb59c070fd0 2024-03-07T10:21:17.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.514+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c150800 con 0x7fb59c070fd0 2024-03-07T10:21:17.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.516+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f09c801a070 con 0x7f09e00c9430 2024-03-07T10:21:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.517+0000 7f09d7400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 0x7f09bc06dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.517+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f09c8005ae0 con 0x7f09e00c9430 2024-03-07T10:21:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.517+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f0075600 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.518+0000 7f09de800640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 0x7f09bc06dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.518+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c004020 con 0x7ff13c0abfe0 2024-03-07T10:21:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.518+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c068170 con 0x7fb59c070fd0 2024-03-07T10:21:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.518+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c020060 con 0x7ff13c0abfe0 2024-03-07T10:21:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.519+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e800ace0 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.519+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8017070 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.520+0000 7f3990000640 1 Processor -- start 2024-03-07T10:21:17.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.521+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f52480587f0 con 0x7f5250158cd0 2024-03-07T10:21:17.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f09de800640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 0x7f09bc06dd90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09d0036000 tx=0x7f09d0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.520+0000 7f3990000640 1 -- start start 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f3990000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39880be720 0x7f39881556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f3990000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39880c8f90 0x7f3988155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f3990000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3988159750 con 0x7f3988152e90 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f3990000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880cb3c0 con 0x7f39880be720 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.522+0000 7f3990000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880cb980 con 0x7f39880c8f90 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39880c8f90 0x7f3988155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f39880c8f90 0x7f3988155bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:35146/0 (socket says 172.21.15.194:35146) 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 -- 172.21.15.194:0/2141333483 learned_addr learned my addr 172.21.15.194:0/2141333483 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 -- 172.21.15.194:0/2141333483 >> v2:172.21.15.194:3300/0 conn(0x7f39880be720 msgr2=0x7f39881556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 --2- 172.21.15.194:0/2141333483 >> v2:172.21.15.194:3300/0 conn(0x7f39880be720 0x7f39881556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 -- 172.21.15.194:0/2141333483 >> v1:172.21.15.196:6789/0 conn(0x7f3988152e90 legacy=0x7f39880c5a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:21:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.523+0000 7f398e000640 1 -- 172.21.15.194:0/2141333483 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988159a30 con 0x7f39880c8f90 2024-03-07T10:21:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.525+0000 7f398e000640 1 --2- 172.21.15.194:0/2141333483 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39880c8f90 0x7f3988155bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f398806d290 tx=0x7f398002bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b925dd5fe555872 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.525+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff12c0057c0 con 0x7ff13c0abfe0 2024-03-07T10:21:17.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.527+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc1e801a070 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.527+0000 7ff132000640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 0x7ff11c06db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.527+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff12c0041d0 con 0x7ff13c0abfe0 2024-03-07T10:21:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.528+0000 7ff139e00640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 0x7ff11c06db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.529+0000 7fc1e7400640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 0x7fc1d006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.529+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fc1e808a410 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.529+0000 7ff139e00640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 0x7ff11c06db90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff134000f80 tx=0x7ff134001b20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.530+0000 7fc1eea00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 0x7fc1d006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.530+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff12c057c40 con 0x7ff13c0abfe0 2024-03-07T10:21:17.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.531+0000 7f3987e00640 1 -- 172.21.15.194:0/2141333483 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398002c980 con 0x7f39880c8f90 2024-03-07T10:21:17.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.531+0000 7f3987e00640 1 -- 172.21.15.194:0/2141333483 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398002cb20 con 0x7f39880c8f90 2024-03-07T10:21:17.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.531+0000 7f3987e00640 1 -- 172.21.15.194:0/2141333483 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800343f0 con 0x7f39880c8f90 2024-03-07T10:21:17.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.532+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f09c8057e80 con 0x7f09e00c9430 2024-03-07T10:21:17.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7fc1eea00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 0x7fc1d006db90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0036000 tx=0x7fc1e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 -- 172.21.15.194:0/2141333483 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39880c8f90 msgr2=0x7f3988155bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 --2- 172.21.15.194:0/2141333483 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39880c8f90 0x7f3988155bf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f398806d290 tx=0x7f398002bde0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 -- 172.21.15.194:0/2141333483 shutdown_connections 2024-03-07T10:21:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 --2- 172.21.15.194:0/2141333483 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f39880c8f90 0x7f3988155bf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 --2- 172.21.15.194:0/2141333483 >> v2:172.21.15.194:3300/0 conn(0x7f39880be720 0x7f39881556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 -- 172.21.15.194:0/2141333483 >> 172.21.15.194:0/2141333483 conn(0x7f3988066f70 msgr2=0x7f3988067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 -- 172.21.15.194:0/2141333483 shutdown_connections 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.533+0000 7f3990000640 1 -- 172.21.15.194:0/2141333483 wait complete. 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.536+0000 7f3990000640 1 Processor -- start 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.536+0000 7f3990000640 1 -- start start 2024-03-07T10:21:17.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.538+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fb58801e460 con 0x7fb59c070fd0 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.538+0000 7f3990000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.539+0000 7f3990000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 0x7f398814ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.539+0000 7f3990000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 0x7f39881ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.539+0000 7f398d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.539+0000 7f398d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51076/0 (socket says 172.21.15.194:51076) 2024-03-07T10:21:17.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.539+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc1e8021020 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f398cc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 0x7f398814ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f398e000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 0x7f39881ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398806d9d0 con 0x7f39880be720 2024-03-07T10:21:17.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398806d850 con 0x7f3988152e90 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39880c6120 con 0x7f39880c8f90 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.540+0000 7f398d600640 1 -- 172.21.15.194:0/1751478586 learned_addr learned my addr 172.21.15.194:0/1751478586 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.541+0000 7f398e000640 1 -- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 msgr2=0x7f398814ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.541+0000 7f398e000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 0x7f398814ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.541+0000 7f398e000640 1 -- 172.21.15.194:0/1751478586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 msgr2=0x7f398814a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.541+0000 7fb593400640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 0x7fb57c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.542+0000 7f398e000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.542+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb58808b5a0 con 0x7fb59c070fd0 2024-03-07T10:21:17.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.542+0000 7f398e000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398814b460 con 0x7f3988152e90 2024-03-07T10:21:17.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.542+0000 7f398d600640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:17.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.542+0000 7f398cc00640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 0x7f398814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.543+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 0x7fb57c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.543+0000 7f398e000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 0x7f39881ef120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3980032000 tx=0x7f3980004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.544+0000 7fb59aa00640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 0x7fb57c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb58c036000 tx=0x7fb58c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.546+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980043020 con 0x7f3988152e90 2024-03-07T10:21:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.546+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398003e450 con 0x7f3988152e90 2024-03-07T10:21:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.547+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398003e860 con 0x7f3988152e90 2024-03-07T10:21:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.547+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398814c1c0 con 0x7f3988152e90 2024-03-07T10:21:17.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.547+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39881eec00 con 0x7f3988152e90 2024-03-07T10:21:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.548+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb58805a160 con 0x7fb59c070fd0 2024-03-07T10:21:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.548+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3988068170 con 0x7f3988152e90 2024-03-07T10:21:17.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.554+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3980046020 con 0x7f3988152e90 2024-03-07T10:21:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.555+0000 7f3985600640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 0x7f396806da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.555+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f39800acc10 con 0x7f3988152e90 2024-03-07T10:21:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.556+0000 7f398d600640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 0x7f396806da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.557+0000 7f398d600640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 0x7f396806da60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39880ad7f0 tx=0x7f397c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.572+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f398004d030 con 0x7f3988152e90 2024-03-07T10:21:17.627 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:21:17.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:21:17.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.728+0000 7fa1ccc00640 1 Processor -- start 2024-03-07T10:21:17.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.729+0000 7fa1ccc00640 1 -- start start 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1ccc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c8152e90 0x7fa1c80c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1ccc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c8159750 con 0x7fa1c80be720 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1ccc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c8159a30 con 0x7fa1c80c8f90 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1ccc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80cb3c0 con 0x7fa1c8152e90 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1c5400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa1c80be720 0x7fa1c81556b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:60536/0 (socket says 172.21.15.194:60536) 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.731+0000 7fa1c5400640 1 -- 172.21.15.194:0/165597236 learned_addr learned my addr 172.21.15.194:0/165597236 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812126322 0 0) 0x7fa1c8159a30 con 0x7fa1c80c8f90 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ac003520 con 0x7fa1c80c8f90 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125335475 0 0) 0x7fa1c8159750 con 0x7fa1c80be720 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c8159a30 con 0x7fa1c80be720 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076709975 0 0) 0x7fa1c8159a30 con 0x7fa1c80be720 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c8152e90 msgr2=0x7fa1c80c5a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-07T10:21:17.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c8152e90 0x7fa1c80c5a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 >> v1:172.21.15.196:6789/0 conn(0x7fa1c80c8f90 legacy=0x7fa1c8155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c80cb610 con 0x7fa1c80be720 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fa1b8001670 con 0x7fa1c80be720 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 >> v1:172.21.15.194:6789/0 conn(0x7fa1c80be720 legacy=0x7fa1c81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.732+0000 7fa1c4a00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1ac004c20 0x7fa1ac005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.733+0000 7fa1c4a00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0037a0 0x7fa1ac003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.733+0000 7fa1c4a00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1ac02da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.733+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80cb3c0 con 0x7fa1ac0037a0 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.733+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac02e310 con 0x7fa1ac004390 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.733+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1ac02e510 con 0x7fa1ac004c20 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.735+0000 7fa1c6800640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1ac02da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.735+0000 7fa1c5e00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1ac004c20 0x7fa1ac005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.736+0000 7fa1c6800640 1 -- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1ac004c20 msgr2=0x7fa1ac005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:17.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.736+0000 7fa1c6800640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1ac004c20 0x7fa1ac005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.736+0000 7fa1c6800640 1 -- 172.21.15.194:0/165597236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0037a0 msgr2=0x7fa1ac003c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:21:17.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.736+0000 7fa1c6800640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1ac0037a0 0x7fa1ac003c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.752+0000 7fa1c6800640 1 -- 172.21.15.194:0/165597236 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8159a30 con 0x7fa1ac004390 2024-03-07T10:21:17.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.762+0000 7fa1c6800640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1ac02da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4001830 tx=0x7fa1ac005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c28e22cef8e954e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.766+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4001450 con 0x7fa1ac004390 2024-03-07T10:21:17.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.766+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b40052f0 con 0x7fa1ac004390 2024-03-07T10:21:17.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.766+0000 7fa1c4a00640 1 -- 172.21.15.194:0/165597236 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003830 con 0x7fa1ac004390 2024-03-07T10:21:17.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.767+0000 7fa1ccc00640 1 -- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 msgr2=0x7fa1ac02da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.767+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/165597236 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1ac02da30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4001830 tx=0x7fa1ac005830 comp rx=0 tx=0).stop 2024-03-07T10:21:17.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.767+0000 7fa1c6800640 1 -- 172.21.15.194:0/165597236 reap_dead start 2024-03-07T10:21:17.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.773+0000 7fa1ccc00640 1 -- 172.21.15.194:0/165597236 shutdown_connections 2024-03-07T10:21:17.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.773+0000 7fa1ccc00640 1 -- 172.21.15.194:0/165597236 >> 172.21.15.194:0/165597236 conn(0x7fa1c8066f70 msgr2=0x7fa1c8067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.773+0000 7fa1ccc00640 1 -- 172.21.15.194:0/165597236 shutdown_connections 2024-03-07T10:21:17.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.774+0000 7fa1ccc00640 1 -- 172.21.15.194:0/165597236 wait complete. 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.776+0000 7fa1ccc00640 1 Processor -- start 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.776+0000 7fa1ccc00640 1 -- start start 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.778+0000 7fa1ccc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1c814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.778+0000 7fa1ccc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.778+0000 7fa1ccc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 0x7fa1c814c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.778+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.778+0000 7fa1c5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51086/0 (socket says 172.21.15.194:51086) 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.787+0000 7fa1c5e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1c814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.787+0000 7fa1c6800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 0x7fa1c814c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.788+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80c5a10 con 0x7fa1c814f680 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.788+0000 7fa1c5400640 1 -- 172.21.15.194:0/229311825 learned_addr learned my addr 172.21.15.194:0/229311825 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.788+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80cb980 con 0x7fa1ac004390 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.788+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80c5b90 con 0x7fa1c814caf0 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.790+0000 7fa1c6800640 1 -- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 msgr2=0x7fa1c814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.790+0000 7fa1c6800640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1c814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.790+0000 7fa1c6800640 1 -- 172.21.15.194:0/229311825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 msgr2=0x7fa1c814bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.791+0000 7fa1c6800640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.791+0000 7fa1c6800640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8158990 con 0x7fa1c814caf0 2024-03-07T10:21:17.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.793+0000 7fa1c5400640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:17.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.794+0000 7fa1c6800640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 0x7fa1c814c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac02e4e0 tx=0x7fa1b4001200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.796+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b40054a0 con 0x7fa1c814caf0 2024-03-07T10:21:17.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.796+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b40035f0 con 0x7fa1c814caf0 2024-03-07T10:21:17.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.796+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4007030 con 0x7fa1c814caf0 2024-03-07T10:21:17.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.796+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c81501e0 con 0x7fa1c814caf0 2024-03-07T10:21:17.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.797+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c81586b0 con 0x7fa1c814caf0 2024-03-07T10:21:17.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.799+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c8068170 con 0x7fa1c814caf0 2024-03-07T10:21:17.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.824+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa1b4044030 con 0x7fa1c814caf0 2024-03-07T10:21:17.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.833+0000 7fa1be000640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 0x7fa1a806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:17.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.833+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa1b40abe30 con 0x7fa1c814caf0 2024-03-07T10:21:17.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.833+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa1b404b020 con 0x7fa1c814caf0 2024-03-07T10:21:17.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.836+0000 7fa1c5e00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 0x7fa1a806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:17.843 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.842+0000 7fa1c5e00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 0x7fa1a806dc00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80c8b20 tx=0x7fa1c0010040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:17.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.926+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5250072590 con 0x7f5250158cd0 2024-03-07T10:21:17.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.927+0000 7f5247400640 1 -- 172.21.15.194:0/944642407 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f524805c890 con 0x7f5250158cd0 2024-03-07T10:21:17.933 INFO:teuthology.orchestra.run.smithi194.stdout:55834574855 2024-03-07T10:21:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.936+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 msgr2=0x7f523006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.936+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 0x7f523006d9c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5240007fd0 tx=0x7f5240007e80 comp rx=0 tx=0).stop 2024-03-07T10:21:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.936+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 msgr2=0x7f525014a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.936+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f524800b9c0 tx=0x7f524800be80 comp rx=0 tx=0).stop 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 shutdown_connections 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f523006b500 0x7f523006d9c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5250158cd0 0x7f525014a0d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f52500c8f50 0x7f5250146ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 --2- 172.21.15.194:0/944642407 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f525006bbe0 0x7f5250154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 >> 172.21.15.194:0/944642407 conn(0x7f52500cb050 msgr2=0x7f525014c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 shutdown_connections 2024-03-07T10:21:17.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.940+0000 7f5256200640 1 -- 172.21.15.194:0/944642407 wait complete. 2024-03-07T10:21:17.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.943+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efe04070fb0 con 0x7efe0406ce90 2024-03-07T10:21:17.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.944+0000 7efe01600640 1 -- 172.21.15.194:0/3826691938 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdf8040070 con 0x7efe0406ce90 2024-03-07T10:21:17.946 INFO:teuthology.orchestra.run.smithi194.stdout:55834574856 2024-03-07T10:21:17.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.950+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 msgr2=0x7efde406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.950+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 0x7efde406d9e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe040ac5e0 tx=0x7efdf0007e80 comp rx=0 tx=0).stop 2024-03-07T10:21:17.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.950+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 msgr2=0x7efe041efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.950+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 0x7efe041efc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efdf8033000 tx=0x7efdf80046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 shutdown_connections 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7efde406b520 0x7efde406d9e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7efe0406e9c0 0x7efe040bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7efe0406d270 0x7efe04152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 --2- 172.21.15.194:0/3826691938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe0406ce90 0x7efe041efc40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.951+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 >> 172.21.15.194:0/3826691938 conn(0x7efe0406b840 msgr2=0x7efe040c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.952+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 shutdown_connections 2024-03-07T10:21:17.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.952+0000 7efe0c600640 1 -- 172.21.15.194:0/3826691938 wait complete. 2024-03-07T10:21:17.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.973+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc1f0072000 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.976+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff13c152700 con 0x7ff13c0abfe0 2024-03-07T10:21:17.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.977+0000 7fc1e7400640 1 -- 172.21.15.194:0/1949550264 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1e8021020 con 0x7fc1f00c2dc0 2024-03-07T10:21:17.978 INFO:teuthology.orchestra.run.smithi194.stdout:55834574856 2024-03-07T10:21:17.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2024-03-07T10:21:17.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.979+0000 7ff132000640 1 -- 172.21.15.194:0/2498423897 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff12c05bce0 con 0x7ff13c0abfe0 2024-03-07T10:21:17.981 INFO:teuthology.orchestra.run.smithi194.stdout:55834574855 2024-03-07T10:21:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.981+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 msgr2=0x7fc1d006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.981+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 0x7fc1d006db90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0036000 tx=0x7fc1e0008030 comp rx=0 tx=0).stop 2024-03-07T10:21:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.981+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 msgr2=0x7fc1f01ea2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.981+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800cbc0 tx=0x7fc1e800a430 comp rx=0 tx=0).stop 2024-03-07T10:21:17.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 shutdown_connections 2024-03-07T10:21:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc1d006b6d0 0x7fc1d006db90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc1f0151560 0x7fc1f0140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc1f00c4460 0x7fc1f01e8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 --2- 172.21.15.194:0/1949550264 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc1f00c2dc0 0x7fc1f01ea2c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 >> 172.21.15.194:0/1949550264 conn(0x7fc1f00c3970 msgr2=0x7fc1f0150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2024-03-07T10:21:17.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 shutdown_connections 2024-03-07T10:21:17.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7fc1f4a00640 1 -- 172.21.15.194:0/1949550264 wait complete. 2024-03-07T10:21:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 msgr2=0x7ff11c06db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 0x7ff11c06db90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff134000f80 tx=0x7ff134001b20 comp rx=0 tx=0).stop 2024-03-07T10:21:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 msgr2=0x7ff13c1dabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.982+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff13c14bbf0 tx=0x7ff12c00c820 comp rx=0 tx=0).stop 2024-03-07T10:21:17.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 shutdown_connections 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff11c06b6d0 0x7ff11c06db90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff13c0abfe0 0x7ff13c1dabc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff13c1e7050 0x7ff13c1503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 --2- 172.21.15.194:0/2498423897 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff120004800 0x7ff13c1dd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 >> 172.21.15.194:0/2498423897 conn(0x7ff13c0c3970 msgr2=0x7ff13c06e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 shutdown_connections 2024-03-07T10:21:17.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.983+0000 7ff13b200640 1 -- 172.21.15.194:0/2498423897 wait complete. 2024-03-07T10:21:17.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.993+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09b8005850 con 0x7f09e00c9430 2024-03-07T10:21:17.996 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:17.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.994+0000 7f09d7400640 1 -- 172.21.15.194:0/2614462003 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09c805bf20 con 0x7f09e00c9430 2024-03-07T10:21:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 msgr2=0x7f09bc06dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 0x7f09bc06dd90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f09d0036000 tx=0x7f09d0030000 comp rx=0 tx=0).stop 2024-03-07T10:21:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 msgr2=0x7f09e01f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:17.999 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c400 tx=0x7f09c800c8c0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 shutdown_connections 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09bc06b8d0 0x7f09bc06dd90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09e0152f40 0x7f09e01494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09e00c9430 0x7f09e01f2e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 --2- 172.21.15.194:0/2614462003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09e00c7960 0x7f09e01f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 >> 172.21.15.194:0/2614462003 conn(0x7f09e00cb200 msgr2=0x7f09e00ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:18.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 shutdown_connections 2024-03-07T10:21:18.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:17.998+0000 7f09e5400640 1 -- 172.21.15.194:0/2614462003 wait complete. 2024-03-07T10:21:18.010 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.7 2024-03-07T10:21:18.011 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2024-03-07T10:21:18.026 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.2 2024-03-07T10:21:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.053+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb59c06d1c0 con 0x7fb59c070fd0 2024-03-07T10:21:18.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.054+0000 7fb593400640 1 -- 172.21.15.194:0/1897777622 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb588059a60 con 0x7fb59c070fd0 2024-03-07T10:21:18.055 INFO:teuthology.orchestra.run.smithi194.stdout:55834574854 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 msgr2=0x7fb57c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 0x7fb57c06d9c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb58c036000 tx=0x7fb58c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 msgr2=0x7fb59c1efe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb58800d830 tx=0x7fb58800dcf0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 shutdown_connections 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb57c06b500 0x7fb57c06d9c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb59c14ef50 0x7fb59c1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb59c071700 0x7fb59c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 --2- 172.21.15.194:0/1897777622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb59c070fd0 0x7fb59c1efe90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 >> 172.21.15.194:0/1897777622 conn(0x7fb59c06b470 msgr2=0x7fb59c06e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:18.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 shutdown_connections 2024-03-07T10:21:18.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.057+0000 7fb5a2800640 1 -- 172.21.15.194:0/1897777622 wait complete. 2024-03-07T10:21:18.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.070+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f39880c6550 con 0x7f3988152e90 2024-03-07T10:21:18.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.071+0000 7f3985600640 1 -- 172.21.15.194:0/1751478586 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f398007b180 con 0x7f3988152e90 2024-03-07T10:21:18.072 INFO:teuthology.orchestra.run.smithi194.stdout:55834574855 2024-03-07T10:21:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.074+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 msgr2=0x7f396806da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.074+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 0x7f396806da60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f39880ad7f0 tx=0x7f397c0090e0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.074+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 msgr2=0x7f39881ef120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.074+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 0x7f39881ef120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3980032000 tx=0x7f3980004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 shutdown_connections 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f396806b5a0 0x7f396806da60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3988152e90 0x7f39881ef120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f39880c8f90 0x7f398814ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 --2- 172.21.15.194:0/1751478586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39880be720 0x7f398814a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 >> 172.21.15.194:0/1751478586 conn(0x7f3988066f70 msgr2=0x7f3988158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 shutdown_connections 2024-03-07T10:21:18.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.075+0000 7f3990000640 1 -- 172.21.15.194:0/1751478586 wait complete. 2024-03-07T10:21:18.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2024-03-07T10:21:18.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-03-07T10:21:18.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.169+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa1c806d580 con 0x7fa1c814caf0 2024-03-07T10:21:18.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.169+0000 7fa1be000640 1 -- 172.21.15.194:0/229311825 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa1b4030070 con 0x7fa1c814caf0 2024-03-07T10:21:18.171 INFO:teuthology.orchestra.run.smithi194.stdout:55834574856 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 msgr2=0x7fa1a806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 0x7fa1a806dc00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa1c80c8b20 tx=0x7fa1c0010040 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 msgr2=0x7fa1c814c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 0x7fa1c814c2b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa1ac02e4e0 tx=0x7fa1b4001200 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 shutdown_connections 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa1a806b740 0x7fa1a806dc00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa1c814caf0 0x7fa1c814c2b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1c814f680 0x7fa1c814bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 --2- 172.21.15.194:0/229311825 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa1ac004390 0x7fa1c814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 >> 172.21.15.194:0/229311825 conn(0x7fa1c8066f70 msgr2=0x7fa1c808b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:18.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 shutdown_connections 2024-03-07T10:21:18.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:18.172+0000 7fa1ccc00640 1 -- 172.21.15.194:0/229311825 wait complete. 2024-03-07T10:21:18.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2024-03-07T10:21:18.981 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-07T10:21:18.985 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-07T10:21:19.011 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-07T10:21:19.013 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-07T10:21:19.027 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-07T10:21:19.080 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-07T10:21:19.102 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-07T10:21:19.191 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-07T10:21:19.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.246+0000 7f9ea3600640 1 Processor -- start 2024-03-07T10:21:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.247+0000 7f9ea3600640 1 -- start start 2024-03-07T10:21:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea3600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 0x7f9e9c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea3600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9e9c154ea0 0x7f9e9c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea3600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c0c6ef0 con 0x7f9e9c1549f0 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea3600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c157700 con 0x7f9e9c071340 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea3600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c7190 con 0x7f9e9c154ea0 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea0c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 0x7f9e9c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea0c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 0x7f9e9c0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59098/0 (socket says 172.21.15.194:59098) 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7f9ea0c00640 1 -- 172.21.15.194:0/3036046301 learned_addr learned my addr 172.21.15.194:0/3036046301 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.250+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3036046301 >> v2:172.21.15.196:3300/0 conn(0x7f9e9c154ea0 0x7f9e9c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7fedf7200640 1 Processor -- start 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.249+0000 7fedf7200640 1 -- start start 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.251+0000 7fedf7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 0x7fedf006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7fedf7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 0x7fedf00c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7fedf7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf00c6ff0 con 0x7fedf0157230 2024-03-07T10:21:19.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7fedf7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf00c8af0 con 0x7fedf015a930 2024-03-07T10:21:19.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7f9ea1600640 1 -- 172.21.15.194:0/3036046301 >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 msgr2=0x7f9e9c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3036046301 >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 0x7f9e9c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7f9ea1600640 1 -- 172.21.15.194:0/3036046301 >> v1:172.21.15.194:6789/0 conn(0x7f9e9c1549f0 legacy=0x7f9e9c0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7f9ea1600640 1 -- 172.21.15.194:0/3036046301 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c0c7470 con 0x7f9e9c154ea0 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.252+0000 7fedf7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00c72d0 con 0x7fedf006dc10 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.253+0000 7fedef400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 0x7fedf006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.253+0000 7fedefe00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fedf0157230 0x7fedf00c82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49790/0 (socket says 172.21.15.194:49790) 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.253+0000 7fedefe00640 1 -- 172.21.15.194:0/2482059984 learned_addr learned my addr 172.21.15.194:0/2482059984 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.254+0000 7fedf5200640 1 --2- 172.21.15.194:0/2482059984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 0x7fedf00c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.255+0000 7fedf5200640 1 -- 172.21.15.194:0/2482059984 >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 msgr2=0x7fedf006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.255+0000 7fedf5200640 1 --2- 172.21.15.194:0/2482059984 >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 0x7fedf006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.255+0000 7fedf5200640 1 -- 172.21.15.194:0/2482059984 >> v1:172.21.15.196:6789/0 conn(0x7fedf0157230 legacy=0x7fedf00c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.255+0000 7fedf5200640 1 -- 172.21.15.194:0/2482059984 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00c75b0 con 0x7fedf006dc10 2024-03-07T10:21:19.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.254+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3036046301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c154ea0 0x7f9e9c156bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0c9fd0 tx=0x7f9e9402b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51cd19c5197a9c73 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.256+0000 7fedef400640 1 --2- 172.21.15.194:0/2482059984 >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 0x7fedf006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:19.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.258+0000 7fedf5200640 1 --2- 172.21.15.194:0/2482059984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 0x7fedf00c3d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fede8009d90 tx=0x7fede802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c95820374bf8d3ea server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.259+0000 7f9e9b400640 1 -- 172.21.15.194:0/3036046301 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94037070 con 0x7f9e9c154ea0 2024-03-07T10:21:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.259+0000 7f9e9b400640 1 -- 172.21.15.194:0/3036046301 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e94030710 con 0x7f9e9c154ea0 2024-03-07T10:21:19.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.259+0000 7f9e9b400640 1 -- 172.21.15.194:0/3036046301 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94030ae0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 -- 172.21.15.194:0/3036046301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c154ea0 msgr2=0x7f9e9c156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3036046301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c154ea0 0x7f9e9c156bf0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c0c9fd0 tx=0x7f9e9402b680 comp rx=0 tx=0).stop 2024-03-07T10:21:19.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 -- 172.21.15.194:0/3036046301 shutdown_connections 2024-03-07T10:21:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3036046301 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c154ea0 0x7f9e9c156bf0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3036046301 >> v2:172.21.15.194:3300/0 conn(0x7f9e9c071340 0x7f9e9c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.260+0000 7f9ea3600640 1 -- 172.21.15.194:0/3036046301 >> 172.21.15.194:0/3036046301 conn(0x7f9e9c0c8f50 msgr2=0x7f9e9c0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.262+0000 7fedeea00640 1 -- 172.21.15.194:0/2482059984 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8039070 con 0x7fedf006dc10 2024-03-07T10:21:19.264 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.262+0000 7fedeea00640 1 -- 172.21.15.194:0/2482059984 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede802cc50 con 0x7fedf006dc10 2024-03-07T10:21:19.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.262+0000 7fedeea00640 1 -- 172.21.15.194:0/2482059984 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8034440 con 0x7fedf006dc10 2024-03-07T10:21:19.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.261+0000 7f9ea3600640 1 -- 172.21.15.194:0/3036046301 shutdown_connections 2024-03-07T10:21:19.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.261+0000 7f9ea3600640 1 -- 172.21.15.194:0/3036046301 wait complete. 2024-03-07T10:21:19.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.263+0000 7f9ea3600640 1 Processor -- start 2024-03-07T10:21:19.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.264+0000 7f9ea3600640 1 -- start start 2024-03-07T10:21:19.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.265+0000 7fedf7200640 1 -- 172.21.15.194:0/2482059984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 msgr2=0x7fedf00c3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.265+0000 7fedf7200640 1 --2- 172.21.15.194:0/2482059984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 0x7fedf00c3d20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fede8009d90 tx=0x7fede802bea0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.266+0000 7fedf7200640 1 -- 172.21.15.194:0/2482059984 shutdown_connections 2024-03-07T10:21:19.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.266+0000 7fedf7200640 1 --2- 172.21.15.194:0/2482059984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf006dc10 0x7fedf00c3d20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.266+0000 7fedf7200640 1 --2- 172.21.15.194:0/2482059984 >> v2:172.21.15.194:3300/0 conn(0x7fedf015a930 0x7fedf006d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.266+0000 7fedf7200640 1 -- 172.21.15.194:0/2482059984 >> 172.21.15.194:0/2482059984 conn(0x7fedf00c8f50 msgr2=0x7fedf00c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.266+0000 7f9ea3600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.267+0000 7f9ea3600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 0x7f9e9c1dd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.267+0000 7f9ea3600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.268+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 0x7f9e9c1dd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.268+0000 7f9e9be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 0x7f9e9c1dd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:44078/0 (socket says 172.21.15.194:44078) 2024-03-07T10:21:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.268+0000 7f9ea1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.268+0000 7f9ea1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41024/0 (socket says 172.21.15.194:41024) 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.268+0000 7f9ea0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.269+0000 7f9ea0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59128/0 (socket says 172.21.15.194:59128) 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.269+0000 7f9e9be00640 1 -- 172.21.15.194:0/3004071857 learned_addr learned my addr 172.21.15.194:0/3004071857 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.269+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c1538a0 con 0x7f9e9c071340 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.269+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c153720 con 0x7f9e9c1549f0 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.269+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0c8970 con 0x7f9e9c154ea0 2024-03-07T10:21:19.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.270+0000 7fedf7200640 1 -- 172.21.15.194:0/2482059984 shutdown_connections 2024-03-07T10:21:19.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.270+0000 7fedf7200640 1 -- 172.21.15.194:0/2482059984 wait complete. 2024-03-07T10:21:19.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.272+0000 7fedf7200640 1 Processor -- start 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea1600640 1 -- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 msgr2=0x7f9e9c1dd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 0x7f9e9c1dd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea1600640 1 -- 172.21.15.194:0/3004071857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 msgr2=0x7f9e9c1de100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea1600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c14d4b0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7f9ea0c00640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:19.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.274+0000 7f9ea1600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e94032000 tx=0x7f9e940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.273+0000 7fedf7200640 1 -- start start 2024-03-07T10:21:19.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.274+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94037040 con 0x7f9e9c154ea0 2024-03-07T10:21:19.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.274+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9403bbb0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.274+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e94032400 con 0x7f9e9c154ea0 2024-03-07T10:21:19.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.275+0000 7fedf7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf006dc10 0x7fedf00bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.275+0000 7fedf7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedf0157230 0x7fedf0156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.275+0000 7fedf7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c14dfd0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedf7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0157790 con 0x7fedf006dc10 2024-03-07T10:21:19.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c1dcc00 con 0x7f9e9c154ea0 2024-03-07T10:21:19.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedf5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedf5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41040/0 (socket says 172.21.15.194:41040) 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedf5200640 1 -- 172.21.15.194:0/776671381 learned_addr learned my addr 172.21.15.194:0/776671381 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf0157610 con 0x7fedf0157230 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedefe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf006dc10 0x7fedf00bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.276+0000 7fedef400640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedf0157230 0x7fedf0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.277+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf00c4260 con 0x7fedf015a930 2024-03-07T10:21:19.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7fedf5200640 1 -- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedf0157230 msgr2=0x7fedf0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7fedf5200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedf0157230 0x7fedf0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7fedf5200640 1 -- 172.21.15.194:0/776671381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf006dc10 msgr2=0x7fedf00bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7fedf5200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf006dc10 0x7fedf00bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7fedf5200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00aa4e0 con 0x7fedf015a930 2024-03-07T10:21:19.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.278+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c068170 con 0x7f9e9c154ea0 2024-03-07T10:21:19.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.280+0000 7fedf5200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fede802c4b0 tx=0x7fede8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.280+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9e940325a0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.280+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8044020 con 0x7fedf015a930 2024-03-07T10:21:19.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.281+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf015dbe0 con 0x7fedf015a930 2024-03-07T10:21:19.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.281+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf0165810 con 0x7fedf015a930 2024-03-07T10:21:19.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.281+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede802ca50 con 0x7fedf015a930 2024-03-07T10:21:19.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.282+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8044020 con 0x7fedf015a930 2024-03-07T10:21:19.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.282+0000 7f9e98c00640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 0x7f9e7c06da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.282+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f9e940af800 con 0x7f9e9c154ea0 2024-03-07T10:21:19.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.283+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc8005290 con 0x7fedf015a930 2024-03-07T10:21:19.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.283+0000 7f9ea0c00640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 0x7f9e7c06da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.285+0000 7f9ea0c00640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 0x7f9e7c06da60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009c30 tx=0x7f9e88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.298+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9e94040070 con 0x7f9e9c154ea0 2024-03-07T10:21:19.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.302+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fede8047020 con 0x7fedf015a930 2024-03-07T10:21:19.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.303+0000 7fede7e00640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 0x7fedd006db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.303+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fede80acc20 con 0x7fedf015a930 2024-03-07T10:21:19.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.307+0000 7fedefe00640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 0x7fedd006db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.308+0000 7fedefe00640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 0x7fedd006db90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fede0005880 tx=0x7fede0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.310+0000 7f78da000640 1 Processor -- start 2024-03-07T10:21:19.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.310+0000 7f78da000640 1 -- start start 2024-03-07T10:21:19.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.310+0000 7f2a86600640 1 Processor -- start 2024-03-07T10:21:19.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.311+0000 7f2a86600640 1 -- start start 2024-03-07T10:21:19.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.311+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fede804e030 con 0x7fedf015a930 2024-03-07T10:21:19.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78da000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78d41572d0 0x7f78d4070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78da000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f78d415d6d0 0x7f78d415db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.313 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78da000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d406e5d0 con 0x7f78d415a640 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78da000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d415abb0 con 0x7f78d41572d0 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78da000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d406e8b0 con 0x7f78d415d6d0 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f78d3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78d41572d0 0x7f78d4070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78d41572d0 0x7f78d4070f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59148/0 (socket says 172.21.15.194:59148) 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 -- 172.21.15.194:0/1425712455 learned_addr learned my addr 172.21.15.194:0/1425712455 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.314 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3e00640 1 --2- 172.21.15.194:0/1425712455 >> v2:172.21.15.196:3300/0 conn(0x7f78d415d6d0 0x7f78d415db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.312+0000 7f2a86600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2a801528a0 0x7f2a80152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f2a86600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a80155b20 con 0x7f2a800c5bc0 2024-03-07T10:21:19.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f2a86600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a80155dc0 con 0x7f2a8006c1c0 2024-03-07T10:21:19.315 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f2a86600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800c95e0 con 0x7f2a801528a0 2024-03-07T10:21:19.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 -- 172.21.15.194:0/1425712455 >> v2:172.21.15.196:3300/0 conn(0x7f78d415d6d0 msgr2=0x7f78d415db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 --2- 172.21.15.194:0/1425712455 >> v2:172.21.15.196:3300/0 conn(0x7f78d415d6d0 0x7f78d415db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 -- 172.21.15.194:0/1425712455 >> v1:172.21.15.194:6789/0 conn(0x7f78d415a640 legacy=0x7f78d40c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.313+0000 7f78d3400640 1 -- 172.21.15.194:0/1425712455 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d406eb90 con 0x7f78d41572d0 2024-03-07T10:21:19.316 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.314+0000 7f2a85200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2a800c5bc0 0x7f2a800c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43720/0 (socket says 172.21.15.194:43720) 2024-03-07T10:21:19.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.314+0000 7f2a85200640 1 -- 172.21.15.194:0/433185062 learned_addr learned my addr 172.21.15.194:0/433185062 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:19.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.315+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843985650 0 0) 0x7f2a80155b20 con 0x7f2a800c5bc0 2024-03-07T10:21:19.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.315+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a68003520 con 0x7f2a800c5bc0 2024-03-07T10:21:19.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098835998 0 0) 0x7f2a68003520 con 0x7f2a800c5bc0 2024-03-07T10:21:19.317 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 >> v2:172.21.15.196:3300/0 conn(0x7f2a801528a0 msgr2=0x7f2a80152c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 --2- 172.21.15.194:0/433185062 >> v2:172.21.15.196:3300/0 conn(0x7f2a801528a0 0x7f2a80152c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 >> v1:172.21.15.196:6789/0 conn(0x7f2a8006c1c0 legacy=0x7f2a8006c610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a80156080 con 0x7f2a800c5bc0 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f2a74001650 con 0x7f2a800c5bc0 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 >> v1:172.21.15.194:6789/0 conn(0x7f2a800c5bc0 legacy=0x7f2a800c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 0x7f2a68003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a680053c0 0x7f2a6800ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800c95e0 con 0x7f2a68003a00 2024-03-07T10:21:19.318 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68014b10 con 0x7f2a680053c0 2024-03-07T10:21:19.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68014d10 con 0x7f2a68004800 2024-03-07T10:21:19.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.315+0000 7f78d3400640 1 --2- 172.21.15.194:0/1425712455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d4070f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78d40c39d0 tx=0x7f78c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d23d241a0f6f6a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f78d2000640 1 -- 172.21.15.194:0/1425712455 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c402e070 con 0x7f78d41572d0 2024-03-07T10:21:19.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.316+0000 7f78d2000640 1 -- 172.21.15.194:0/1425712455 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c4037070 con 0x7f78d41572d0 2024-03-07T10:21:19.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.317+0000 7f78d2000640 1 -- 172.21.15.194:0/1425712455 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c4031a00 con 0x7f78d41572d0 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.317+0000 7f78da000640 1 -- 172.21.15.194:0/1425712455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 msgr2=0x7f78d4070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.317+0000 7f78da000640 1 --2- 172.21.15.194:0/1425712455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d4070f80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f78d40c39d0 tx=0x7f78c402b880 comp rx=0 tx=0).stop 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 -- 172.21.15.194:0/1425712455 shutdown_connections 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 --2- 172.21.15.194:0/1425712455 >> v2:172.21.15.196:3300/0 conn(0x7f78d415d6d0 0x7f78d415db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 --2- 172.21.15.194:0/1425712455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d4070f80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 -- 172.21.15.194:0/1425712455 >> 172.21.15.194:0/1425712455 conn(0x7f78d406b470 msgr2=0x7f78d406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 -- 172.21.15.194:0/1425712455 shutdown_connections 2024-03-07T10:21:19.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.317+0000 7f2a85200640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 0x7f2a68003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f2a85c00640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a680053c0 0x7f2a6800ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f2a7fe00640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85200640 1 -- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a68004800 msgr2=0x7f2a68004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.321 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85200640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85200640 1 -- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a680053c0 msgr2=0x7f2a6800ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85200640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a680053c0 0x7f2a6800ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85200640 1 -- 172.21.15.194:0/433185062 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a68003520 con 0x7f2a68003a00 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a85c00640 1 -- 172.21.15.194:0/433185062 reap_dead start 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.319+0000 7f2a7fe00640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a68004800 0x7f2a68004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:19.322 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.321+0000 7f2a85200640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 0x7f2a68003e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c340 tx=0x7f2a68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359257c7df397210 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.318+0000 7f78da000640 1 -- 172.21.15.194:0/1425712455 wait complete. 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.321+0000 7f78da000640 1 Processor -- start 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.321+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74007be0 con 0x7f2a68003a00 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.321+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74030030 con 0x7f2a68003a00 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.321+0000 7f2a7f400640 1 -- 172.21.15.194:0/433185062 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7402ce60 con 0x7f2a68003a00 2024-03-07T10:21:19.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.322+0000 7f78da000640 1 -- start start 2024-03-07T10:21:19.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.322+0000 7f2a86600640 1 -- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 msgr2=0x7f2a68003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.322+0000 7f2a86600640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 0x7f2a68003e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c340 tx=0x7f2a68005830 comp rx=0 tx=0).stop 2024-03-07T10:21:19.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.323+0000 7f2a86600640 1 -- 172.21.15.194:0/433185062 shutdown_connections 2024-03-07T10:21:19.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.323+0000 7f2a86600640 1 --2- 172.21.15.194:0/433185062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a68003a00 0x7f2a68003e40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.323+0000 7f2a86600640 1 -- 172.21.15.194:0/433185062 >> 172.21.15.194:0/433185062 conn(0x7f2a800675e0 msgr2=0x7f2a800cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.324+0000 7f78da000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.324+0000 7f78da000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 0x7f78d40abbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78da000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d415d6d0 0x7f78d4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.326 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f2a86600640 1 -- 172.21.15.194:0/433185062 shutdown_connections 2024-03-07T10:21:19.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78d3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78d3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59180/0 (socket says 172.21.15.194:59180) 2024-03-07T10:21:19.327 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f2a86600640 1 -- 172.21.15.194:0/433185062 wait complete. 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78d3400640 1 -- 172.21.15.194:0/1301564652 learned_addr learned my addr 172.21.15.194:0/1301564652 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d406cc20 con 0x7f78d41572d0 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d415e0c0 con 0x7f78d415d6d0 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d40c4590 con 0x7f78d415a640 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78d2a00640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 0x7f78d40abbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.325+0000 7f78d3e00640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d415d6d0 0x7f78d4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.326+0000 7f78d2a00640 1 -- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d415d6d0 msgr2=0x7f78d4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.326+0000 7f78d2a00640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d415d6d0 0x7f78d4151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.328 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.326+0000 7f78d2a00640 1 -- 172.21.15.194:0/1301564652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 msgr2=0x7f78d40c1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.327+0000 7f2a86600640 1 Processor -- start 2024-03-07T10:21:19.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.328+0000 7f78d2a00640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.328+0000 7f78d2a00640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d41f7870 con 0x7f78d415a640 2024-03-07T10:21:19.329 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.328+0000 7f78d3400640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:19.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.328+0000 7f2a86600640 1 -- start start 2024-03-07T10:21:19.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a68003a00 0x7f2a80151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7fe793000640 1 Processor -- start 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a8013f710 0x7f2a8013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80155730 con 0x7f2a80142f90 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80156640 con 0x7f2a68003a00 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7f2a86600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a801558b0 con 0x7f2a8013f710 2024-03-07T10:21:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.330+0000 7fe793000640 1 -- start start 2024-03-07T10:21:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.331+0000 7f2a7fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.331+0000 7f2a7fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59184/0 (socket says 172.21.15.194:59184) 2024-03-07T10:21:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.331+0000 7f2a7fe00640 1 -- 172.21.15.194:0/1812444332 learned_addr learned my addr 172.21.15.194:0/1812444332 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.333+0000 7f2a7fe00640 1 -- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a8013f710 msgr2=0x7f2a8013fbc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T10:21:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.333+0000 7f2a7fe00640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a8013f710 0x7f2a8013fbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.333+0000 7f2a7fe00640 1 -- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a68003a00 msgr2=0x7f2a80151f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.333+0000 7f2a7fe00640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a68003a00 0x7f2a80151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.333+0000 7f2a7fe00640 1 -- 172.21.15.194:0/1812444332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a801e7120 con 0x7f2a80142f90 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.328+0000 7f78d2a00640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 0x7f78d40abbc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c3c0 tx=0x7f78c000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.329+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0017070 con 0x7f78d415a640 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.329+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c00052d0 con 0x7f78d415a640 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.329+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c0003830 con 0x7f78d415a640 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.332+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d40c20d0 con 0x7f78d415a640 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.332+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d41f7b10 con 0x7f78d415a640 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f2a7fe00640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d440 tx=0x7f2a6c00d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d4068170 con 0x7f78d415a640 2024-03-07T10:21:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7fe793000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 0x7fe78c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c018020 con 0x7f2a80142f90 2024-03-07T10:21:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6c014620 con 0x7f2a80142f90 2024-03-07T10:21:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c0149f0 con 0x7f2a80142f90 2024-03-07T10:21:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.334+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a801eb3f0 con 0x7f2a80142f90 2024-03-07T10:21:19.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.335+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a80150820 con 0x7f2a80142f90 2024-03-07T10:21:19.338 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.335+0000 7fe793000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe78c070fd0 0x7fe78c0c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.338+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a80150330 con 0x7f2a80142f90 2024-03-07T10:21:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.337+0000 7fe78be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 0x7fe78c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.337+0000 7fe78be00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 0x7fe78c14ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:44136/0 (socket says 172.21.15.194:44136) 2024-03-07T10:21:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.337+0000 7fe78be00640 1 -- 172.21.15.194:0/1018609625 learned_addr learned my addr 172.21.15.194:0/1018609625 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.338+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c06d480 con 0x7fe78c14ef50 2024-03-07T10:21:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.338+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c06da30 con 0x7fe78c070fd0 2024-03-07T10:21:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.338+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c1522c0 con 0x7fe78c071700 2024-03-07T10:21:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.339+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f2a6c01b020 con 0x7f2a80142f90 2024-03-07T10:21:19.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.340+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f78c001a070 con 0x7f78d415a640 2024-03-07T10:21:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.341+0000 7f2a7cc00640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 0x7f2a6006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.339+0000 7fe78b400640 1 --2- 172.21.15.194:0/1018609625 >> v2:172.21.15.194:3300/0 conn(0x7fe78c070fd0 0x7fe78c0c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.341+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f2a6c08a690 con 0x7f2a80142f90 2024-03-07T10:21:19.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.342+0000 7f2a85200640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 0x7f2a6006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.341+0000 7f78cb400640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 0x7f78b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.342+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f78c0089920 con 0x7f78d415a640 2024-03-07T10:21:19.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.342+0000 7f78d3400640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 0x7f78b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.343+0000 7fe78b400640 1 -- 172.21.15.194:0/1018609625 >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 msgr2=0x7fe78c14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.344+0000 7f78d3400640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 0x7f78b406d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009630 tx=0x7f78c403d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.343+0000 7fe78b400640 1 --2- 172.21.15.194:0/1018609625 >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 0x7fe78c14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.343+0000 7fe78b400640 1 -- 172.21.15.194:0/1018609625 >> v1:172.21.15.194:6789/0 conn(0x7fe78c14ef50 legacy=0x7fe78c0c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.343+0000 7fe78b400640 1 -- 172.21.15.194:0/1018609625 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c1527a0 con 0x7fe78c070fd0 2024-03-07T10:21:19.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.345+0000 7f2a85200640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 0x7f2a6006d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a74034000 tx=0x7f2a74006000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.345+0000 7fe78b400640 1 --2- 172.21.15.194:0/1018609625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c070fd0 0x7fe78c0c19c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0c36d0 tx=0x7fe77402d930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6fd56e328f1284 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.350+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f78c0057cf0 con 0x7f78d415a640 2024-03-07T10:21:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.355+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2a6c022020 con 0x7f2a80142f90 2024-03-07T10:21:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.355+0000 7fe78aa00640 1 -- 172.21.15.194:0/1018609625 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe774008df0 con 0x7fe78c070fd0 2024-03-07T10:21:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.356+0000 7fe78aa00640 1 -- 172.21.15.194:0/1018609625 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe774038070 con 0x7fe78c070fd0 2024-03-07T10:21:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.357+0000 7fe78aa00640 1 -- 172.21.15.194:0/1018609625 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400a2f0 con 0x7fe78c070fd0 2024-03-07T10:21:19.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c070fd0 msgr2=0x7fe78c0c19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 --2- 172.21.15.194:0/1018609625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c070fd0 0x7fe78c0c19c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe78c0c36d0 tx=0x7fe77402d930 comp rx=0 tx=0).stop 2024-03-07T10:21:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 shutdown_connections 2024-03-07T10:21:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 --2- 172.21.15.194:0/1018609625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c070fd0 0x7fe78c0c19c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 --2- 172.21.15.194:0/1018609625 >> v2:172.21.15.196:3300/0 conn(0x7fe78c071700 0x7fe78c14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.359+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 >> 172.21.15.194:0/1018609625 conn(0x7fe78c06b470 msgr2=0x7fe78c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.363+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 shutdown_connections 2024-03-07T10:21:19.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.365+0000 7fe793000640 1 -- 172.21.15.194:0/1018609625 wait complete. 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.367+0000 7fe793000640 1 Processor -- start 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.368+0000 7fe793000640 1 -- start start 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.370+0000 7fe793000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.370+0000 7fe793000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c071700 0x7fe78c155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.370+0000 7fe793000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe78c14ef50 0x7fe78c08b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.371+0000 7fe78be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.373+0000 7f4a2e400640 1 Processor -- start 2024-03-07T10:21:19.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.373+0000 7f4a2e400640 1 -- start start 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.375+0000 7f4a2e400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4a28161fc0 0x7f4a280715b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.375+0000 7f4a2e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a28166a40 con 0x7f4a2808b960 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.375+0000 7f4a2e400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a28070ee0 con 0x7f4a281623a0 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.375+0000 7f4a2e400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a28166500 con 0x7f4a28161fc0 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.376+0000 7f4a27e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4a2808b960 0x7f4a28162a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43732/0 (socket says 172.21.15.194:43732) 2024-03-07T10:21:19.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.376+0000 7f4a27e00640 1 -- 172.21.15.194:0/3229226398 learned_addr learned my addr 172.21.15.194:0/3229226398 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:19.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.376+0000 7fe793000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c06e3c0 con 0x7fe78c071700 2024-03-07T10:21:19.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.376+0000 7fe793000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c06dcd0 con 0x7fe78c14ef50 2024-03-07T10:21:19.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.376+0000 7fe793000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c06e540 con 0x7fe78c070fd0 2024-03-07T10:21:19.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.377+0000 7f4a27400640 1 --2- 172.21.15.194:0/3229226398 >> v2:172.21.15.196:3300/0 conn(0x7f4a28161fc0 0x7f4a280715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.379+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084673293 0 0) 0x7f4a28166a40 con 0x7f4a2808b960 2024-03-07T10:21:19.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.379+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a0c003440 con 0x7f4a2808b960 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 333761964 0 0) 0x7f4a0c003440 con 0x7f4a2808b960 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 >> v2:172.21.15.196:3300/0 conn(0x7f4a28161fc0 msgr2=0x7f4a280715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 --2- 172.21.15.194:0/3229226398 >> v2:172.21.15.196:3300/0 conn(0x7f4a28161fc0 0x7f4a280715b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 >> v1:172.21.15.196:6789/0 conn(0x7f4a281623a0 legacy=0x7f4a280c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2806cc20 con 0x7f4a2808b960 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f4a14001670 con 0x7f4a2808b960 2024-03-07T10:21:19.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 >> v1:172.21.15.194:6789/0 conn(0x7f4a2808b960 legacy=0x7f4a28162a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.379+0000 7fe78be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41092/0 (socket says 172.21.15.194:41092) 2024-03-07T10:21:19.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.379+0000 7fe78be00640 1 -- 172.21.15.194:0/142201622 learned_addr learned my addr 172.21.15.194:0/142201622 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 0x7f4a0c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7fe78be00640 1 -- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe78c14ef50 msgr2=0x7fe78c08b640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7fe78be00640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe78c14ef50 0x7fe78c08b640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7fe78be00640 1 -- 172.21.15.194:0/142201622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c071700 msgr2=0x7fe78c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7fe78be00640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c071700 0x7fe78c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7fe78be00640 1 -- 172.21.15.194:0/142201622 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c1559b0 con 0x7fe78c070fd0 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.381+0000 7fe78be00640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009fd0 tx=0x7fe77c00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c008850 0x7f4a0c00acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a0c00b560 0x7f4a0c00da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28166500 con 0x7f4a0c00b560 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c00e300 con 0x7f4a0c008850 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.380+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c00e500 con 0x7f4a0c003aa0 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.381+0000 7f4a27400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 0x7f4a0c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.381+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c008850 0x7f4a0c00acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.381+0000 7f4a27e00640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a0c00b560 0x7f4a0c00da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.381+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c01f020 con 0x7fe78c070fd0 2024-03-07T10:21:19.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a27400640 1 -- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c008850 msgr2=0x7f4a0c00acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a27400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c008850 0x7f4a0c00acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a27400640 1 -- 172.21.15.194:0/3229226398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a0c00b560 msgr2=0x7f4a0c00da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a27400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a0c00b560 0x7f4a0c00da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a27400640 1 -- 172.21.15.194:0/3229226398 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a2806cc20 con 0x7f4a0c003aa0 2024-03-07T10:21:19.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c008850 0x7f4a0c00acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:19.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c155c80 con 0x7fe78c070fd0 2024-03-07T10:21:19.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.382+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c154950 con 0x7fe78c070fd0 2024-03-07T10:21:19.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.384+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c0123e0 con 0x7fe78c070fd0 2024-03-07T10:21:19.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.385+0000 7f4a27e00640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a0c00b560 0x7f4a0c00da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:19.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.385+0000 7f4a27e00640 1 -- 172.21.15.194:0/3229226398 reap_dead start 2024-03-07T10:21:19.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.386+0000 7f4a27400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 0x7f4a0c003ec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009fc0 tx=0x7f4a0c003730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=899671cbc1ba5fff server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.388+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c068170 con 0x7fe78c070fd0 2024-03-07T10:21:19.390 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.389+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c012ea0 con 0x7fe78c070fd0 2024-03-07T10:21:19.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.389+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe77c022020 con 0x7fe78c070fd0 2024-03-07T10:21:19.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.391+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2003c070 con 0x7f4a0c003aa0 2024-03-07T10:21:19.392 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.391+0000 7fe783e00640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 0x7fe76806da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.391+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe77c092d30 con 0x7fe78c070fd0 2024-03-07T10:21:19.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.392+0000 7fe78b400640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 0x7fe76806da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.394+0000 7fe78b400640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 0x7fe76806da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe774037000 tx=0x7fe774032000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.407 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.405+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe77c029030 con 0x7fe78c070fd0 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.405+0000 7f4a26000640 1 -- 172.21.15.194:0/3229226398 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a20037600 con 0x7f4a0c003aa0 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.406+0000 7f4a2e400640 1 -- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 msgr2=0x7f4a0c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.406+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 0x7f4a0c003ec0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009fc0 tx=0x7f4a0c003730 comp rx=0 tx=0).stop 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.406+0000 7f4a2e400640 1 -- 172.21.15.194:0/3229226398 shutdown_connections 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.406+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3229226398 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a0c003aa0 0x7f4a0c003ec0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.406+0000 7f4a2e400640 1 -- 172.21.15.194:0/3229226398 >> 172.21.15.194:0/3229226398 conn(0x7f4a2806b470 msgr2=0x7f4a2806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.407+0000 7f4a2e400640 1 -- 172.21.15.194:0/3229226398 shutdown_connections 2024-03-07T10:21:19.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.407+0000 7f4a2e400640 1 -- 172.21.15.194:0/3229226398 wait complete. 2024-03-07T10:21:19.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.410+0000 7f4a2e400640 1 Processor -- start 2024-03-07T10:21:19.412 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.411+0000 7f4a2e400640 1 -- start start 2024-03-07T10:21:19.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.416+0000 7f4a2e400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 0x7f4a280bc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.417+0000 7f4a2e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 0x7f4a28164c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.417+0000 7f4a2e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a2815b730 0x7f4a2815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.417+0000 7f4a2e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2806e850 con 0x7f4a2815b730 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.417+0000 7f4a27400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 0x7f4a280bc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.418+0000 7f4a27400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 0x7f4a280bc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:44170/0 (socket says 172.21.15.194:44170) 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.418+0000 7f4a27400640 1 -- 172.21.15.194:0/3510449943 learned_addr learned my addr 172.21.15.194:0/3510449943 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.418+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a28071180 con 0x7f4a0c003aa0 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.418+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a2806e9d0 con 0x7f4a280ab0e0 2024-03-07T10:21:19.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.418+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 0x7f4a28164c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.419+0000 7f4a27e00640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a2815b730 0x7f4a2815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.420+0000 7f4a26a00640 1 -- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 msgr2=0x7f4a280bc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.420+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 0x7f4a280bc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.420+0000 7f4a26a00640 1 -- 172.21.15.194:0/3510449943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a2815b730 msgr2=0x7f4a2815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.420+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a2815b730 0x7f4a2815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.420+0000 7f4a26a00640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a280ac370 con 0x7f4a280ab0e0 2024-03-07T10:21:19.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.421+0000 7f4a26a00640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 0x7f4a28164c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800f7d0 tx=0x7f4a1800fc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.422+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a1801a070 con 0x7f4a280ab0e0 2024-03-07T10:21:19.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.422+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a280ab5f0 con 0x7f4a280ab0e0 2024-03-07T10:21:19.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.422+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a280ab890 con 0x7f4a280ab0e0 2024-03-07T10:21:19.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.422+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a18005320 con 0x7f4a280ab0e0 2024-03-07T10:21:19.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.422+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a18007250 con 0x7f4a280ab0e0 2024-03-07T10:21:19.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.424+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a28068170 con 0x7f4a280ab0e0 2024-03-07T10:21:19.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.428+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4a180073f0 con 0x7f4a280ab0e0 2024-03-07T10:21:19.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.429+0000 7f4a1f400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 0x7f4a0806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.431+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f4a1808a110 con 0x7f4a280ab0e0 2024-03-07T10:21:19.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.431+0000 7f4a27400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 0x7f4a0806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.433+0000 7f4a27400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 0x7f4a0806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a200095c0 tx=0x7f4a20034000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.443+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4a18023020 con 0x7f4a280ab0e0 2024-03-07T10:21:19.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.448+0000 7f588a000640 1 Processor -- start 2024-03-07T10:21:19.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.448+0000 7f588a000640 1 -- start start 2024-03-07T10:21:19.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.450+0000 7f588a000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.451+0000 7f588a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 0x7f587c0071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.451+0000 7f5888c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.451+0000 7f5888c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41112/0 (socket says 172.21.15.194:41112) 2024-03-07T10:21:19.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.451+0000 7f5888c00640 1 -- 172.21.15.194:0/90281312 learned_addr learned my addr 172.21.15.194:0/90281312 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.452+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c0df740 con 0x7f587c0076f0 2024-03-07T10:21:19.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.452+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c04a560 con 0x7f587c04dae0 2024-03-07T10:21:19.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.452+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c04a840 con 0x7f587c0dbe80 2024-03-07T10:21:19.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.453+0000 7f5883e00640 1 --2- 172.21.15.194:0/90281312 >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 0x7f587c0071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.454+0000 7f5888c00640 1 -- 172.21.15.194:0/90281312 >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 msgr2=0x7f587c0071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.454+0000 7f5888c00640 1 --2- 172.21.15.194:0/90281312 >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 0x7f587c0071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.454+0000 7f5883400640 1 -- 172.21.15.194:0/90281312 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988459724 0 0) 0x7f587c0df740 con 0x7f587c0076f0 2024-03-07T10:21:19.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.454+0000 7f5888c00640 1 -- 172.21.15.194:0/90281312 >> v1:172.21.15.194:6789/0 conn(0x7f587c0076f0 legacy=0x7f587c00ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.455+0000 7f5888c00640 1 -- 172.21.15.194:0/90281312 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c04ab20 con 0x7f587c0dbe80 2024-03-07T10:21:19.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.457+0000 7f5883e00640 1 --2- 172.21.15.194:0/90281312 >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 0x7f587c0071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.458+0000 7f5888c00640 1 --2- 172.21.15.194:0/90281312 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d6dca8b90803f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.458+0000 7f5883400640 1 -- 172.21.15.194:0/90281312 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878035020 con 0x7f587c0dbe80 2024-03-07T10:21:19.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.459+0000 7f5883400640 1 -- 172.21.15.194:0/90281312 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5878031890 con 0x7f587c0dbe80 2024-03-07T10:21:19.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.460+0000 7f5883400640 1 -- 172.21.15.194:0/90281312 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5878035020 con 0x7f587c0dbe80 2024-03-07T10:21:19.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.460+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 msgr2=0x7f587c0df200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.460+0000 7f588a000640 1 --2- 172.21.15.194:0/90281312 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5878009870 tx=0x7f587802b930 comp rx=0 tx=0).stop 2024-03-07T10:21:19.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.461+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 shutdown_connections 2024-03-07T10:21:19.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.461+0000 7f588a000640 1 --2- 172.21.15.194:0/90281312 >> v2:172.21.15.194:3300/0 conn(0x7f587c04dae0 0x7f587c0071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.461+0000 7f588a000640 1 --2- 172.21.15.194:0/90281312 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0df200 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.461+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 >> 172.21.15.194:0/90281312 conn(0x7f587c04c660 msgr2=0x7f587c04ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.462+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 shutdown_connections 2024-03-07T10:21:19.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.465+0000 7f588a000640 1 -- 172.21.15.194:0/90281312 wait complete. 2024-03-07T10:21:19.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.468+0000 7f588a000640 1 Processor -- start 2024-03-07T10:21:19.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.468+0000 7f588a000640 1 -- start start 2024-03-07T10:21:19.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.471+0000 7f588a000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.471+0000 7f588a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.471+0000 7f5888c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.471+0000 7f5888c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:44182/0 (socket says 172.21.15.194:44182) 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.472+0000 7f5883e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.472+0000 7f5883e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59248/0 (socket says 172.21.15.194:59248) 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.472+0000 7f5888c00640 1 -- 172.21.15.194:0/2332908131 learned_addr learned my addr 172.21.15.194:0/2332908131 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.473+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.473+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c04ae00 con 0x7f587c04dae0 2024-03-07T10:21:19.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.473+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c00e4e0 con 0x7f587c0076f0 2024-03-07T10:21:19.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.473+0000 7f5889600640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.474+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c00fdc0 con 0x7f587c0dbe80 2024-03-07T10:21:19.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5883e00640 1 -- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 msgr2=0x7f587c0e0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5883e00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0e0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5883e00640 1 -- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 msgr2=0x7f587c1749b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5883e00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5883e00640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c174ef0 con 0x7f587c04dae0 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.475+0000 7f5888c00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:19.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.476+0000 7f5883e00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f587000c7f0 tx=0x7f587000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.481+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870015070 con 0x7f587c04dae0 2024-03-07T10:21:19.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.481+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870004220 con 0x7f587c04dae0 2024-03-07T10:21:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.481+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0ded10 con 0x7f587c04dae0 2024-03-07T10:21:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.481+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870007620 con 0x7f587c04dae0 2024-03-07T10:21:19.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.481+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0e0130 con 0x7f587c04dae0 2024-03-07T10:21:19.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.483+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5860005290 con 0x7f587c04dae0 2024-03-07T10:21:19.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.489+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f58700077c0 con 0x7f587c04dae0 2024-03-07T10:21:19.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.510+0000 7f5880c00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 0x7f586406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.510+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f58700899f0 con 0x7f587c04dae0 2024-03-07T10:21:19.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.511+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5870089d20 con 0x7f587c04dae0 2024-03-07T10:21:19.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.515+0000 7f5888c00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 0x7f586406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.518+0000 7f5888c00640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 0x7f586406d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5878009280 tx=0x7f5878008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.559+0000 7f99f9400640 1 Processor -- start 2024-03-07T10:21:19.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.559+0000 7f99f9400640 1 -- start start 2024-03-07T10:21:19.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f9400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99f40c5bc0 0x7f99f40c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f9400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f99f41528a0 0x7f99f4152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f9400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f4155b20 con 0x7f99f406c1c0 2024-03-07T10:21:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f9400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f41531c0 con 0x7f99f40c5bc0 2024-03-07T10:21:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f9400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f4155dc0 con 0x7f99f41528a0 2024-03-07T10:21:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f8a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f99f406c1c0 0x7f99f406c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43760/0 (socket says 172.21.15.194:43760) 2024-03-07T10:21:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f99f40c5bc0 0x7f99f40c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.561+0000 7f99f8a00640 1 -- 172.21.15.194:0/1568950924 learned_addr learned my addr 172.21.15.194:0/1568950924 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:19.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.563+0000 7f99f2a00640 1 -- 172.21.15.194:0/1568950924 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162075604 0 0) 0x7f99f4155b20 con 0x7f99f406c1c0 2024-03-07T10:21:19.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.563+0000 7f99f3e00640 1 -- 172.21.15.194:0/1568950924 >> v2:172.21.15.196:3300/0 conn(0x7f99f41528a0 msgr2=0x7f99f4152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:19.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.563+0000 7f99f3e00640 1 --2- 172.21.15.194:0/1568950924 >> v2:172.21.15.196:3300/0 conn(0x7f99f41528a0 0x7f99f4152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.563+0000 7f99f3e00640 1 -- 172.21.15.194:0/1568950924 >> v1:172.21.15.194:6789/0 conn(0x7f99f406c1c0 legacy=0x7f99f406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.563+0000 7f99f3e00640 1 -- 172.21.15.194:0/1568950924 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4156080 con 0x7f99f40c5bc0 2024-03-07T10:21:19.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.566+0000 7f99f3e00640 1 --2- 172.21.15.194:0/1568950924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f40c8ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99f4153340 tx=0x7f99e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83a2d5d860bc648 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.567+0000 7f99f2a00640 1 -- 172.21.15.194:0/1568950924 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40315a0 con 0x7f99f40c5bc0 2024-03-07T10:21:19.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.567+0000 7f99f2a00640 1 -- 172.21.15.194:0/1568950924 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4037070 con 0x7f99f40c5bc0 2024-03-07T10:21:19.568 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.567+0000 7f99f2a00640 1 -- 172.21.15.194:0/1568950924 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40315a0 con 0x7f99f40c5bc0 2024-03-07T10:21:19.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.575+0000 7f99f9400640 1 -- 172.21.15.194:0/1568950924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 msgr2=0x7f99f40c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.575+0000 7f99f9400640 1 --2- 172.21.15.194:0/1568950924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f40c8ed0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f99f4153340 tx=0x7f99e402b840 comp rx=0 tx=0).stop 2024-03-07T10:21:19.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.577+0000 7f99f9400640 1 -- 172.21.15.194:0/1568950924 shutdown_connections 2024-03-07T10:21:19.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.577+0000 7f99f9400640 1 --2- 172.21.15.194:0/1568950924 >> v2:172.21.15.196:3300/0 conn(0x7f99f41528a0 0x7f99f4152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.577+0000 7f99f9400640 1 --2- 172.21.15.194:0/1568950924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f40c8ed0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.577+0000 7f99f9400640 1 -- 172.21.15.194:0/1568950924 >> 172.21.15.194:0/1568950924 conn(0x7f99f40675e0 msgr2=0x7f99f40cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.579+0000 7f99f9400640 1 -- 172.21.15.194:0/1568950924 shutdown_connections 2024-03-07T10:21:19.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.579+0000 7f99f9400640 1 -- 172.21.15.194:0/1568950924 wait complete. 2024-03-07T10:21:19.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.582+0000 7f99f9400640 1 Processor -- start 2024-03-07T10:21:19.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.582+0000 7f99f9400640 1 -- start start 2024-03-07T10:21:19.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.583+0000 7f99f9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99f406c1c0 0x7f99f414ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.586+0000 7f99f9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f4156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.586+0000 7f99f9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4155730 con 0x7f99f40c5bc0 2024-03-07T10:21:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f9400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f4156640 con 0x7f99f406c1c0 2024-03-07T10:21:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f9400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f41558b0 con 0x7f99f41528a0 2024-03-07T10:21:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f4156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f8a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41140/0 (socket says 172.21.15.194:41140) 2024-03-07T10:21:19.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f8a00640 1 -- 172.21.15.194:0/221481279 learned_addr learned my addr 172.21.15.194:0/221481279 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:19.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.588+0000 7f99f3e00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99f406c1c0 0x7f99f414ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 -- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99f406c1c0 msgr2=0x7f99f414ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99f406c1c0 0x7f99f414ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 -- 172.21.15.194:0/221481279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 msgr2=0x7f99f4156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f4156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 -- 172.21.15.194:0/221481279 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f40c3070 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.589+0000 7f99f8a00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c810 tx=0x7f99ec00ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.593+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec018070 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.593+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f41591c0 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.593+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f4159780 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.593+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec00a640 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.593+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00aa30 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.602+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f99ec01b070 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.602+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc005290 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.603+0000 7f99ebe00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 0x7f99d406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.603+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f99ec089cb0 con 0x7f99f41528a0 2024-03-07T10:21:19.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.606+0000 7f99f3e00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 0x7f99d406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:19.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.608+0000 7f99f3e00640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 0x7f99d406da60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99e4036000 tx=0x7f99e4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:19.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.618+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f99ec0587e0 con 0x7f99f41528a0 2024-03-07T10:21:19.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.688+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e9c0c8040 con 0x7f9e9c154ea0 2024-03-07T10:21:19.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.691+0000 7f9e98c00640 1 -- 172.21.15.194:0/3004071857 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e9407dce0 con 0x7f9e9c154ea0 2024-03-07T10:21:19.693 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:19.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.699+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 msgr2=0x7f9e7c06da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.699+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 0x7f9e7c06da60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009c30 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2024-03-07T10:21:19.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.699+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 msgr2=0x7f9e9c14a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.699+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9e94032000 tx=0x7f9e940046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 shutdown_connections 2024-03-07T10:21:19.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9e7c06b5a0 0x7f9e7c06da60 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009c30 tx=0x7f9e88008040 comp rx=0 tx=0).stop 2024-03-07T10:21:19.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9e9c154ea0 0x7f9e9c14a160 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9e9c1549f0 0x7f9e9c1dd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 --2- 172.21.15.194:0/3004071857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e9c071340 0x7f9e9c1de100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.700+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 >> 172.21.15.194:0/3004071857 conn(0x7f9e9c0c8f50 msgr2=0x7f9e9c070160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.706+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 shutdown_connections 2024-03-07T10:21:19.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.706+0000 7f9ea3600640 1 -- 172.21.15.194:0/3004071857 wait complete. 2024-03-07T10:21:19.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.738+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedc8005850 con 0x7fedf015a930 2024-03-07T10:21:19.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.739+0000 7fede7e00640 1 -- 172.21.15.194:0/776671381 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fede807b800 con 0x7fedf015a930 2024-03-07T10:21:19.744 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:19.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-03-07T10:21:19.748 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.743+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 msgr2=0x7fedd006db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.743+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 0x7fedd006db90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fede0005880 tx=0x7fede0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:19.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.743+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 msgr2=0x7fedf015b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.743+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fede802c4b0 tx=0x7fede8004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:19.750 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 shutdown_connections 2024-03-07T10:21:19.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fedd006b6d0 0x7fedd006db90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fedf015a930 0x7fedf015b090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fedf0157230 0x7fedf0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 --2- 172.21.15.194:0/776671381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf006dc10 0x7fedf00bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 >> 172.21.15.194:0/776671381 conn(0x7fedf00c8f50 msgr2=0x7fedf00c5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 shutdown_connections 2024-03-07T10:21:19.752 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.744+0000 7fedf7200640 1 -- 172.21.15.194:0/776671381 wait complete. 2024-03-07T10:21:19.783 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-03-07T10:21:19.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.778+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2a80068170 con 0x7f2a80142f90 2024-03-07T10:21:19.783 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.779+0000 7f2a7cc00640 1 -- 172.21.15.194:0/1812444332 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a6c059350 con 0x7f2a80142f90 2024-03-07T10:21:19.784 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:19.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.782+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 msgr2=0x7f2a6006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.782+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 0x7f2a6006d9e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2a74034000 tx=0x7f2a74006000 comp rx=0 tx=0).stop 2024-03-07T10:21:19.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.782+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 msgr2=0x7f2a8014ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.782+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c00d440 tx=0x7f2a6c00d900 comp rx=0 tx=0).stop 2024-03-07T10:21:19.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 shutdown_connections 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2a6006b520 0x7f2a6006d9e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2a8013f710 0x7f2a8013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a80142f90 0x7f2a8014ba30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 --2- 172.21.15.194:0/1812444332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2a68003a00 0x7f2a80151f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 >> 172.21.15.194:0/1812444332 conn(0x7f2a800675e0 msgr2=0x7f2a80152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 shutdown_connections 2024-03-07T10:21:19.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.783+0000 7f2a86600640 1 -- 172.21.15.194:0/1812444332 wait complete. 2024-03-07T10:21:19.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.797+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f78d406b9f0 con 0x7f78d415a640 2024-03-07T10:21:19.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.798+0000 7f78cb400640 1 -- 172.21.15.194:0/1301564652 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78c005bd90 con 0x7f78d415a640 2024-03-07T10:21:19.801 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 msgr2=0x7f78b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 0x7f78b406d990 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f78c4009630 tx=0x7f78c403d040 comp rx=0 tx=0).stop 2024-03-07T10:21:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 msgr2=0x7f78d40abbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 0x7f78d40abbc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f78c000c3c0 tx=0x7f78c000c880 comp rx=0 tx=0).stop 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 shutdown_connections 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.802+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f78b406b4d0 0x7f78b406d990 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78d415d6d0 0x7f78d4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f78d415a640 0x7f78d40abbc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 --2- 172.21.15.194:0/1301564652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78d41572d0 0x7f78d40c1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 >> 172.21.15.194:0/1301564652 conn(0x7f78d406b470 msgr2=0x7f78d41561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 shutdown_connections 2024-03-07T10:21:19.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.803+0000 7f78da000640 1 -- 172.21.15.194:0/1301564652 wait complete. 2024-03-07T10:21:19.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-03-07T10:21:19.808 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.818+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe78c06d1c0 con 0x7fe78c070fd0 2024-03-07T10:21:19.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.819+0000 7fe783e00640 1 -- 172.21.15.194:0/142201622 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe77c061860 con 0x7fe78c070fd0 2024-03-07T10:21:19.825 INFO:teuthology.orchestra.run.smithi194.stdout:55834574859 2024-03-07T10:21:19.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 msgr2=0x7fe76806da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 0x7fe76806da10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe774037000 tx=0x7fe774032000 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 msgr2=0x7fe78c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009fd0 tx=0x7fe77c00c520 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 shutdown_connections 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe76806b550 0x7fe76806da10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe78c14ef50 0x7fe78c08b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe78c071700 0x7fe78c155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.822+0000 7fe793000640 1 --2- 172.21.15.194:0/142201622 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe78c070fd0 0x7fe78c152af0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.823+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 >> 172.21.15.194:0/142201622 conn(0x7fe78c06b470 msgr2=0x7fe78c1510c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.823+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 shutdown_connections 2024-03-07T10:21:19.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.823+0000 7fe793000640 1 -- 172.21.15.194:0/142201622 wait complete. 2024-03-07T10:21:19.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-03-07T10:21:19.831 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-03-07T10:21:19.849 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.857+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4a2806d8a0 con 0x7f4a280ab0e0 2024-03-07T10:21:19.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.858+0000 7f4a1f400640 1 -- 172.21.15.194:0/3510449943 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4a18058680 con 0x7f4a280ab0e0 2024-03-07T10:21:19.864 INFO:teuthology.orchestra.run.smithi194.stdout:55834574856 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 msgr2=0x7f4a0806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 0x7f4a0806d9c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a200095c0 tx=0x7f4a20034000 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 msgr2=0x7f4a28164c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 0x7f4a28164c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800f7d0 tx=0x7f4a1800fc90 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 shutdown_connections 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4a0806b500 0x7f4a0806d9c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a2815b730 0x7f4a2815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4a280ab0e0 0x7f4a28164c00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 --2- 172.21.15.194:0/3510449943 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4a0c003aa0 0x7f4a280bc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.861+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 >> 172.21.15.194:0/3510449943 conn(0x7f4a2806b470 msgr2=0x7f4a2815c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.862+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 shutdown_connections 2024-03-07T10:21:19.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.862+0000 7f4a2e400640 1 -- 172.21.15.194:0/3510449943 wait complete. 2024-03-07T10:21:19.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2024-03-07T10:21:19.887 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.901+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5860005850 con 0x7f587c04dae0 2024-03-07T10:21:19.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.902+0000 7f5880c00640 1 -- 172.21.15.194:0/2332908131 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5870057bc0 con 0x7f587c04dae0 2024-03-07T10:21:19.904 INFO:teuthology.orchestra.run.smithi194.stdout:55834574857 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 msgr2=0x7f586406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 0x7f586406d9c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5878009280 tx=0x7f5878008030 comp rx=0 tx=0).stop 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 msgr2=0x7f587c0dc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f587000c7f0 tx=0x7f587000ccb0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 shutdown_connections 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f586406b500 0x7f586406d9c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f587c0dbe80 0x7f587c0e0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f587c04dae0 0x7f587c0dc5f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 --2- 172.21.15.194:0/2332908131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f587c0076f0 0x7f587c1749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 >> 172.21.15.194:0/2332908131 conn(0x7f587c04c660 msgr2=0x7f587c0d9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 shutdown_connections 2024-03-07T10:21:19.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.904+0000 7f588a000640 1 -- 172.21.15.194:0/2332908131 wait complete. 2024-03-07T10:21:19.942 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-03-07T10:21:19.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.935+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f99cc005580 con 0x7f99f41528a0 2024-03-07T10:21:19.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.935+0000 7f99ebe00640 1 -- 172.21.15.194:0/221481279 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99ec0580e0 con 0x7f99f41528a0 2024-03-07T10:21:19.943 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.943 INFO:teuthology.orchestra.run.smithi194.stdout:55834574858 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 msgr2=0x7f99d406da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 0x7f99d406da60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f99e4036000 tx=0x7f99e4008030 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 msgr2=0x7f99f4157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c810 tx=0x7f99ec00ccd0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 shutdown_connections 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f99d406b5a0 0x7f99d406da60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f99f41528a0 0x7f99f4157210 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99f40c5bc0 0x7f99f4156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 --2- 172.21.15.194:0/221481279 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f99f406c1c0 0x7f99f414ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:19.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 >> 172.21.15.194:0/221481279 conn(0x7f99f40675e0 msgr2=0x7f99f41535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:19.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 shutdown_connections 2024-03-07T10:21:19.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:19.938+0000 7f99f9400640 1 -- 172.21.15.194:0/221481279 wait complete. 2024-03-07T10:21:19.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-03-07T10:21:19.958 DEBUG:teuthology.parallel:result is None 2024-03-07T10:21:19.959 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-07T10:21:19.959 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:20.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.209+0000 7ff330c00640 1 Processor -- start 2024-03-07T10:21:20.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.209+0000 7ff330c00640 1 -- start start 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff330c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff32c159700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff330c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c159c40 con 0x7ff32c152e10 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff330c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff32c0c2b50 con 0x7ff32c06b080 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff330c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c156740 con 0x7ff32c0c23d0 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff329e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff32c152e10 0x7ff32c06e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43772/0 (socket says 172.21.15.194:43772) 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff329e00640 1 -- 172.21.15.194:0/1775505850 learned_addr learned my addr 172.21.15.194:0/1775505850 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff32a800640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff32c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690726172 0 0) 0x7ff32c159c40 con 0x7ff32c152e10 2024-03-07T10:21:20.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.211+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff310003520 con 0x7ff32c152e10 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1306547217 0 0) 0x7ff310003520 con 0x7ff32c152e10 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 msgr2=0x7ff32c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff32c159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 >> v1:172.21.15.196:6789/0 conn(0x7ff32c06b080 legacy=0x7ff32c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c0c2df0 con 0x7ff32c152e10 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7ff31c001670 con 0x7ff32c152e10 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 >> v1:172.21.15.194:6789/0 conn(0x7ff32c152e10 legacy=0x7ff32c06e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3100039e0 0x7ff310003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff310004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff3100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c156740 con 0x7ff310004d40 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31000bb80 con 0x7ff3100039e0 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31000bd80 con 0x7ff32c0c23d0 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff3100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff329400640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff310004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff329e00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3100039e0 0x7ff310003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 -- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 msgr2=0x7ff310004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c23d0 0x7ff310004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 -- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3100039e0 msgr2=0x7ff310003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3100039e0 0x7ff310003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff32a800640 1 -- 172.21.15.194:0/1775505850 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff310003520 con 0x7ff310004d40 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.212+0000 7ff329e00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3100039e0 0x7ff310003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.213+0000 7ff32a800640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff3100051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff324009fc0 tx=0x7ff310005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5591145ff95e621e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324039070 con 0x7ff310004d40 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32402cc20 con 0x7ff310004d40 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff328a00640 1 -- 172.21.15.194:0/1775505850 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff324009c10 con 0x7ff310004d40 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff330c00640 1 -- 172.21.15.194:0/1775505850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 msgr2=0x7ff3100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff330c00640 1 --2- 172.21.15.194:0/1775505850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff3100051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff324009fc0 tx=0x7ff310005830 comp rx=0 tx=0).stop 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff32a800640 1 -- 172.21.15.194:0/1775505850 reap_dead start 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff330c00640 1 -- 172.21.15.194:0/1775505850 shutdown_connections 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff330c00640 1 -- 172.21.15.194:0/1775505850 >> 172.21.15.194:0/1775505850 conn(0x7ff32c0a9450 msgr2=0x7ff32c0a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:20.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.214+0000 7ff330c00640 1 -- 172.21.15.194:0/1775505850 shutdown_connections 2024-03-07T10:21:20.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.215+0000 7ff330c00640 1 -- 172.21.15.194:0/1775505850 wait complete. 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.216+0000 7ff330c00640 1 Processor -- start 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.216+0000 7ff330c00640 1 -- start start 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff32c1521e0 0x7ff32c1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c5ca0 0x7ff32c148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c06eb50 con 0x7ff310004d40 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c06e9d0 con 0x7ff32c1521e0 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff330c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c06f300 con 0x7ff32c0c5ca0 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff329e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff329e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59284/0 (socket says 172.21.15.194:59284) 2024-03-07T10:21:20.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.217+0000 7ff329e00640 1 -- 172.21.15.194:0/2113713730 learned_addr learned my addr 172.21.15.194:0/2113713730 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 -- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c5ca0 msgr2=0x7ff32c148d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff32a800640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c5ca0 0x7ff32c148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c5ca0 0x7ff32c148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.222 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 -- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff32c1521e0 msgr2=0x7ff32c1487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329400640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff32c1521e0 0x7ff32c1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff32c1521e0 0x7ff32c1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 -- 172.21.15.194:0/2113713730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c149270 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff329e00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d8b0 tx=0x7ff31c00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c019070 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c0074e0 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c1eb8f0 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004a00 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.218+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c1ebeb0 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.220+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c068880 con 0x7ff310004d40 2024-03-07T10:21:20.223 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.220+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff31c004ba0 con 0x7ff310004d40 2024-03-07T10:21:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.222+0000 7ff322000640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 0x7ff30c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.222+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff31c089e20 con 0x7ff310004d40 2024-03-07T10:21:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.222+0000 7ff329400640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 0x7ff30c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.223+0000 7ff329400640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 0x7ff30c06d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff318007fd0 tx=0x7ff318009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.227 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.225+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff31c058960 con 0x7ff310004d40 2024-03-07T10:21:20.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.461+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff32c06f0e0 con 0x7ff30c06b500 2024-03-07T10:21:20.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.496+0000 7ff322000640 1 -- 172.21.15.194:0/2113713730 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490306 (secure 0 0 0) 0x7ff32c06f0e0 con 0x7ff30c06b500 2024-03-07T10:21:20.503 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:20.520 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:20.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 msgr2=0x7ff30c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 0x7ff30c06d9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff318007fd0 tx=0x7ff318009040 comp rx=0 tx=0).stop 2024-03-07T10:21:20.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 msgr2=0x7ff32c1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d8b0 tx=0x7ff31c00dd70 comp rx=0 tx=0).stop 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 shutdown_connections 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff30c06b500 0x7ff30c06d9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff32c0c5ca0 0x7ff32c148d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff32c1521e0 0x7ff32c1487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 --2- 172.21.15.194:0/2113713730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff310004d40 0x7ff32c1517d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.502+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 >> 172.21.15.194:0/2113713730 conn(0x7ff32c0a9450 msgr2=0x7ff32c0a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.503+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 shutdown_connections 2024-03-07T10:21:20.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.503+0000 7ff330c00640 1 -- 172.21.15.194:0/2113713730 wait complete. 2024-03-07T10:21:20.534 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-07T10:21:20.418842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.137405"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681952+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:10.681952+0000","last_peered":"2024-03-07T10:21:10.681952+0000","last_clean":"2024-03-07T10:21:10.681952+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:10.681952+0000","last_undegraded":"2024-03-07T10:21:10.681952+0000","last_fullsized":"2024-03-07T10:21:10.681952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325792+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:10.325792+0000","last_peered":"2024-03-07T10:21:10.325792+0000","last_clean":"2024-03-07T10:21:10.325792+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:10.325792+0000","last_undegraded":"2024-03-07T10:21:10.325792+0000","last_fullsized":"2024-03-07T10:21:10.325792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286432+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:10.286432+0000","last_peered":"2024-03-07T10:21:10.286432+0000","last_clean":"2024-03-07T10:21:10.286432+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:10.286432+0000","last_undegraded":"2024-03-07T10:21:10.286432+0000","last_fullsized":"2024-03-07T10:21:10.286432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284469+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:10.284469+0000","last_peered":"2024-03-07T10:21:10.284469+0000","last_clean":"2024-03-07T10:21:10.284469+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:10.284469+0000","last_undegraded":"2024-03-07T10:21:10.284469+0000","last_fullsized":"2024-03-07T10:21:10.284469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286865+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:10.286865+0000","last_peered":"2024-03-07T10:21:10.286865+0000","last_clean":"2024-03-07T10:21:10.286865+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:10.286865+0000","last_undegraded":"2024-03-07T10:21:10.286865+0000","last_fullsized":"2024-03-07T10:21:10.286865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286551+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:10.286551+0000","last_peered":"2024-03-07T10:21:10.286551+0000","last_clean":"2024-03-07T10:21:10.286551+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:10.286551+0000","last_undegraded":"2024-03-07T10:21:10.286551+0000","last_fullsized":"2024-03-07T10:21:10.286551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325568+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:10.325568+0000","last_peered":"2024-03-07T10:21:10.325568+0000","last_clean":"2024-03-07T10:21:10.325568+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:10.325568+0000","last_undegraded":"2024-03-07T10:21:10.325568+0000","last_fullsized":"2024-03-07T10:21:10.325568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684538+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:10.684538+0000","last_peered":"2024-03-07T10:21:10.684538+0000","last_clean":"2024-03-07T10:21:10.684538+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:10.684538+0000","last_undegraded":"2024-03-07T10:21:10.684538+0000","last_fullsized":"2024-03-07T10:21:10.684538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682332+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:10.682332+0000","last_peered":"2024-03-07T10:21:10.682332+0000","last_clean":"2024-03-07T10:21:10.682332+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:10.682332+0000","last_undegraded":"2024-03-07T10:21:10.682332+0000","last_fullsized":"2024-03-07T10:21:10.682332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685302+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:10.685302+0000","last_peered":"2024-03-07T10:21:10.685302+0000","last_clean":"2024-03-07T10:21:10.685302+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:10.685302+0000","last_undegraded":"2024-03-07T10:21:10.685302+0000","last_fullsized":"2024-03-07T10:21:10.685302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685091+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:10.685091+0000","last_peered":"2024-03-07T10:21:10.685091+0000","last_clean":"2024-03-07T10:21:10.685091+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:10.685091+0000","last_undegraded":"2024-03-07T10:21:10.685091+0000","last_fullsized":"2024-03-07T10:21:10.685091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684372+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:10.684372+0000","last_peered":"2024-03-07T10:21:10.684372+0000","last_clean":"2024-03-07T10:21:10.684372+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:10.684372+0000","last_undegraded":"2024-03-07T10:21:10.684372+0000","last_fullsized":"2024-03-07T10:21:10.684372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684343+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:10.684343+0000","last_peered":"2024-03-07T10:21:10.684343+0000","last_clean":"2024-03-07T10:21:10.684343+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:10.684343+0000","last_undegraded":"2024-03-07T10:21:10.684343+0000","last_fullsized":"2024-03-07T10:21:10.684343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684183+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:10.684183+0000","last_peered":"2024-03-07T10:21:10.684183+0000","last_clean":"2024-03-07T10:21:10.684183+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:10.684183+0000","last_undegraded":"2024-03-07T10:21:10.684183+0000","last_fullsized":"2024-03-07T10:21:10.684183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685884+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:10.685884+0000","last_peered":"2024-03-07T10:21:10.685884+0000","last_clean":"2024-03-07T10:21:10.685884+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:10.685884+0000","last_undegraded":"2024-03-07T10:21:10.685884+0000","last_fullsized":"2024-03-07T10:21:10.685884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684425+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:10.684425+0000","last_peered":"2024-03-07T10:21:10.684425+0000","last_clean":"2024-03-07T10:21:10.684425+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:10.684425+0000","last_undegraded":"2024-03-07T10:21:10.684425+0000","last_fullsized":"2024-03-07T10:21:10.684425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286489+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:10.286489+0000","last_peered":"2024-03-07T10:21:10.286489+0000","last_clean":"2024-03-07T10:21:10.286489+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:10.286489+0000","last_undegraded":"2024-03-07T10:21:10.286489+0000","last_fullsized":"2024-03-07T10:21:10.286489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683354+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:10.683354+0000","last_peered":"2024-03-07T10:21:10.683354+0000","last_clean":"2024-03-07T10:21:10.683354+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:10.683354+0000","last_undegraded":"2024-03-07T10:21:10.683354+0000","last_fullsized":"2024-03-07T10:21:10.683354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684552+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:10.684552+0000","last_peered":"2024-03-07T10:21:10.684552+0000","last_clean":"2024-03-07T10:21:10.684552+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:10.684552+0000","last_undegraded":"2024-03-07T10:21:10.684552+0000","last_fullsized":"2024-03-07T10:21:10.684552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679906+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:10.679906+0000","last_peered":"2024-03-07T10:21:10.679906+0000","last_clean":"2024-03-07T10:21:10.679906+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:10.679906+0000","last_undegraded":"2024-03-07T10:21:10.679906+0000","last_fullsized":"2024-03-07T10:21:10.679906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285306+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:10.285306+0000","last_peered":"2024-03-07T10:21:10.285306+0000","last_clean":"2024-03-07T10:21:10.285306+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:10.285306+0000","last_undegraded":"2024-03-07T10:21:10.285306+0000","last_fullsized":"2024-03-07T10:21:10.285306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288869+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:10.288869+0000","last_peered":"2024-03-07T10:21:10.288869+0000","last_clean":"2024-03-07T10:21:10.288869+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:10.288869+0000","last_undegraded":"2024-03-07T10:21:10.288869+0000","last_fullsized":"2024-03-07T10:21:10.288869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683532+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:10.683532+0000","last_peered":"2024-03-07T10:21:10.683532+0000","last_clean":"2024-03-07T10:21:10.683532+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:10.683532+0000","last_undegraded":"2024-03-07T10:21:10.683532+0000","last_fullsized":"2024-03-07T10:21:10.683532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686187+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:10.686187+0000","last_peered":"2024-03-07T10:21:10.686187+0000","last_clean":"2024-03-07T10:21:10.686187+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:10.686187+0000","last_undegraded":"2024-03-07T10:21:10.686187+0000","last_fullsized":"2024-03-07T10:21:10.686187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284191+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:10.284191+0000","last_peered":"2024-03-07T10:21:10.284191+0000","last_clean":"2024-03-07T10:21:10.284191+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:10.284191+0000","last_undegraded":"2024-03-07T10:21:10.284191+0000","last_fullsized":"2024-03-07T10:21:10.284191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287480+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:10.287480+0000","last_peered":"2024-03-07T10:21:10.287480+0000","last_clean":"2024-03-07T10:21:10.287480+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:10.287480+0000","last_undegraded":"2024-03-07T10:21:10.287480+0000","last_fullsized":"2024-03-07T10:21:10.287480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288170+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:10.288170+0000","last_peered":"2024-03-07T10:21:10.288170+0000","last_clean":"2024-03-07T10:21:10.288170+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:10.288170+0000","last_undegraded":"2024-03-07T10:21:10.288170+0000","last_fullsized":"2024-03-07T10:21:10.288170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686667+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:10.686667+0000","last_peered":"2024-03-07T10:21:10.686667+0000","last_clean":"2024-03-07T10:21:10.686667+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:10.686667+0000","last_undegraded":"2024-03-07T10:21:10.686667+0000","last_fullsized":"2024-03-07T10:21:10.686667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683628+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:10.683628+0000","last_peered":"2024-03-07T10:21:10.683628+0000","last_clean":"2024-03-07T10:21:10.683628+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:10.683628+0000","last_undegraded":"2024-03-07T10:21:10.683628+0000","last_fullsized":"2024-03-07T10:21:10.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682871+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:10.682871+0000","last_peered":"2024-03-07T10:21:10.682871+0000","last_clean":"2024-03-07T10:21:10.682871+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:10.682871+0000","last_undegraded":"2024-03-07T10:21:10.682871+0000","last_fullsized":"2024-03-07T10:21:10.682871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686358+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:10.686358+0000","last_peered":"2024-03-07T10:21:10.686358+0000","last_clean":"2024-03-07T10:21:10.686358+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:10.686358+0000","last_undegraded":"2024-03-07T10:21:10.686358+0000","last_fullsized":"2024-03-07T10:21:10.686358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283827+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:10.283827+0000","last_peered":"2024-03-07T10:21:10.283827+0000","last_clean":"2024-03-07T10:21:10.283827+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:10.283827+0000","last_undegraded":"2024-03-07T10:21:10.283827+0000","last_fullsized":"2024-03-07T10:21:10.283827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325741+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:10.325741+0000","last_peered":"2024-03-07T10:21:10.325741+0000","last_clean":"2024-03-07T10:21:10.325741+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:10.325741+0000","last_undegraded":"2024-03-07T10:21:10.325741+0000","last_fullsized":"2024-03-07T10:21:10.325741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287317+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:10.287317+0000","last_peered":"2024-03-07T10:21:10.287317+0000","last_clean":"2024-03-07T10:21:10.287317+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:10.287317+0000","last_undegraded":"2024-03-07T10:21:10.287317+0000","last_fullsized":"2024-03-07T10:21:10.287317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683398+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:10.683398+0000","last_peered":"2024-03-07T10:21:10.683398+0000","last_clean":"2024-03-07T10:21:10.683398+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:10.683398+0000","last_undegraded":"2024-03-07T10:21:10.683398+0000","last_fullsized":"2024-03-07T10:21:10.683398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682936+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:10.682936+0000","last_peered":"2024-03-07T10:21:10.682936+0000","last_clean":"2024-03-07T10:21:10.682936+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:10.682936+0000","last_undegraded":"2024-03-07T10:21:10.682936+0000","last_fullsized":"2024-03-07T10:21:10.682936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288774+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:10.288774+0000","last_peered":"2024-03-07T10:21:10.288774+0000","last_clean":"2024-03-07T10:21:10.288774+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:10.288774+0000","last_undegraded":"2024-03-07T10:21:10.288774+0000","last_fullsized":"2024-03-07T10:21:10.288774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289710+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:10.289710+0000","last_peered":"2024-03-07T10:21:10.289710+0000","last_clean":"2024-03-07T10:21:10.289710+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:10.289710+0000","last_undegraded":"2024-03-07T10:21:10.289710+0000","last_fullsized":"2024-03-07T10:21:10.289710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283722+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:10.283722+0000","last_peered":"2024-03-07T10:21:10.283722+0000","last_clean":"2024-03-07T10:21:10.283722+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:10.283722+0000","last_undegraded":"2024-03-07T10:21:10.283722+0000","last_fullsized":"2024-03-07T10:21:10.283722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286315+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:10.286315+0000","last_peered":"2024-03-07T10:21:10.286315+0000","last_clean":"2024-03-07T10:21:10.286315+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:10.286315+0000","last_undegraded":"2024-03-07T10:21:10.286315+0000","last_fullsized":"2024-03-07T10:21:10.286315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287699+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:10.287699+0000","last_peered":"2024-03-07T10:21:10.287699+0000","last_clean":"2024-03-07T10:21:10.287699+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:10.287699+0000","last_undegraded":"2024-03-07T10:21:10.287699+0000","last_fullsized":"2024-03-07T10:21:10.287699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685644+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:10.685644+0000","last_peered":"2024-03-07T10:21:10.685644+0000","last_clean":"2024-03-07T10:21:10.685644+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:10.685644+0000","last_undegraded":"2024-03-07T10:21:10.685644+0000","last_fullsized":"2024-03-07T10:21:10.685644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325736+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:10.325736+0000","last_peered":"2024-03-07T10:21:10.325736+0000","last_clean":"2024-03-07T10:21:10.325736+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:10.325736+0000","last_undegraded":"2024-03-07T10:21:10.325736+0000","last_fullsized":"2024-03-07T10:21:10.325736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326342+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:10.326342+0000","last_peered":"2024-03-07T10:21:10.326342+0000","last_clean":"2024-03-07T10:21:10.326342+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:10.326342+0000","last_undegraded":"2024-03-07T10:21:10.326342+0000","last_fullsized":"2024-03-07T10:21:10.326342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685900+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:10.685900+0000","last_peered":"2024-03-07T10:21:10.685900+0000","last_clean":"2024-03-07T10:21:10.685900+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:10.685900+0000","last_undegraded":"2024-03-07T10:21:10.685900+0000","last_fullsized":"2024-03-07T10:21:10.685900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287824+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:10.287824+0000","last_peered":"2024-03-07T10:21:10.287824+0000","last_clean":"2024-03-07T10:21:10.287824+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:10.287824+0000","last_undegraded":"2024-03-07T10:21:10.287824+0000","last_fullsized":"2024-03-07T10:21:10.287824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288576+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:10.288576+0000","last_peered":"2024-03-07T10:21:10.288576+0000","last_clean":"2024-03-07T10:21:10.288576+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:10.288576+0000","last_undegraded":"2024-03-07T10:21:10.288576+0000","last_fullsized":"2024-03-07T10:21:10.288576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325290+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:10.325290+0000","last_peered":"2024-03-07T10:21:10.325290+0000","last_clean":"2024-03-07T10:21:10.325290+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:10.325290+0000","last_undegraded":"2024-03-07T10:21:10.325290+0000","last_fullsized":"2024-03-07T10:21:10.325290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685706+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:10.685706+0000","last_peered":"2024-03-07T10:21:10.685706+0000","last_clean":"2024-03-07T10:21:10.685706+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:10.685706+0000","last_undegraded":"2024-03-07T10:21:10.685706+0000","last_fullsized":"2024-03-07T10:21:10.685706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685126+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:10.685126+0000","last_peered":"2024-03-07T10:21:10.685126+0000","last_clean":"2024-03-07T10:21:10.685126+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:10.685126+0000","last_undegraded":"2024-03-07T10:21:10.685126+0000","last_fullsized":"2024-03-07T10:21:10.685126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287637+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:10.287637+0000","last_peered":"2024-03-07T10:21:10.287637+0000","last_clean":"2024-03-07T10:21:10.287637+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:10.287637+0000","last_undegraded":"2024-03-07T10:21:10.287637+0000","last_fullsized":"2024-03-07T10:21:10.287637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679879+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:10.679879+0000","last_peered":"2024-03-07T10:21:10.679879+0000","last_clean":"2024-03-07T10:21:10.679879+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:10.679879+0000","last_undegraded":"2024-03-07T10:21:10.679879+0000","last_fullsized":"2024-03-07T10:21:10.679879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287054+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:10.287054+0000","last_peered":"2024-03-07T10:21:10.287054+0000","last_clean":"2024-03-07T10:21:10.287054+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:10.287054+0000","last_undegraded":"2024-03-07T10:21:10.287054+0000","last_fullsized":"2024-03-07T10:21:10.287054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679803+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:10.679803+0000","last_peered":"2024-03-07T10:21:10.679803+0000","last_clean":"2024-03-07T10:21:10.679803+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:10.679803+0000","last_undegraded":"2024-03-07T10:21:10.679803+0000","last_fullsized":"2024-03-07T10:21:10.679803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288300+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:10.288300+0000","last_peered":"2024-03-07T10:21:10.288300+0000","last_clean":"2024-03-07T10:21:10.288300+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:10.288300+0000","last_undegraded":"2024-03-07T10:21:10.288300+0000","last_fullsized":"2024-03-07T10:21:10.288300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686885+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:10.686885+0000","last_peered":"2024-03-07T10:21:10.686885+0000","last_clean":"2024-03-07T10:21:10.686885+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:10.686885+0000","last_undegraded":"2024-03-07T10:21:10.686885+0000","last_fullsized":"2024-03-07T10:21:10.686885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324971+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:10.324971+0000","last_peered":"2024-03-07T10:21:10.324971+0000","last_clean":"2024-03-07T10:21:10.324971+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:10.324971+0000","last_undegraded":"2024-03-07T10:21:10.324971+0000","last_fullsized":"2024-03-07T10:21:10.324971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683051+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:10.683051+0000","last_peered":"2024-03-07T10:21:10.683051+0000","last_clean":"2024-03-07T10:21:10.683051+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:10.683051+0000","last_undegraded":"2024-03-07T10:21:10.683051+0000","last_fullsized":"2024-03-07T10:21:10.683051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.328523+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:10.328523+0000","last_peered":"2024-03-07T10:21:10.328523+0000","last_clean":"2024-03-07T10:21:10.328523+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:10.328523+0000","last_undegraded":"2024-03-07T10:21:10.328523+0000","last_fullsized":"2024-03-07T10:21:10.328523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683818+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:10.683818+0000","last_peered":"2024-03-07T10:21:10.683818+0000","last_clean":"2024-03-07T10:21:10.683818+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:10.683818+0000","last_undegraded":"2024-03-07T10:21:10.683818+0000","last_fullsized":"2024-03-07T10:21:10.683818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284681+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:10.284681+0000","last_peered":"2024-03-07T10:21:10.284681+0000","last_clean":"2024-03-07T10:21:10.284681+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:10.284681+0000","last_undegraded":"2024-03-07T10:21:10.284681+0000","last_fullsized":"2024-03-07T10:21:10.284681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684415+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:10.684415+0000","last_peered":"2024-03-07T10:21:10.684415+0000","last_clean":"2024-03-07T10:21:10.684415+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:10.684415+0000","last_undegraded":"2024-03-07T10:21:10.684415+0000","last_fullsized":"2024-03-07T10:21:10.684415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683520+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:10.683520+0000","last_peered":"2024-03-07T10:21:10.683520+0000","last_clean":"2024-03-07T10:21:10.683520+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:10.683520+0000","last_undegraded":"2024-03-07T10:21:10.683520+0000","last_fullsized":"2024-03-07T10:21:10.683520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286588+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:10.286588+0000","last_peered":"2024-03-07T10:21:10.286588+0000","last_clean":"2024-03-07T10:21:10.286588+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:10.286588+0000","last_undegraded":"2024-03-07T10:21:10.286588+0000","last_fullsized":"2024-03-07T10:21:10.286588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681084+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:10.681084+0000","last_peered":"2024-03-07T10:21:10.681084+0000","last_clean":"2024-03-07T10:21:10.681084+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:10.681084+0000","last_undegraded":"2024-03-07T10:21:10.681084+0000","last_fullsized":"2024-03-07T10:21:10.681084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685123+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:10.685123+0000","last_peered":"2024-03-07T10:21:10.685123+0000","last_clean":"2024-03-07T10:21:10.685123+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:10.685123+0000","last_undegraded":"2024-03-07T10:21:10.685123+0000","last_fullsized":"2024-03-07T10:21:10.685123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680116+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:10.680116+0000","last_peered":"2024-03-07T10:21:10.680116+0000","last_clean":"2024-03-07T10:21:10.680116+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:10.680116+0000","last_undegraded":"2024-03-07T10:21:10.680116+0000","last_fullsized":"2024-03-07T10:21:10.680116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286346+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:10.286346+0000","last_peered":"2024-03-07T10:21:10.286346+0000","last_clean":"2024-03-07T10:21:10.286346+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:10.286346+0000","last_undegraded":"2024-03-07T10:21:10.286346+0000","last_fullsized":"2024-03-07T10:21:10.286346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679853+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:10.679853+0000","last_peered":"2024-03-07T10:21:10.679853+0000","last_clean":"2024-03-07T10:21:10.679853+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:10.679853+0000","last_undegraded":"2024-03-07T10:21:10.679853+0000","last_fullsized":"2024-03-07T10:21:10.679853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685331+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:10.685331+0000","last_peered":"2024-03-07T10:21:10.685331+0000","last_clean":"2024-03-07T10:21:10.685331+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:10.685331+0000","last_undegraded":"2024-03-07T10:21:10.685331+0000","last_fullsized":"2024-03-07T10:21:10.685331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288324+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:10.288324+0000","last_peered":"2024-03-07T10:21:10.288324+0000","last_clean":"2024-03-07T10:21:10.288324+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:10.288324+0000","last_undegraded":"2024-03-07T10:21:10.288324+0000","last_fullsized":"2024-03-07T10:21:10.288324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325430+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:10.325430+0000","last_peered":"2024-03-07T10:21:10.325430+0000","last_clean":"2024-03-07T10:21:10.325430+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:10.325430+0000","last_undegraded":"2024-03-07T10:21:10.325430+0000","last_fullsized":"2024-03-07T10:21:10.325430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683114+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:10.683114+0000","last_peered":"2024-03-07T10:21:10.683114+0000","last_clean":"2024-03-07T10:21:10.683114+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:10.683114+0000","last_undegraded":"2024-03-07T10:21:10.683114+0000","last_fullsized":"2024-03-07T10:21:10.683114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686525+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:10.686525+0000","last_peered":"2024-03-07T10:21:10.686525+0000","last_clean":"2024-03-07T10:21:10.686525+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:10.686525+0000","last_undegraded":"2024-03-07T10:21:10.686525+0000","last_fullsized":"2024-03-07T10:21:10.686525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680173+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:10.680173+0000","last_peered":"2024-03-07T10:21:10.680173+0000","last_clean":"2024-03-07T10:21:10.680173+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:10.680173+0000","last_undegraded":"2024-03-07T10:21:10.680173+0000","last_fullsized":"2024-03-07T10:21:10.680173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681801+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:10.681801+0000","last_peered":"2024-03-07T10:21:10.681801+0000","last_clean":"2024-03-07T10:21:10.681801+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:10.681801+0000","last_undegraded":"2024-03-07T10:21:10.681801+0000","last_fullsized":"2024-03-07T10:21:10.681801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679626+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:10.679626+0000","last_peered":"2024-03-07T10:21:10.679626+0000","last_clean":"2024-03-07T10:21:10.679626+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:10.679626+0000","last_undegraded":"2024-03-07T10:21:10.679626+0000","last_fullsized":"2024-03-07T10:21:10.679626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683746+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:10.683746+0000","last_peered":"2024-03-07T10:21:10.683746+0000","last_clean":"2024-03-07T10:21:10.683746+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:10.683746+0000","last_undegraded":"2024-03-07T10:21:10.683746+0000","last_fullsized":"2024-03-07T10:21:10.683746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685507+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:10.685507+0000","last_peered":"2024-03-07T10:21:10.685507+0000","last_clean":"2024-03-07T10:21:10.685507+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:10.685507+0000","last_undegraded":"2024-03-07T10:21:10.685507+0000","last_fullsized":"2024-03-07T10:21:10.685507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683092+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:10.683092+0000","last_peered":"2024-03-07T10:21:10.683092+0000","last_clean":"2024-03-07T10:21:10.683092+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:10.683092+0000","last_undegraded":"2024-03-07T10:21:10.683092+0000","last_fullsized":"2024-03-07T10:21:10.683092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288351+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:10.288351+0000","last_peered":"2024-03-07T10:21:10.288351+0000","last_clean":"2024-03-07T10:21:10.288351+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:10.288351+0000","last_undegraded":"2024-03-07T10:21:10.288351+0000","last_fullsized":"2024-03-07T10:21:10.288351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682905+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:10.682905+0000","last_peered":"2024-03-07T10:21:10.682905+0000","last_clean":"2024-03-07T10:21:10.682905+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:10.682905+0000","last_undegraded":"2024-03-07T10:21:10.682905+0000","last_fullsized":"2024-03-07T10:21:10.682905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679685+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:10.679685+0000","last_peered":"2024-03-07T10:21:10.679685+0000","last_clean":"2024-03-07T10:21:10.679685+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:10.679685+0000","last_undegraded":"2024-03-07T10:21:10.679685+0000","last_fullsized":"2024-03-07T10:21:10.679685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325673+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:10.325673+0000","last_peered":"2024-03-07T10:21:10.325673+0000","last_clean":"2024-03-07T10:21:10.325673+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:10.325673+0000","last_undegraded":"2024-03-07T10:21:10.325673+0000","last_fullsized":"2024-03-07T10:21:10.325673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686280+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:10.686280+0000","last_peered":"2024-03-07T10:21:10.686280+0000","last_clean":"2024-03-07T10:21:10.686280+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:10.686280+0000","last_undegraded":"2024-03-07T10:21:10.686280+0000","last_fullsized":"2024-03-07T10:21:10.686280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285582+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:10.285582+0000","last_peered":"2024-03-07T10:21:10.285582+0000","last_clean":"2024-03-07T10:21:10.285582+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:10.285582+0000","last_undegraded":"2024-03-07T10:21:10.285582+0000","last_fullsized":"2024-03-07T10:21:10.285582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286158+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:10.286158+0000","last_peered":"2024-03-07T10:21:10.286158+0000","last_clean":"2024-03-07T10:21:10.286158+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:10.286158+0000","last_undegraded":"2024-03-07T10:21:10.286158+0000","last_fullsized":"2024-03-07T10:21:10.286158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288602+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:10.288602+0000","last_peered":"2024-03-07T10:21:10.288602+0000","last_clean":"2024-03-07T10:21:10.288602+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:10.288602+0000","last_undegraded":"2024-03-07T10:21:10.288602+0000","last_fullsized":"2024-03-07T10:21:10.288602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685483+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:10.685483+0000","last_peered":"2024-03-07T10:21:10.685483+0000","last_clean":"2024-03-07T10:21:10.685483+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:10.685483+0000","last_undegraded":"2024-03-07T10:21:10.685483+0000","last_fullsized":"2024-03-07T10:21:10.685483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682452+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:10.682452+0000","last_peered":"2024-03-07T10:21:10.682452+0000","last_clean":"2024-03-07T10:21:10.682452+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:10.682452+0000","last_undegraded":"2024-03-07T10:21:10.682452+0000","last_fullsized":"2024-03-07T10:21:10.682452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684988+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:10.684988+0000","last_peered":"2024-03-07T10:21:10.684988+0000","last_clean":"2024-03-07T10:21:10.684988+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:10.684988+0000","last_undegraded":"2024-03-07T10:21:10.684988+0000","last_fullsized":"2024-03-07T10:21:10.684988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285957+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:10.285957+0000","last_peered":"2024-03-07T10:21:10.285957+0000","last_clean":"2024-03-07T10:21:10.285957+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:10.285957+0000","last_undegraded":"2024-03-07T10:21:10.285957+0000","last_fullsized":"2024-03-07T10:21:10.285957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287780+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:10.287780+0000","last_peered":"2024-03-07T10:21:10.287780+0000","last_clean":"2024-03-07T10:21:10.287780+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:10.287780+0000","last_undegraded":"2024-03-07T10:21:10.287780+0000","last_fullsized":"2024-03-07T10:21:10.287780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324945+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:10.324945+0000","last_peered":"2024-03-07T10:21:10.324945+0000","last_clean":"2024-03-07T10:21:10.324945+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:10.324945+0000","last_undegraded":"2024-03-07T10:21:10.324945+0000","last_fullsized":"2024-03-07T10:21:10.324945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326639+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:10.326639+0000","last_peered":"2024-03-07T10:21:10.326639+0000","last_clean":"2024-03-07T10:21:10.326639+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:10.326639+0000","last_undegraded":"2024-03-07T10:21:10.326639+0000","last_fullsized":"2024-03-07T10:21:10.326639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685807+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:10.685807+0000","last_peered":"2024-03-07T10:21:10.685807+0000","last_clean":"2024-03-07T10:21:10.685807+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:10.685807+0000","last_undegraded":"2024-03-07T10:21:10.685807+0000","last_fullsized":"2024-03-07T10:21:10.685807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285236+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:10.285236+0000","last_peered":"2024-03-07T10:21:10.285236+0000","last_clean":"2024-03-07T10:21:10.285236+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:10.285236+0000","last_undegraded":"2024-03-07T10:21:10.285236+0000","last_fullsized":"2024-03-07T10:21:10.285236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684937+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:10.684937+0000","last_peered":"2024-03-07T10:21:10.684937+0000","last_clean":"2024-03-07T10:21:10.684937+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:10.684937+0000","last_undegraded":"2024-03-07T10:21:10.684937+0000","last_fullsized":"2024-03-07T10:21:10.684937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286416+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:10.286416+0000","last_peered":"2024-03-07T10:21:10.286416+0000","last_clean":"2024-03-07T10:21:10.286416+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:10.286416+0000","last_undegraded":"2024-03-07T10:21:10.286416+0000","last_fullsized":"2024-03-07T10:21:10.286416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288375+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:10.288375+0000","last_peered":"2024-03-07T10:21:10.288375+0000","last_clean":"2024-03-07T10:21:10.288375+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:10.288375+0000","last_undegraded":"2024-03-07T10:21:10.288375+0000","last_fullsized":"2024-03-07T10:21:10.288375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288996+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:10.288996+0000","last_peered":"2024-03-07T10:21:10.288996+0000","last_clean":"2024-03-07T10:21:10.288996+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:10.288996+0000","last_undegraded":"2024-03-07T10:21:10.288996+0000","last_fullsized":"2024-03-07T10:21:10.288996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683910+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:10.683910+0000","last_peered":"2024-03-07T10:21:10.683910+0000","last_clean":"2024-03-07T10:21:10.683910+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:10.683910+0000","last_undegraded":"2024-03-07T10:21:10.683910+0000","last_fullsized":"2024-03-07T10:21:10.683910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288186+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:10.288186+0000","last_peered":"2024-03-07T10:21:10.288186+0000","last_clean":"2024-03-07T10:21:10.288186+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:10.288186+0000","last_undegraded":"2024-03-07T10:21:10.288186+0000","last_fullsized":"2024-03-07T10:21:10.288186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687163+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:10.687163+0000","last_peered":"2024-03-07T10:21:10.687163+0000","last_clean":"2024-03-07T10:21:10.687163+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:10.687163+0000","last_undegraded":"2024-03-07T10:21:10.687163+0000","last_fullsized":"2024-03-07T10:21:10.687163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286227+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:10.286227+0000","last_peered":"2024-03-07T10:21:10.286227+0000","last_clean":"2024-03-07T10:21:10.286227+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:10.286227+0000","last_undegraded":"2024-03-07T10:21:10.286227+0000","last_fullsized":"2024-03-07T10:21:10.286227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325604+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:10.325604+0000","last_peered":"2024-03-07T10:21:10.325604+0000","last_clean":"2024-03-07T10:21:10.325604+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:10.325604+0000","last_undegraded":"2024-03-07T10:21:10.325604+0000","last_fullsized":"2024-03-07T10:21:10.325604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686797+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:10.686797+0000","last_peered":"2024-03-07T10:21:10.686797+0000","last_clean":"2024-03-07T10:21:10.686797+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:10.686797+0000","last_undegraded":"2024-03-07T10:21:10.686797+0000","last_fullsized":"2024-03-07T10:21:10.686797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283947+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:10.283947+0000","last_peered":"2024-03-07T10:21:10.283947+0000","last_clean":"2024-03-07T10:21:10.283947+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:10.283947+0000","last_undegraded":"2024-03-07T10:21:10.283947+0000","last_fullsized":"2024-03-07T10:21:10.283947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682584+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:10.682584+0000","last_peered":"2024-03-07T10:21:10.682584+0000","last_clean":"2024-03-07T10:21:10.682584+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:10.682584+0000","last_undegraded":"2024-03-07T10:21:10.682584+0000","last_fullsized":"2024-03-07T10:21:10.682584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686634+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:21:10.686634+0000","last_peered":"2024-03-07T10:21:10.686634+0000","last_clean":"2024-03-07T10:21:10.686634+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:21:10.686634+0000","last_undegraded":"2024-03-07T10:21:10.686634+0000","last_fullsized":"2024-03-07T10:21:10.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287237+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:10.287237+0000","last_peered":"2024-03-07T10:21:10.287237+0000","last_clean":"2024-03-07T10:21:10.287237+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:10.287237+0000","last_undegraded":"2024-03-07T10:21:10.287237+0000","last_fullsized":"2024-03-07T10:21:10.287237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284075+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:10.284075+0000","last_peered":"2024-03-07T10:21:10.284075+0000","last_clean":"2024-03-07T10:21:10.284075+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:10.284075+0000","last_undegraded":"2024-03-07T10:21:10.284075+0000","last_fullsized":"2024-03-07T10:21:10.284075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287179+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:10.287179+0000","last_peered":"2024-03-07T10:21:10.287179+0000","last_clean":"2024-03-07T10:21:10.287179+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:10.287179+0000","last_undegraded":"2024-03-07T10:21:10.287179+0000","last_fullsized":"2024-03-07T10:21:10.287179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326678+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:10.326678+0000","last_peered":"2024-03-07T10:21:10.326678+0000","last_clean":"2024-03-07T10:21:10.326678+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:10.326678+0000","last_undegraded":"2024-03-07T10:21:10.326678+0000","last_fullsized":"2024-03-07T10:21:10.326678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287143+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:10.287143+0000","last_peered":"2024-03-07T10:21:10.287143+0000","last_clean":"2024-03-07T10:21:10.287143+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:10.287143+0000","last_undegraded":"2024-03-07T10:21:10.287143+0000","last_fullsized":"2024-03-07T10:21:10.287143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682184+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:10.682184+0000","last_peered":"2024-03-07T10:21:10.682184+0000","last_clean":"2024-03-07T10:21:10.682184+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:10.682184+0000","last_undegraded":"2024-03-07T10:21:10.682184+0000","last_fullsized":"2024-03-07T10:21:10.682184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325459+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:10.325459+0000","last_peered":"2024-03-07T10:21:10.325459+0000","last_clean":"2024-03-07T10:21:10.325459+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:10.325459+0000","last_undegraded":"2024-03-07T10:21:10.325459+0000","last_fullsized":"2024-03-07T10:21:10.325459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287094+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:10.287094+0000","last_peered":"2024-03-07T10:21:10.287094+0000","last_clean":"2024-03-07T10:21:10.287094+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:10.287094+0000","last_undegraded":"2024-03-07T10:21:10.287094+0000","last_fullsized":"2024-03-07T10:21:10.287094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284128+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:10.284128+0000","last_peered":"2024-03-07T10:21:10.284128+0000","last_clean":"2024-03-07T10:21:10.284128+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:10.284128+0000","last_undegraded":"2024-03-07T10:21:10.284128+0000","last_fullsized":"2024-03-07T10:21:10.284128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284918+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:10.284918+0000","last_peered":"2024-03-07T10:21:10.284918+0000","last_clean":"2024-03-07T10:21:10.284918+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:10.284918+0000","last_undegraded":"2024-03-07T10:21:10.284918+0000","last_fullsized":"2024-03-07T10:21:10.284918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287904+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:10.287904+0000","last_peered":"2024-03-07T10:21:10.287904+0000","last_clean":"2024-03-07T10:21:10.287904+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:10.287904+0000","last_undegraded":"2024-03-07T10:21:10.287904+0000","last_fullsized":"2024-03-07T10:21:10.287904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286516+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:10.286516+0000","last_peered":"2024-03-07T10:21:10.286516+0000","last_clean":"2024-03-07T10:21:10.286516+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:10.286516+0000","last_undegraded":"2024-03-07T10:21:10.286516+0000","last_fullsized":"2024-03-07T10:21:10.286516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326452+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:10.326452+0000","last_peered":"2024-03-07T10:21:10.326452+0000","last_clean":"2024-03-07T10:21:10.326452+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:10.326452+0000","last_undegraded":"2024-03-07T10:21:10.326452+0000","last_fullsized":"2024-03-07T10:21:10.326452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680031+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:10.680031+0000","last_peered":"2024-03-07T10:21:10.680031+0000","last_clean":"2024-03-07T10:21:10.680031+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:10.680031+0000","last_undegraded":"2024-03-07T10:21:10.680031+0000","last_fullsized":"2024-03-07T10:21:10.680031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683202+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:10.683202+0000","last_peered":"2024-03-07T10:21:10.683202+0000","last_clean":"2024-03-07T10:21:10.683202+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:10.683202+0000","last_undegraded":"2024-03-07T10:21:10.683202+0000","last_fullsized":"2024-03-07T10:21:10.683202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285522+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:10.285522+0000","last_peered":"2024-03-07T10:21:10.285522+0000","last_clean":"2024-03-07T10:21:10.285522+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:10.285522+0000","last_undegraded":"2024-03-07T10:21:10.285522+0000","last_fullsized":"2024-03-07T10:21:10.285522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684573+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:10.684573+0000","last_peered":"2024-03-07T10:21:10.684573+0000","last_clean":"2024-03-07T10:21:10.684573+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:10.684573+0000","last_undegraded":"2024-03-07T10:21:10.684573+0000","last_fullsized":"2024-03-07T10:21:10.684573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285803+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:10.285803+0000","last_peered":"2024-03-07T10:21:10.285803+0000","last_clean":"2024-03-07T10:21:10.285803+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:10.285803+0000","last_undegraded":"2024-03-07T10:21:10.285803+0000","last_fullsized":"2024-03-07T10:21:10.285803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286194+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:10.286194+0000","last_peered":"2024-03-07T10:21:10.286194+0000","last_clean":"2024-03-07T10:21:10.286194+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:10.286194+0000","last_undegraded":"2024-03-07T10:21:10.286194+0000","last_fullsized":"2024-03-07T10:21:10.286194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285576+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:10.285576+0000","last_peered":"2024-03-07T10:21:10.285576+0000","last_clean":"2024-03-07T10:21:10.285576+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:10.285576+0000","last_undegraded":"2024-03-07T10:21:10.285576+0000","last_fullsized":"2024-03-07T10:21:10.285576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288264+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:10.288264+0000","last_peered":"2024-03-07T10:21:10.288264+0000","last_clean":"2024-03-07T10:21:10.288264+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:10.288264+0000","last_undegraded":"2024-03-07T10:21:10.288264+0000","last_fullsized":"2024-03-07T10:21:10.288264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679567+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:10.679567+0000","last_peered":"2024-03-07T10:21:10.679567+0000","last_clean":"2024-03-07T10:21:10.679567+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:10.679567+0000","last_undegraded":"2024-03-07T10:21:10.679567+0000","last_fullsized":"2024-03-07T10:21:10.679567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684568+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:10.684568+0000","last_peered":"2024-03-07T10:21:10.684568+0000","last_clean":"2024-03-07T10:21:10.684568+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:10.684568+0000","last_undegraded":"2024-03-07T10:21:10.684568+0000","last_fullsized":"2024-03-07T10:21:10.684568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684863+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:10.684863+0000","last_peered":"2024-03-07T10:21:10.684863+0000","last_clean":"2024-03-07T10:21:10.684863+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:10.684863+0000","last_undegraded":"2024-03-07T10:21:10.684863+0000","last_fullsized":"2024-03-07T10:21:10.684863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287708+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:10.287708+0000","last_peered":"2024-03-07T10:21:10.287708+0000","last_clean":"2024-03-07T10:21:10.287708+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:10.287708+0000","last_undegraded":"2024-03-07T10:21:10.287708+0000","last_fullsized":"2024-03-07T10:21:10.287708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326210+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:10.326210+0000","last_peered":"2024-03-07T10:21:10.326210+0000","last_clean":"2024-03-07T10:21:10.326210+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:10.326210+0000","last_undegraded":"2024-03-07T10:21:10.326210+0000","last_fullsized":"2024-03-07T10:21:10.326210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686265+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:10.686265+0000","last_peered":"2024-03-07T10:21:10.686265+0000","last_clean":"2024-03-07T10:21:10.686265+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:10.686265+0000","last_undegraded":"2024-03-07T10:21:10.686265+0000","last_fullsized":"2024-03-07T10:21:10.686265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287200+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:10.287200+0000","last_peered":"2024-03-07T10:21:10.287200+0000","last_clean":"2024-03-07T10:21:10.287200+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:10.287200+0000","last_undegraded":"2024-03-07T10:21:10.287200+0000","last_fullsized":"2024-03-07T10:21:10.287200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684228+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:10.684228+0000","last_peered":"2024-03-07T10:21:10.684228+0000","last_clean":"2024-03-07T10:21:10.684228+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:10.684228+0000","last_undegraded":"2024-03-07T10:21:10.684228+0000","last_fullsized":"2024-03-07T10:21:10.684228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288057+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:10.288057+0000","last_peered":"2024-03-07T10:21:10.288057+0000","last_clean":"2024-03-07T10:21:10.288057+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:10.288057+0000","last_undegraded":"2024-03-07T10:21:10.288057+0000","last_fullsized":"2024-03-07T10:21:10.288057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682253+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:10.682253+0000","last_peered":"2024-03-07T10:21:10.682253+0000","last_clean":"2024-03-07T10:21:10.682253+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:10.682253+0000","last_undegraded":"2024-03-07T10:21:10.682253+0000","last_fullsized":"2024-03-07T10:21:10.682253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287258+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:10.287258+0000","last_peered":"2024-03-07T10:21:10.287258+0000","last_clean":"2024-03-07T10:21:10.287258+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:10.287258+0000","last_undegraded":"2024-03-07T10:21:10.287258+0000","last_fullsized":"2024-03-07T10:21:10.287258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285886+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:10.285886+0000","last_peered":"2024-03-07T10:21:10.285886+0000","last_clean":"2024-03-07T10:21:10.285886+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:10.285886+0000","last_undegraded":"2024-03-07T10:21:10.285886+0000","last_fullsized":"2024-03-07T10:21:10.285886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289513+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:10.289513+0000","last_peered":"2024-03-07T10:21:10.289513+0000","last_clean":"2024-03-07T10:21:10.289513+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:10.289513+0000","last_undegraded":"2024-03-07T10:21:10.289513+0000","last_fullsized":"2024-03-07T10:21:10.289513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286013+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:10.286013+0000","last_peered":"2024-03-07T10:21:10.286013+0000","last_clean":"2024-03-07T10:21:10.286013+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:10.286013+0000","last_undegraded":"2024-03-07T10:21:10.286013+0000","last_fullsized":"2024-03-07T10:21:10.286013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682028+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:21:10.682028+0000","last_peered":"2024-03-07T10:21:10.682028+0000","last_clean":"2024-03-07T10:21:10.682028+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:21:10.682028+0000","last_undegraded":"2024-03-07T10:21:10.682028+0000","last_fullsized":"2024-03-07T10:21:10.682028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683779+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:10.683779+0000","last_peered":"2024-03-07T10:21:10.683779+0000","last_clean":"2024-03-07T10:21:10.683779+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:10.683779+0000","last_undegraded":"2024-03-07T10:21:10.683779+0000","last_fullsized":"2024-03-07T10:21:10.683779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284741+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:10.284741+0000","last_peered":"2024-03-07T10:21:10.284741+0000","last_clean":"2024-03-07T10:21:10.284741+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:10.284741+0000","last_undegraded":"2024-03-07T10:21:10.284741+0000","last_fullsized":"2024-03-07T10:21:10.284741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679954+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:10.679954+0000","last_peered":"2024-03-07T10:21:10.679954+0000","last_clean":"2024-03-07T10:21:10.679954+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:10.679954+0000","last_undegraded":"2024-03-07T10:21:10.679954+0000","last_fullsized":"2024-03-07T10:21:10.679954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684730+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:21:10.684730+0000","last_peered":"2024-03-07T10:21:10.684730+0000","last_clean":"2024-03-07T10:21:10.684730+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:21:10.684730+0000","last_undegraded":"2024-03-07T10:21:10.684730+0000","last_fullsized":"2024-03-07T10:21:10.684730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285569+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:10.285569+0000","last_peered":"2024-03-07T10:21:10.285569+0000","last_clean":"2024-03-07T10:21:10.285569+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:10.285569+0000","last_undegraded":"2024-03-07T10:21:10.285569+0000","last_fullsized":"2024-03-07T10:21:10.285569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325987+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:10.325987+0000","last_peered":"2024-03-07T10:21:10.325987+0000","last_clean":"2024-03-07T10:21:10.325987+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:10.325987+0000","last_undegraded":"2024-03-07T10:21:10.325987+0000","last_fullsized":"2024-03-07T10:21:10.325987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684286+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:10.684286+0000","last_peered":"2024-03-07T10:21:10.684286+0000","last_clean":"2024-03-07T10:21:10.684286+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:10.684286+0000","last_undegraded":"2024-03-07T10:21:10.684286+0000","last_fullsized":"2024-03-07T10:21:10.684286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286334+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:10.286334+0000","last_peered":"2024-03-07T10:21:10.286334+0000","last_clean":"2024-03-07T10:21:10.286334+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:10.286334+0000","last_undegraded":"2024-03-07T10:21:10.286334+0000","last_fullsized":"2024-03-07T10:21:10.286334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684011+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:10.684011+0000","last_peered":"2024-03-07T10:21:10.684011+0000","last_clean":"2024-03-07T10:21:10.684011+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:10.684011+0000","last_undegraded":"2024-03-07T10:21:10.684011+0000","last_fullsized":"2024-03-07T10:21:10.684011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685485+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:10.685485+0000","last_peered":"2024-03-07T10:21:10.685485+0000","last_clean":"2024-03-07T10:21:10.685485+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:10.685485+0000","last_undegraded":"2024-03-07T10:21:10.685485+0000","last_fullsized":"2024-03-07T10:21:10.685485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683901+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:10.683901+0000","last_peered":"2024-03-07T10:21:10.683901+0000","last_clean":"2024-03-07T10:21:10.683901+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:10.683901+0000","last_undegraded":"2024-03-07T10:21:10.683901+0000","last_fullsized":"2024-03-07T10:21:10.683901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680027+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:10.680027+0000","last_peered":"2024-03-07T10:21:10.680027+0000","last_clean":"2024-03-07T10:21:10.680027+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:10.680027+0000","last_undegraded":"2024-03-07T10:21:10.680027+0000","last_fullsized":"2024-03-07T10:21:10.680027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324794+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:10.324794+0000","last_peered":"2024-03-07T10:21:10.324794+0000","last_clean":"2024-03-07T10:21:10.324794+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:10.324794+0000","last_undegraded":"2024-03-07T10:21:10.324794+0000","last_fullsized":"2024-03-07T10:21:10.324794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687014+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:21:10.687014+0000","last_peered":"2024-03-07T10:21:10.687014+0000","last_clean":"2024-03-07T10:21:10.687014+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:21:10.687014+0000","last_undegraded":"2024-03-07T10:21:10.687014+0000","last_fullsized":"2024-03-07T10:21:10.687014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289400+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:10.289400+0000","last_peered":"2024-03-07T10:21:10.289400+0000","last_clean":"2024-03-07T10:21:10.289400+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:10.289400+0000","last_undegraded":"2024-03-07T10:21:10.289400+0000","last_fullsized":"2024-03-07T10:21:10.289400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681886+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:10.681886+0000","last_peered":"2024-03-07T10:21:10.681886+0000","last_clean":"2024-03-07T10:21:10.681886+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:10.681886+0000","last_undegraded":"2024-03-07T10:21:10.681886+0000","last_fullsized":"2024-03-07T10:21:10.681886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684951+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:10.684951+0000","last_peered":"2024-03-07T10:21:10.684951+0000","last_clean":"2024-03-07T10:21:10.684951+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:10.684951+0000","last_undegraded":"2024-03-07T10:21:10.684951+0000","last_fullsized":"2024-03-07T10:21:10.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684310+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:10.684310+0000","last_peered":"2024-03-07T10:21:10.684310+0000","last_clean":"2024-03-07T10:21:10.684310+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:10.684310+0000","last_undegraded":"2024-03-07T10:21:10.684310+0000","last_fullsized":"2024-03-07T10:21:10.684310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324787+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:10.324787+0000","last_peered":"2024-03-07T10:21:10.324787+0000","last_clean":"2024-03-07T10:21:10.324787+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:10.324787+0000","last_undegraded":"2024-03-07T10:21:10.324787+0000","last_fullsized":"2024-03-07T10:21:10.324787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684852+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:10.684852+0000","last_peered":"2024-03-07T10:21:10.684852+0000","last_clean":"2024-03-07T10:21:10.684852+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:10.684852+0000","last_undegraded":"2024-03-07T10:21:10.684852+0000","last_fullsized":"2024-03-07T10:21:10.684852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285216+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:10.285216+0000","last_peered":"2024-03-07T10:21:10.285216+0000","last_clean":"2024-03-07T10:21:10.285216+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:10.285216+0000","last_undegraded":"2024-03-07T10:21:10.285216+0000","last_fullsized":"2024-03-07T10:21:10.285216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284392+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:10.284392+0000","last_peered":"2024-03-07T10:21:10.284392+0000","last_clean":"2024-03-07T10:21:10.284392+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:10.284392+0000","last_undegraded":"2024-03-07T10:21:10.284392+0000","last_fullsized":"2024-03-07T10:21:10.284392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683772+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:10.683772+0000","last_peered":"2024-03-07T10:21:10.683772+0000","last_clean":"2024-03-07T10:21:10.683772+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:10.683772+0000","last_undegraded":"2024-03-07T10:21:10.683772+0000","last_fullsized":"2024-03-07T10:21:10.683772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680958+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:10.680958+0000","last_peered":"2024-03-07T10:21:10.680958+0000","last_clean":"2024-03-07T10:21:10.680958+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:10.680958+0000","last_undegraded":"2024-03-07T10:21:10.680958+0000","last_fullsized":"2024-03-07T10:21:10.680958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286746+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:10.286746+0000","last_peered":"2024-03-07T10:21:10.286746+0000","last_clean":"2024-03-07T10:21:10.286746+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:10.286746+0000","last_undegraded":"2024-03-07T10:21:10.286746+0000","last_fullsized":"2024-03-07T10:21:10.286746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683414+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:10.683414+0000","last_peered":"2024-03-07T10:21:10.683414+0000","last_clean":"2024-03-07T10:21:10.683414+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:10.683414+0000","last_undegraded":"2024-03-07T10:21:10.683414+0000","last_fullsized":"2024-03-07T10:21:10.683414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287229+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:10.287229+0000","last_peered":"2024-03-07T10:21:10.287229+0000","last_clean":"2024-03-07T10:21:10.287229+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:10.287229+0000","last_undegraded":"2024-03-07T10:21:10.287229+0000","last_fullsized":"2024-03-07T10:21:10.287229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682287+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:10.682287+0000","last_peered":"2024-03-07T10:21:10.682287+0000","last_clean":"2024-03-07T10:21:10.682287+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:10.682287+0000","last_undegraded":"2024-03-07T10:21:10.682287+0000","last_fullsized":"2024-03-07T10:21:10.682287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686299+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:10.686299+0000","last_peered":"2024-03-07T10:21:10.686299+0000","last_clean":"2024-03-07T10:21:10.686299+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:10.686299+0000","last_undegraded":"2024-03-07T10:21:10.686299+0000","last_fullsized":"2024-03-07T10:21:10.686299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285806+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:10.285806+0000","last_peered":"2024-03-07T10:21:10.285806+0000","last_clean":"2024-03-07T10:21:10.285806+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:10.285806+0000","last_undegraded":"2024-03-07T10:21:10.285806+0000","last_fullsized":"2024-03-07T10:21:10.285806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283983+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:10.283983+0000","last_peered":"2024-03-07T10:21:10.283983+0000","last_clean":"2024-03-07T10:21:10.283983+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:10.283983+0000","last_undegraded":"2024-03-07T10:21:10.283983+0000","last_fullsized":"2024-03-07T10:21:10.283983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286880+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:10.286880+0000","last_peered":"2024-03-07T10:21:10.286880+0000","last_clean":"2024-03-07T10:21:10.286880+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:10.286880+0000","last_undegraded":"2024-03-07T10:21:10.286880+0000","last_fullsized":"2024-03-07T10:21:10.286880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682579+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:10.682579+0000","last_peered":"2024-03-07T10:21:10.682579+0000","last_clean":"2024-03-07T10:21:10.682579+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:10.682579+0000","last_undegraded":"2024-03-07T10:21:10.682579+0000","last_fullsized":"2024-03-07T10:21:10.682579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287145+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:10.287145+0000","last_peered":"2024-03-07T10:21:10.287145+0000","last_clean":"2024-03-07T10:21:10.287145+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:10.287145+0000","last_undegraded":"2024-03-07T10:21:10.287145+0000","last_fullsized":"2024-03-07T10:21:10.287145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684595+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:10.684595+0000","last_peered":"2024-03-07T10:21:10.684595+0000","last_clean":"2024-03-07T10:21:10.684595+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:10.684595+0000","last_undegraded":"2024-03-07T10:21:10.684595+0000","last_fullsized":"2024-03-07T10:21:10.684595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685825+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:10.685825+0000","last_peered":"2024-03-07T10:21:10.685825+0000","last_clean":"2024-03-07T10:21:10.685825+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:10.685825+0000","last_undegraded":"2024-03-07T10:21:10.685825+0000","last_fullsized":"2024-03-07T10:21:10.685825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682261+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:10.682261+0000","last_peered":"2024-03-07T10:21:10.682261+0000","last_clean":"2024-03-07T10:21:10.682261+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:10.682261+0000","last_undegraded":"2024-03-07T10:21:10.682261+0000","last_fullsized":"2024-03-07T10:21:10.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284788+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:10.284788+0000","last_peered":"2024-03-07T10:21:10.284788+0000","last_clean":"2024-03-07T10:21:10.284788+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:10.284788+0000","last_undegraded":"2024-03-07T10:21:10.284788+0000","last_fullsized":"2024-03-07T10:21:10.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684796+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:10.684796+0000","last_peered":"2024-03-07T10:21:10.684796+0000","last_clean":"2024-03-07T10:21:10.684796+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:10.684796+0000","last_undegraded":"2024-03-07T10:21:10.684796+0000","last_fullsized":"2024-03-07T10:21:10.684796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679707+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:10.679707+0000","last_peered":"2024-03-07T10:21:10.679707+0000","last_clean":"2024-03-07T10:21:10.679707+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:10.679707+0000","last_undegraded":"2024-03-07T10:21:10.679707+0000","last_fullsized":"2024-03-07T10:21:10.679707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326644+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:10.326644+0000","last_peered":"2024-03-07T10:21:10.326644+0000","last_clean":"2024-03-07T10:21:10.326644+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:10.326644+0000","last_undegraded":"2024-03-07T10:21:10.326644+0000","last_fullsized":"2024-03-07T10:21:10.326644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681923+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:10.681923+0000","last_peered":"2024-03-07T10:21:10.681923+0000","last_clean":"2024-03-07T10:21:10.681923+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:10.681923+0000","last_undegraded":"2024-03-07T10:21:10.681923+0000","last_fullsized":"2024-03-07T10:21:10.681923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289526+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:10.289526+0000","last_peered":"2024-03-07T10:21:10.289526+0000","last_clean":"2024-03-07T10:21:10.289526+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:10.289526+0000","last_undegraded":"2024-03-07T10:21:10.289526+0000","last_fullsized":"2024-03-07T10:21:10.289526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682347+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:10.682347+0000","last_peered":"2024-03-07T10:21:10.682347+0000","last_clean":"2024-03-07T10:21:10.682347+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:10.682347+0000","last_undegraded":"2024-03-07T10:21:10.682347+0000","last_fullsized":"2024-03-07T10:21:10.682347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686295+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:10.686295+0000","last_peered":"2024-03-07T10:21:10.686295+0000","last_clean":"2024-03-07T10:21:10.686295+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:10.686295+0000","last_undegraded":"2024-03-07T10:21:10.686295+0000","last_fullsized":"2024-03-07T10:21:10.686295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:20.543 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.780+0000 7f7be3200640 1 Processor -- start 2024-03-07T10:21:20.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.781+0000 7f7be3200640 1 -- start start 2024-03-07T10:21:20.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4150a90 0x7f7be40c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 0x7f7be40c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7be40c2690 0x7f7be40c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4072b50 con 0x7f7be40c2690 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4150e70 con 0x7f7be40c4130 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4071cf0 con 0x7f7be4150a90 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be2800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7be40c2690 0x7f7be40c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be2800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7be40c2690 0x7f7be40c1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59292/0 (socket says 172.21.15.194:59292) 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.782+0000 7f7be2800640 1 -- 172.21.15.194:0/160960943 learned_addr learned my addr 172.21.15.194:0/160960943 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be1e00640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4150a90 0x7f7be40c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7bd9400640 1 --2- 172.21.15.194:0/160960943 >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 0x7f7be40c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be2800640 1 -- 172.21.15.194:0/160960943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4150a90 msgr2=0x7f7be40c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be2800640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4150a90 0x7f7be40c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be2800640 1 -- 172.21.15.194:0/160960943 >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 msgr2=0x7f7be40c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be2800640 1 --2- 172.21.15.194:0/160960943 >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 0x7f7be40c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7be2800640 1 -- 172.21.15.194:0/160960943 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be40c33b0 con 0x7f7be40c2690 2024-03-07T10:21:20.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.783+0000 7f7bd9400640 1 --2- 172.21.15.194:0/160960943 >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 0x7f7be40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.784+0000 7f7be2800640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be40c2690 0x7f7be40c1c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7be40c6c30 tx=0x7f7bdc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa435beacfbbc1a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.784+0000 7f7be1400640 1 -- 172.21.15.194:0/160960943 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc02ca70 con 0x7f7be40c2690 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.784+0000 7f7be1400640 1 -- 172.21.15.194:0/160960943 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc02cc10 con 0x7f7be40c2690 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.784+0000 7f7be1400640 1 -- 172.21.15.194:0/160960943 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0343f0 con 0x7f7be40c2690 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 -- 172.21.15.194:0/160960943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be40c2690 msgr2=0x7f7be40c1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be40c2690 0x7f7be40c1c10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7be40c6c30 tx=0x7f7bdc02bed0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 -- 172.21.15.194:0/160960943 shutdown_connections 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be40c2690 0x7f7be40c1c10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 --2- 172.21.15.194:0/160960943 >> v2:172.21.15.196:3300/0 conn(0x7f7be40c4130 0x7f7be40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 --2- 172.21.15.194:0/160960943 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be4150a90 0x7f7be40c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 -- 172.21.15.194:0/160960943 >> 172.21.15.194:0/160960943 conn(0x7f7be40c70f0 msgr2=0x7f7be40c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 -- 172.21.15.194:0/160960943 shutdown_connections 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.785+0000 7f7be3200640 1 -- 172.21.15.194:0/160960943 wait complete. 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.786+0000 7f7be3200640 1 Processor -- start 2024-03-07T10:21:20.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 -- start start 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40c2690 0x7f7be40a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40c4130 0x7f7be4146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4073340 con 0x7f7be4150a90 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4073060 con 0x7f7be40c2690 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.787+0000 7f7be3200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4071520 con 0x7f7be40c4130 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59304/0 (socket says 172.21.15.194:59304) 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 -- 172.21.15.194:0/3570619875 learned_addr learned my addr 172.21.15.194:0/3570619875 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:20.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be1e00640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40c2690 0x7f7be40a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7bd9400640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40c4130 0x7f7be4146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 -- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40c4130 msgr2=0x7f7be4146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40c4130 0x7f7be4146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 -- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40c2690 msgr2=0x7f7be40a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40c2690 0x7f7be40a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 -- 172.21.15.194:0/3570619875 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4147de0 con 0x7f7be4150a90 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.788+0000 7f7be2800640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc02c4e0 tx=0x7f7bdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.789+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc043020 con 0x7f7be4150a90 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.789+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc03e450 con 0x7f7be4150a90 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.789+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc009510 con 0x7f7be4150a90 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.789+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be414b0f0 con 0x7f7be4150a90 2024-03-07T10:21:20.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.789+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be40aa320 con 0x7f7be4150a90 2024-03-07T10:21:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.790+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be414b5b0 con 0x7f7be4150a90 2024-03-07T10:21:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.791+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7bdc046020 con 0x7f7be4150a90 2024-03-07T10:21:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.791+0000 7f7bdaa00640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 0x7f7bc006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:20.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.792+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7bdc0acfe0 con 0x7f7be4150a90 2024-03-07T10:21:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.792+0000 7f7be1e00640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 0x7f7bc006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:20.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.793+0000 7f7be1e00640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 0x7f7bc006d9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:20.797 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:20.796+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7bdc04d020 con 0x7f7be4150a90 2024-03-07T10:21:21.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.016+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7be414aee0 con 0x7f7bc006b520 2024-03-07T10:21:21.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.050+0000 7f7bdaa00640 1 -- 172.21.15.194:0/3570619875 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490306 (secure 0 0 0) 0x7f7be414aee0 con 0x7f7bc006b520 2024-03-07T10:21:21.054 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:21.065 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 msgr2=0x7f7bc006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 0x7f7bc006d9e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc006fd0 tx=0x7f7bcc008040 comp rx=0 tx=0).stop 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 msgr2=0x7f7be4147430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc02c4e0 tx=0x7f7bdc004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 shutdown_connections 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7bc006b520 0x7f7bc006d9e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.068 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be4150a90 0x7f7be4147430 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7be40c4130 0x7f7be4146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 --2- 172.21.15.194:0/3570619875 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7be40c2690 0x7f7be40a9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 >> 172.21.15.194:0/3570619875 conn(0x7f7be40c70f0 msgr2=0x7f7be40c0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:21.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 shutdown_connections 2024-03-07T10:21:21.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.060+0000 7f7be3200640 1 -- 172.21.15.194:0/3570619875 wait complete. 2024-03-07T10:21:21.080 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-03-07T10:21:20.418842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219432,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755288,"statfs":{"total":773094113280,"available":772869414912,"internally_reserved":0,"allocated":3350528,"data_stored":1984464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.137405"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681952+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:10.681952+0000","last_peered":"2024-03-07T10:21:10.681952+0000","last_clean":"2024-03-07T10:21:10.681952+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:10.681952+0000","last_undegraded":"2024-03-07T10:21:10.681952+0000","last_fullsized":"2024-03-07T10:21:10.681952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325792+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:10.325792+0000","last_peered":"2024-03-07T10:21:10.325792+0000","last_clean":"2024-03-07T10:21:10.325792+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:10.325792+0000","last_undegraded":"2024-03-07T10:21:10.325792+0000","last_fullsized":"2024-03-07T10:21:10.325792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286432+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:10.286432+0000","last_peered":"2024-03-07T10:21:10.286432+0000","last_clean":"2024-03-07T10:21:10.286432+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:10.286432+0000","last_undegraded":"2024-03-07T10:21:10.286432+0000","last_fullsized":"2024-03-07T10:21:10.286432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284469+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:10.284469+0000","last_peered":"2024-03-07T10:21:10.284469+0000","last_clean":"2024-03-07T10:21:10.284469+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:10.284469+0000","last_undegraded":"2024-03-07T10:21:10.284469+0000","last_fullsized":"2024-03-07T10:21:10.284469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286865+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:10.286865+0000","last_peered":"2024-03-07T10:21:10.286865+0000","last_clean":"2024-03-07T10:21:10.286865+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:10.286865+0000","last_undegraded":"2024-03-07T10:21:10.286865+0000","last_fullsized":"2024-03-07T10:21:10.286865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286551+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:10.286551+0000","last_peered":"2024-03-07T10:21:10.286551+0000","last_clean":"2024-03-07T10:21:10.286551+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:10.286551+0000","last_undegraded":"2024-03-07T10:21:10.286551+0000","last_fullsized":"2024-03-07T10:21:10.286551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325568+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:10.325568+0000","last_peered":"2024-03-07T10:21:10.325568+0000","last_clean":"2024-03-07T10:21:10.325568+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:10.325568+0000","last_undegraded":"2024-03-07T10:21:10.325568+0000","last_fullsized":"2024-03-07T10:21:10.325568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684538+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:10.684538+0000","last_peered":"2024-03-07T10:21:10.684538+0000","last_clean":"2024-03-07T10:21:10.684538+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:10.684538+0000","last_undegraded":"2024-03-07T10:21:10.684538+0000","last_fullsized":"2024-03-07T10:21:10.684538+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682332+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:10.682332+0000","last_peered":"2024-03-07T10:21:10.682332+0000","last_clean":"2024-03-07T10:21:10.682332+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:10.682332+0000","last_undegraded":"2024-03-07T10:21:10.682332+0000","last_fullsized":"2024-03-07T10:21:10.682332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685302+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:10.685302+0000","last_peered":"2024-03-07T10:21:10.685302+0000","last_clean":"2024-03-07T10:21:10.685302+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:10.685302+0000","last_undegraded":"2024-03-07T10:21:10.685302+0000","last_fullsized":"2024-03-07T10:21:10.685302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685091+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:10.685091+0000","last_peered":"2024-03-07T10:21:10.685091+0000","last_clean":"2024-03-07T10:21:10.685091+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:10.685091+0000","last_undegraded":"2024-03-07T10:21:10.685091+0000","last_fullsized":"2024-03-07T10:21:10.685091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684372+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:10.684372+0000","last_peered":"2024-03-07T10:21:10.684372+0000","last_clean":"2024-03-07T10:21:10.684372+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:10.684372+0000","last_undegraded":"2024-03-07T10:21:10.684372+0000","last_fullsized":"2024-03-07T10:21:10.684372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684343+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:10.684343+0000","last_peered":"2024-03-07T10:21:10.684343+0000","last_clean":"2024-03-07T10:21:10.684343+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:10.684343+0000","last_undegraded":"2024-03-07T10:21:10.684343+0000","last_fullsized":"2024-03-07T10:21:10.684343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684183+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:10.684183+0000","last_peered":"2024-03-07T10:21:10.684183+0000","last_clean":"2024-03-07T10:21:10.684183+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:10.684183+0000","last_undegraded":"2024-03-07T10:21:10.684183+0000","last_fullsized":"2024-03-07T10:21:10.684183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685884+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:10.685884+0000","last_peered":"2024-03-07T10:21:10.685884+0000","last_clean":"2024-03-07T10:21:10.685884+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:10.685884+0000","last_undegraded":"2024-03-07T10:21:10.685884+0000","last_fullsized":"2024-03-07T10:21:10.685884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684425+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:10.684425+0000","last_peered":"2024-03-07T10:21:10.684425+0000","last_clean":"2024-03-07T10:21:10.684425+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:10.684425+0000","last_undegraded":"2024-03-07T10:21:10.684425+0000","last_fullsized":"2024-03-07T10:21:10.684425+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286489+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:10.286489+0000","last_peered":"2024-03-07T10:21:10.286489+0000","last_clean":"2024-03-07T10:21:10.286489+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:10.286489+0000","last_undegraded":"2024-03-07T10:21:10.286489+0000","last_fullsized":"2024-03-07T10:21:10.286489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683354+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:10.683354+0000","last_peered":"2024-03-07T10:21:10.683354+0000","last_clean":"2024-03-07T10:21:10.683354+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:10.683354+0000","last_undegraded":"2024-03-07T10:21:10.683354+0000","last_fullsized":"2024-03-07T10:21:10.683354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684552+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:10.684552+0000","last_peered":"2024-03-07T10:21:10.684552+0000","last_clean":"2024-03-07T10:21:10.684552+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:10.684552+0000","last_undegraded":"2024-03-07T10:21:10.684552+0000","last_fullsized":"2024-03-07T10:21:10.684552+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679906+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:10.679906+0000","last_peered":"2024-03-07T10:21:10.679906+0000","last_clean":"2024-03-07T10:21:10.679906+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:10.679906+0000","last_undegraded":"2024-03-07T10:21:10.679906+0000","last_fullsized":"2024-03-07T10:21:10.679906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285306+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:10.285306+0000","last_peered":"2024-03-07T10:21:10.285306+0000","last_clean":"2024-03-07T10:21:10.285306+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:10.285306+0000","last_undegraded":"2024-03-07T10:21:10.285306+0000","last_fullsized":"2024-03-07T10:21:10.285306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288869+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:10.288869+0000","last_peered":"2024-03-07T10:21:10.288869+0000","last_clean":"2024-03-07T10:21:10.288869+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:10.288869+0000","last_undegraded":"2024-03-07T10:21:10.288869+0000","last_fullsized":"2024-03-07T10:21:10.288869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683532+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:10.683532+0000","last_peered":"2024-03-07T10:21:10.683532+0000","last_clean":"2024-03-07T10:21:10.683532+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:10.683532+0000","last_undegraded":"2024-03-07T10:21:10.683532+0000","last_fullsized":"2024-03-07T10:21:10.683532+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686187+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:10.686187+0000","last_peered":"2024-03-07T10:21:10.686187+0000","last_clean":"2024-03-07T10:21:10.686187+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:10.686187+0000","last_undegraded":"2024-03-07T10:21:10.686187+0000","last_fullsized":"2024-03-07T10:21:10.686187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284191+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:10.284191+0000","last_peered":"2024-03-07T10:21:10.284191+0000","last_clean":"2024-03-07T10:21:10.284191+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:10.284191+0000","last_undegraded":"2024-03-07T10:21:10.284191+0000","last_fullsized":"2024-03-07T10:21:10.284191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287480+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:10.287480+0000","last_peered":"2024-03-07T10:21:10.287480+0000","last_clean":"2024-03-07T10:21:10.287480+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:10.287480+0000","last_undegraded":"2024-03-07T10:21:10.287480+0000","last_fullsized":"2024-03-07T10:21:10.287480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288170+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:10.288170+0000","last_peered":"2024-03-07T10:21:10.288170+0000","last_clean":"2024-03-07T10:21:10.288170+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:10.288170+0000","last_undegraded":"2024-03-07T10:21:10.288170+0000","last_fullsized":"2024-03-07T10:21:10.288170+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686667+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:10.686667+0000","last_peered":"2024-03-07T10:21:10.686667+0000","last_clean":"2024-03-07T10:21:10.686667+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:10.686667+0000","last_undegraded":"2024-03-07T10:21:10.686667+0000","last_fullsized":"2024-03-07T10:21:10.686667+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683628+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:10.683628+0000","last_peered":"2024-03-07T10:21:10.683628+0000","last_clean":"2024-03-07T10:21:10.683628+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:10.683628+0000","last_undegraded":"2024-03-07T10:21:10.683628+0000","last_fullsized":"2024-03-07T10:21:10.683628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682871+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:10.682871+0000","last_peered":"2024-03-07T10:21:10.682871+0000","last_clean":"2024-03-07T10:21:10.682871+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:10.682871+0000","last_undegraded":"2024-03-07T10:21:10.682871+0000","last_fullsized":"2024-03-07T10:21:10.682871+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686358+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:10.686358+0000","last_peered":"2024-03-07T10:21:10.686358+0000","last_clean":"2024-03-07T10:21:10.686358+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:10.686358+0000","last_undegraded":"2024-03-07T10:21:10.686358+0000","last_fullsized":"2024-03-07T10:21:10.686358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283827+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:10.283827+0000","last_peered":"2024-03-07T10:21:10.283827+0000","last_clean":"2024-03-07T10:21:10.283827+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:10.283827+0000","last_undegraded":"2024-03-07T10:21:10.283827+0000","last_fullsized":"2024-03-07T10:21:10.283827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325741+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:10.325741+0000","last_peered":"2024-03-07T10:21:10.325741+0000","last_clean":"2024-03-07T10:21:10.325741+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:10.325741+0000","last_undegraded":"2024-03-07T10:21:10.325741+0000","last_fullsized":"2024-03-07T10:21:10.325741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287317+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:10.287317+0000","last_peered":"2024-03-07T10:21:10.287317+0000","last_clean":"2024-03-07T10:21:10.287317+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:10.287317+0000","last_undegraded":"2024-03-07T10:21:10.287317+0000","last_fullsized":"2024-03-07T10:21:10.287317+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683398+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:10.683398+0000","last_peered":"2024-03-07T10:21:10.683398+0000","last_clean":"2024-03-07T10:21:10.683398+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:10.683398+0000","last_undegraded":"2024-03-07T10:21:10.683398+0000","last_fullsized":"2024-03-07T10:21:10.683398+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682936+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:10.682936+0000","last_peered":"2024-03-07T10:21:10.682936+0000","last_clean":"2024-03-07T10:21:10.682936+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:10.682936+0000","last_undegraded":"2024-03-07T10:21:10.682936+0000","last_fullsized":"2024-03-07T10:21:10.682936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288774+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:10.288774+0000","last_peered":"2024-03-07T10:21:10.288774+0000","last_clean":"2024-03-07T10:21:10.288774+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:10.288774+0000","last_undegraded":"2024-03-07T10:21:10.288774+0000","last_fullsized":"2024-03-07T10:21:10.288774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289710+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:10.289710+0000","last_peered":"2024-03-07T10:21:10.289710+0000","last_clean":"2024-03-07T10:21:10.289710+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:10.289710+0000","last_undegraded":"2024-03-07T10:21:10.289710+0000","last_fullsized":"2024-03-07T10:21:10.289710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283722+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:10.283722+0000","last_peered":"2024-03-07T10:21:10.283722+0000","last_clean":"2024-03-07T10:21:10.283722+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:10.283722+0000","last_undegraded":"2024-03-07T10:21:10.283722+0000","last_fullsized":"2024-03-07T10:21:10.283722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286315+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:10.286315+0000","last_peered":"2024-03-07T10:21:10.286315+0000","last_clean":"2024-03-07T10:21:10.286315+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:10.286315+0000","last_undegraded":"2024-03-07T10:21:10.286315+0000","last_fullsized":"2024-03-07T10:21:10.286315+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287699+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:10.287699+0000","last_peered":"2024-03-07T10:21:10.287699+0000","last_clean":"2024-03-07T10:21:10.287699+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:10.287699+0000","last_undegraded":"2024-03-07T10:21:10.287699+0000","last_fullsized":"2024-03-07T10:21:10.287699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685644+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:10.685644+0000","last_peered":"2024-03-07T10:21:10.685644+0000","last_clean":"2024-03-07T10:21:10.685644+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:10.685644+0000","last_undegraded":"2024-03-07T10:21:10.685644+0000","last_fullsized":"2024-03-07T10:21:10.685644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325736+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:10.325736+0000","last_peered":"2024-03-07T10:21:10.325736+0000","last_clean":"2024-03-07T10:21:10.325736+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:10.325736+0000","last_undegraded":"2024-03-07T10:21:10.325736+0000","last_fullsized":"2024-03-07T10:21:10.325736+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326342+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:10.326342+0000","last_peered":"2024-03-07T10:21:10.326342+0000","last_clean":"2024-03-07T10:21:10.326342+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:10.326342+0000","last_undegraded":"2024-03-07T10:21:10.326342+0000","last_fullsized":"2024-03-07T10:21:10.326342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685900+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:10.685900+0000","last_peered":"2024-03-07T10:21:10.685900+0000","last_clean":"2024-03-07T10:21:10.685900+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:10.685900+0000","last_undegraded":"2024-03-07T10:21:10.685900+0000","last_fullsized":"2024-03-07T10:21:10.685900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287824+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:10.287824+0000","last_peered":"2024-03-07T10:21:10.287824+0000","last_clean":"2024-03-07T10:21:10.287824+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:10.287824+0000","last_undegraded":"2024-03-07T10:21:10.287824+0000","last_fullsized":"2024-03-07T10:21:10.287824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288576+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:10.288576+0000","last_peered":"2024-03-07T10:21:10.288576+0000","last_clean":"2024-03-07T10:21:10.288576+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:10.288576+0000","last_undegraded":"2024-03-07T10:21:10.288576+0000","last_fullsized":"2024-03-07T10:21:10.288576+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325290+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:10.325290+0000","last_peered":"2024-03-07T10:21:10.325290+0000","last_clean":"2024-03-07T10:21:10.325290+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:10.325290+0000","last_undegraded":"2024-03-07T10:21:10.325290+0000","last_fullsized":"2024-03-07T10:21:10.325290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685706+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:10.685706+0000","last_peered":"2024-03-07T10:21:10.685706+0000","last_clean":"2024-03-07T10:21:10.685706+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:10.685706+0000","last_undegraded":"2024-03-07T10:21:10.685706+0000","last_fullsized":"2024-03-07T10:21:10.685706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685126+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:10.685126+0000","last_peered":"2024-03-07T10:21:10.685126+0000","last_clean":"2024-03-07T10:21:10.685126+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:10.685126+0000","last_undegraded":"2024-03-07T10:21:10.685126+0000","last_fullsized":"2024-03-07T10:21:10.685126+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287637+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:10.287637+0000","last_peered":"2024-03-07T10:21:10.287637+0000","last_clean":"2024-03-07T10:21:10.287637+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:10.287637+0000","last_undegraded":"2024-03-07T10:21:10.287637+0000","last_fullsized":"2024-03-07T10:21:10.287637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679879+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:10.679879+0000","last_peered":"2024-03-07T10:21:10.679879+0000","last_clean":"2024-03-07T10:21:10.679879+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:10.679879+0000","last_undegraded":"2024-03-07T10:21:10.679879+0000","last_fullsized":"2024-03-07T10:21:10.679879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287054+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:10.287054+0000","last_peered":"2024-03-07T10:21:10.287054+0000","last_clean":"2024-03-07T10:21:10.287054+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:10.287054+0000","last_undegraded":"2024-03-07T10:21:10.287054+0000","last_fullsized":"2024-03-07T10:21:10.287054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679803+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:10.679803+0000","last_peered":"2024-03-07T10:21:10.679803+0000","last_clean":"2024-03-07T10:21:10.679803+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:10.679803+0000","last_undegraded":"2024-03-07T10:21:10.679803+0000","last_fullsized":"2024-03-07T10:21:10.679803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288300+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:10.288300+0000","last_peered":"2024-03-07T10:21:10.288300+0000","last_clean":"2024-03-07T10:21:10.288300+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:10.288300+0000","last_undegraded":"2024-03-07T10:21:10.288300+0000","last_fullsized":"2024-03-07T10:21:10.288300+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686885+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:10.686885+0000","last_peered":"2024-03-07T10:21:10.686885+0000","last_clean":"2024-03-07T10:21:10.686885+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:10.686885+0000","last_undegraded":"2024-03-07T10:21:10.686885+0000","last_fullsized":"2024-03-07T10:21:10.686885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324971+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:10.324971+0000","last_peered":"2024-03-07T10:21:10.324971+0000","last_clean":"2024-03-07T10:21:10.324971+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:10.324971+0000","last_undegraded":"2024-03-07T10:21:10.324971+0000","last_fullsized":"2024-03-07T10:21:10.324971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683051+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:10.683051+0000","last_peered":"2024-03-07T10:21:10.683051+0000","last_clean":"2024-03-07T10:21:10.683051+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:10.683051+0000","last_undegraded":"2024-03-07T10:21:10.683051+0000","last_fullsized":"2024-03-07T10:21:10.683051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.328523+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:10.328523+0000","last_peered":"2024-03-07T10:21:10.328523+0000","last_clean":"2024-03-07T10:21:10.328523+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:10.328523+0000","last_undegraded":"2024-03-07T10:21:10.328523+0000","last_fullsized":"2024-03-07T10:21:10.328523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683818+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:10.683818+0000","last_peered":"2024-03-07T10:21:10.683818+0000","last_clean":"2024-03-07T10:21:10.683818+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:10.683818+0000","last_undegraded":"2024-03-07T10:21:10.683818+0000","last_fullsized":"2024-03-07T10:21:10.683818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284681+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:10.284681+0000","last_peered":"2024-03-07T10:21:10.284681+0000","last_clean":"2024-03-07T10:21:10.284681+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:10.284681+0000","last_undegraded":"2024-03-07T10:21:10.284681+0000","last_fullsized":"2024-03-07T10:21:10.284681+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684415+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:10.684415+0000","last_peered":"2024-03-07T10:21:10.684415+0000","last_clean":"2024-03-07T10:21:10.684415+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:10.684415+0000","last_undegraded":"2024-03-07T10:21:10.684415+0000","last_fullsized":"2024-03-07T10:21:10.684415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683520+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:10.683520+0000","last_peered":"2024-03-07T10:21:10.683520+0000","last_clean":"2024-03-07T10:21:10.683520+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:10.683520+0000","last_undegraded":"2024-03-07T10:21:10.683520+0000","last_fullsized":"2024-03-07T10:21:10.683520+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286588+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:10.286588+0000","last_peered":"2024-03-07T10:21:10.286588+0000","last_clean":"2024-03-07T10:21:10.286588+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:10.286588+0000","last_undegraded":"2024-03-07T10:21:10.286588+0000","last_fullsized":"2024-03-07T10:21:10.286588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681084+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:10.681084+0000","last_peered":"2024-03-07T10:21:10.681084+0000","last_clean":"2024-03-07T10:21:10.681084+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:10.681084+0000","last_undegraded":"2024-03-07T10:21:10.681084+0000","last_fullsized":"2024-03-07T10:21:10.681084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685123+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:10.685123+0000","last_peered":"2024-03-07T10:21:10.685123+0000","last_clean":"2024-03-07T10:21:10.685123+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:10.685123+0000","last_undegraded":"2024-03-07T10:21:10.685123+0000","last_fullsized":"2024-03-07T10:21:10.685123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680116+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:10.680116+0000","last_peered":"2024-03-07T10:21:10.680116+0000","last_clean":"2024-03-07T10:21:10.680116+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:10.680116+0000","last_undegraded":"2024-03-07T10:21:10.680116+0000","last_fullsized":"2024-03-07T10:21:10.680116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286346+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:10.286346+0000","last_peered":"2024-03-07T10:21:10.286346+0000","last_clean":"2024-03-07T10:21:10.286346+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:10.286346+0000","last_undegraded":"2024-03-07T10:21:10.286346+0000","last_fullsized":"2024-03-07T10:21:10.286346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679853+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:10.679853+0000","last_peered":"2024-03-07T10:21:10.679853+0000","last_clean":"2024-03-07T10:21:10.679853+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:10.679853+0000","last_undegraded":"2024-03-07T10:21:10.679853+0000","last_fullsized":"2024-03-07T10:21:10.679853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685331+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:10.685331+0000","last_peered":"2024-03-07T10:21:10.685331+0000","last_clean":"2024-03-07T10:21:10.685331+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:10.685331+0000","last_undegraded":"2024-03-07T10:21:10.685331+0000","last_fullsized":"2024-03-07T10:21:10.685331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288324+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:10.288324+0000","last_peered":"2024-03-07T10:21:10.288324+0000","last_clean":"2024-03-07T10:21:10.288324+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:10.288324+0000","last_undegraded":"2024-03-07T10:21:10.288324+0000","last_fullsized":"2024-03-07T10:21:10.288324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325430+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:10.325430+0000","last_peered":"2024-03-07T10:21:10.325430+0000","last_clean":"2024-03-07T10:21:10.325430+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:10.325430+0000","last_undegraded":"2024-03-07T10:21:10.325430+0000","last_fullsized":"2024-03-07T10:21:10.325430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683114+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:10.683114+0000","last_peered":"2024-03-07T10:21:10.683114+0000","last_clean":"2024-03-07T10:21:10.683114+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:10.683114+0000","last_undegraded":"2024-03-07T10:21:10.683114+0000","last_fullsized":"2024-03-07T10:21:10.683114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686525+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:10.686525+0000","last_peered":"2024-03-07T10:21:10.686525+0000","last_clean":"2024-03-07T10:21:10.686525+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:10.686525+0000","last_undegraded":"2024-03-07T10:21:10.686525+0000","last_fullsized":"2024-03-07T10:21:10.686525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680173+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:10.680173+0000","last_peered":"2024-03-07T10:21:10.680173+0000","last_clean":"2024-03-07T10:21:10.680173+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:10.680173+0000","last_undegraded":"2024-03-07T10:21:10.680173+0000","last_fullsized":"2024-03-07T10:21:10.680173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681801+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:10.681801+0000","last_peered":"2024-03-07T10:21:10.681801+0000","last_clean":"2024-03-07T10:21:10.681801+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:10.681801+0000","last_undegraded":"2024-03-07T10:21:10.681801+0000","last_fullsized":"2024-03-07T10:21:10.681801+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679626+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:10.679626+0000","last_peered":"2024-03-07T10:21:10.679626+0000","last_clean":"2024-03-07T10:21:10.679626+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:10.679626+0000","last_undegraded":"2024-03-07T10:21:10.679626+0000","last_fullsized":"2024-03-07T10:21:10.679626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683746+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:10.683746+0000","last_peered":"2024-03-07T10:21:10.683746+0000","last_clean":"2024-03-07T10:21:10.683746+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:10.683746+0000","last_undegraded":"2024-03-07T10:21:10.683746+0000","last_fullsized":"2024-03-07T10:21:10.683746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685507+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:10.685507+0000","last_peered":"2024-03-07T10:21:10.685507+0000","last_clean":"2024-03-07T10:21:10.685507+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:10.685507+0000","last_undegraded":"2024-03-07T10:21:10.685507+0000","last_fullsized":"2024-03-07T10:21:10.685507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683092+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:10.683092+0000","last_peered":"2024-03-07T10:21:10.683092+0000","last_clean":"2024-03-07T10:21:10.683092+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:10.683092+0000","last_undegraded":"2024-03-07T10:21:10.683092+0000","last_fullsized":"2024-03-07T10:21:10.683092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288351+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:10.288351+0000","last_peered":"2024-03-07T10:21:10.288351+0000","last_clean":"2024-03-07T10:21:10.288351+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:10.288351+0000","last_undegraded":"2024-03-07T10:21:10.288351+0000","last_fullsized":"2024-03-07T10:21:10.288351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682905+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:10.682905+0000","last_peered":"2024-03-07T10:21:10.682905+0000","last_clean":"2024-03-07T10:21:10.682905+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:10.682905+0000","last_undegraded":"2024-03-07T10:21:10.682905+0000","last_fullsized":"2024-03-07T10:21:10.682905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679685+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:10.679685+0000","last_peered":"2024-03-07T10:21:10.679685+0000","last_clean":"2024-03-07T10:21:10.679685+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:10.679685+0000","last_undegraded":"2024-03-07T10:21:10.679685+0000","last_fullsized":"2024-03-07T10:21:10.679685+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325673+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:10.325673+0000","last_peered":"2024-03-07T10:21:10.325673+0000","last_clean":"2024-03-07T10:21:10.325673+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:10.325673+0000","last_undegraded":"2024-03-07T10:21:10.325673+0000","last_fullsized":"2024-03-07T10:21:10.325673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686280+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:10.686280+0000","last_peered":"2024-03-07T10:21:10.686280+0000","last_clean":"2024-03-07T10:21:10.686280+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:10.686280+0000","last_undegraded":"2024-03-07T10:21:10.686280+0000","last_fullsized":"2024-03-07T10:21:10.686280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285582+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:10.285582+0000","last_peered":"2024-03-07T10:21:10.285582+0000","last_clean":"2024-03-07T10:21:10.285582+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:10.285582+0000","last_undegraded":"2024-03-07T10:21:10.285582+0000","last_fullsized":"2024-03-07T10:21:10.285582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286158+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:10.286158+0000","last_peered":"2024-03-07T10:21:10.286158+0000","last_clean":"2024-03-07T10:21:10.286158+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:10.286158+0000","last_undegraded":"2024-03-07T10:21:10.286158+0000","last_fullsized":"2024-03-07T10:21:10.286158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288602+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:10.288602+0000","last_peered":"2024-03-07T10:21:10.288602+0000","last_clean":"2024-03-07T10:21:10.288602+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:10.288602+0000","last_undegraded":"2024-03-07T10:21:10.288602+0000","last_fullsized":"2024-03-07T10:21:10.288602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685483+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:10.685483+0000","last_peered":"2024-03-07T10:21:10.685483+0000","last_clean":"2024-03-07T10:21:10.685483+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:10.685483+0000","last_undegraded":"2024-03-07T10:21:10.685483+0000","last_fullsized":"2024-03-07T10:21:10.685483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682452+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:10.682452+0000","last_peered":"2024-03-07T10:21:10.682452+0000","last_clean":"2024-03-07T10:21:10.682452+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:10.682452+0000","last_undegraded":"2024-03-07T10:21:10.682452+0000","last_fullsized":"2024-03-07T10:21:10.682452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684988+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:10.684988+0000","last_peered":"2024-03-07T10:21:10.684988+0000","last_clean":"2024-03-07T10:21:10.684988+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:10.684988+0000","last_undegraded":"2024-03-07T10:21:10.684988+0000","last_fullsized":"2024-03-07T10:21:10.684988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"23'6","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285957+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:10.285957+0000","last_peered":"2024-03-07T10:21:10.285957+0000","last_clean":"2024-03-07T10:21:10.285957+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:10.285957+0000","last_undegraded":"2024-03-07T10:21:10.285957+0000","last_fullsized":"2024-03-07T10:21:10.285957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287780+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:10.287780+0000","last_peered":"2024-03-07T10:21:10.287780+0000","last_clean":"2024-03-07T10:21:10.287780+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:10.287780+0000","last_undegraded":"2024-03-07T10:21:10.287780+0000","last_fullsized":"2024-03-07T10:21:10.287780+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324945+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:10.324945+0000","last_peered":"2024-03-07T10:21:10.324945+0000","last_clean":"2024-03-07T10:21:10.324945+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:10.324945+0000","last_undegraded":"2024-03-07T10:21:10.324945+0000","last_fullsized":"2024-03-07T10:21:10.324945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326639+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:10.326639+0000","last_peered":"2024-03-07T10:21:10.326639+0000","last_clean":"2024-03-07T10:21:10.326639+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:10.326639+0000","last_undegraded":"2024-03-07T10:21:10.326639+0000","last_fullsized":"2024-03-07T10:21:10.326639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685807+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:10.685807+0000","last_peered":"2024-03-07T10:21:10.685807+0000","last_clean":"2024-03-07T10:21:10.685807+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:10.685807+0000","last_undegraded":"2024-03-07T10:21:10.685807+0000","last_fullsized":"2024-03-07T10:21:10.685807+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285236+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:10.285236+0000","last_peered":"2024-03-07T10:21:10.285236+0000","last_clean":"2024-03-07T10:21:10.285236+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:10.285236+0000","last_undegraded":"2024-03-07T10:21:10.285236+0000","last_fullsized":"2024-03-07T10:21:10.285236+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684937+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:10.684937+0000","last_peered":"2024-03-07T10:21:10.684937+0000","last_clean":"2024-03-07T10:21:10.684937+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:10.684937+0000","last_undegraded":"2024-03-07T10:21:10.684937+0000","last_fullsized":"2024-03-07T10:21:10.684937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286416+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:10.286416+0000","last_peered":"2024-03-07T10:21:10.286416+0000","last_clean":"2024-03-07T10:21:10.286416+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:10.286416+0000","last_undegraded":"2024-03-07T10:21:10.286416+0000","last_fullsized":"2024-03-07T10:21:10.286416+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288375+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:10.288375+0000","last_peered":"2024-03-07T10:21:10.288375+0000","last_clean":"2024-03-07T10:21:10.288375+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:10.288375+0000","last_undegraded":"2024-03-07T10:21:10.288375+0000","last_fullsized":"2024-03-07T10:21:10.288375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288996+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:10.288996+0000","last_peered":"2024-03-07T10:21:10.288996+0000","last_clean":"2024-03-07T10:21:10.288996+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:10.288996+0000","last_undegraded":"2024-03-07T10:21:10.288996+0000","last_fullsized":"2024-03-07T10:21:10.288996+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683910+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:10.683910+0000","last_peered":"2024-03-07T10:21:10.683910+0000","last_clean":"2024-03-07T10:21:10.683910+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:10.683910+0000","last_undegraded":"2024-03-07T10:21:10.683910+0000","last_fullsized":"2024-03-07T10:21:10.683910+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288186+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:10.288186+0000","last_peered":"2024-03-07T10:21:10.288186+0000","last_clean":"2024-03-07T10:21:10.288186+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:10.288186+0000","last_undegraded":"2024-03-07T10:21:10.288186+0000","last_fullsized":"2024-03-07T10:21:10.288186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687163+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:10.687163+0000","last_peered":"2024-03-07T10:21:10.687163+0000","last_clean":"2024-03-07T10:21:10.687163+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:10.687163+0000","last_undegraded":"2024-03-07T10:21:10.687163+0000","last_fullsized":"2024-03-07T10:21:10.687163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286227+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:10.286227+0000","last_peered":"2024-03-07T10:21:10.286227+0000","last_clean":"2024-03-07T10:21:10.286227+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:10.286227+0000","last_undegraded":"2024-03-07T10:21:10.286227+0000","last_fullsized":"2024-03-07T10:21:10.286227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325604+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:10.325604+0000","last_peered":"2024-03-07T10:21:10.325604+0000","last_clean":"2024-03-07T10:21:10.325604+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:10.325604+0000","last_undegraded":"2024-03-07T10:21:10.325604+0000","last_fullsized":"2024-03-07T10:21:10.325604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686797+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:10.686797+0000","last_peered":"2024-03-07T10:21:10.686797+0000","last_clean":"2024-03-07T10:21:10.686797+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:10.686797+0000","last_undegraded":"2024-03-07T10:21:10.686797+0000","last_fullsized":"2024-03-07T10:21:10.686797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283947+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:10.283947+0000","last_peered":"2024-03-07T10:21:10.283947+0000","last_clean":"2024-03-07T10:21:10.283947+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:10.283947+0000","last_undegraded":"2024-03-07T10:21:10.283947+0000","last_fullsized":"2024-03-07T10:21:10.283947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682584+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:10.682584+0000","last_peered":"2024-03-07T10:21:10.682584+0000","last_clean":"2024-03-07T10:21:10.682584+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:10.682584+0000","last_undegraded":"2024-03-07T10:21:10.682584+0000","last_fullsized":"2024-03-07T10:21:10.682584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686634+0000","last_change":"2024-03-07T10:20:58.149736+0000","last_active":"2024-03-07T10:21:10.686634+0000","last_peered":"2024-03-07T10:21:10.686634+0000","last_clean":"2024-03-07T10:21:10.686634+0000","last_became_active":"2024-03-07T10:20:58.148645+0000","last_became_peered":"2024-03-07T10:20:58.148645+0000","last_unstale":"2024-03-07T10:21:10.686634+0000","last_undegraded":"2024-03-07T10:21:10.686634+0000","last_fullsized":"2024-03-07T10:21:10.686634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287237+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:10.287237+0000","last_peered":"2024-03-07T10:21:10.287237+0000","last_clean":"2024-03-07T10:21:10.287237+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:10.287237+0000","last_undegraded":"2024-03-07T10:21:10.287237+0000","last_fullsized":"2024-03-07T10:21:10.287237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284075+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:10.284075+0000","last_peered":"2024-03-07T10:21:10.284075+0000","last_clean":"2024-03-07T10:21:10.284075+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:10.284075+0000","last_undegraded":"2024-03-07T10:21:10.284075+0000","last_fullsized":"2024-03-07T10:21:10.284075+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287179+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:10.287179+0000","last_peered":"2024-03-07T10:21:10.287179+0000","last_clean":"2024-03-07T10:21:10.287179+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:10.287179+0000","last_undegraded":"2024-03-07T10:21:10.287179+0000","last_fullsized":"2024-03-07T10:21:10.287179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326678+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:10.326678+0000","last_peered":"2024-03-07T10:21:10.326678+0000","last_clean":"2024-03-07T10:21:10.326678+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:10.326678+0000","last_undegraded":"2024-03-07T10:21:10.326678+0000","last_fullsized":"2024-03-07T10:21:10.326678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287143+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:10.287143+0000","last_peered":"2024-03-07T10:21:10.287143+0000","last_clean":"2024-03-07T10:21:10.287143+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:10.287143+0000","last_undegraded":"2024-03-07T10:21:10.287143+0000","last_fullsized":"2024-03-07T10:21:10.287143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682184+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:10.682184+0000","last_peered":"2024-03-07T10:21:10.682184+0000","last_clean":"2024-03-07T10:21:10.682184+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:10.682184+0000","last_undegraded":"2024-03-07T10:21:10.682184+0000","last_fullsized":"2024-03-07T10:21:10.682184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325459+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:10.325459+0000","last_peered":"2024-03-07T10:21:10.325459+0000","last_clean":"2024-03-07T10:21:10.325459+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:10.325459+0000","last_undegraded":"2024-03-07T10:21:10.325459+0000","last_fullsized":"2024-03-07T10:21:10.325459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287094+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:10.287094+0000","last_peered":"2024-03-07T10:21:10.287094+0000","last_clean":"2024-03-07T10:21:10.287094+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:10.287094+0000","last_undegraded":"2024-03-07T10:21:10.287094+0000","last_fullsized":"2024-03-07T10:21:10.287094+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284128+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:10.284128+0000","last_peered":"2024-03-07T10:21:10.284128+0000","last_clean":"2024-03-07T10:21:10.284128+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:10.284128+0000","last_undegraded":"2024-03-07T10:21:10.284128+0000","last_fullsized":"2024-03-07T10:21:10.284128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284918+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:10.284918+0000","last_peered":"2024-03-07T10:21:10.284918+0000","last_clean":"2024-03-07T10:21:10.284918+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:10.284918+0000","last_undegraded":"2024-03-07T10:21:10.284918+0000","last_fullsized":"2024-03-07T10:21:10.284918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287904+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:10.287904+0000","last_peered":"2024-03-07T10:21:10.287904+0000","last_clean":"2024-03-07T10:21:10.287904+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:10.287904+0000","last_undegraded":"2024-03-07T10:21:10.287904+0000","last_fullsized":"2024-03-07T10:21:10.287904+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286516+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:10.286516+0000","last_peered":"2024-03-07T10:21:10.286516+0000","last_clean":"2024-03-07T10:21:10.286516+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:10.286516+0000","last_undegraded":"2024-03-07T10:21:10.286516+0000","last_fullsized":"2024-03-07T10:21:10.286516+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326452+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:10.326452+0000","last_peered":"2024-03-07T10:21:10.326452+0000","last_clean":"2024-03-07T10:21:10.326452+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:10.326452+0000","last_undegraded":"2024-03-07T10:21:10.326452+0000","last_fullsized":"2024-03-07T10:21:10.326452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680031+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:10.680031+0000","last_peered":"2024-03-07T10:21:10.680031+0000","last_clean":"2024-03-07T10:21:10.680031+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:10.680031+0000","last_undegraded":"2024-03-07T10:21:10.680031+0000","last_fullsized":"2024-03-07T10:21:10.680031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683202+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:10.683202+0000","last_peered":"2024-03-07T10:21:10.683202+0000","last_clean":"2024-03-07T10:21:10.683202+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:10.683202+0000","last_undegraded":"2024-03-07T10:21:10.683202+0000","last_fullsized":"2024-03-07T10:21:10.683202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285522+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:10.285522+0000","last_peered":"2024-03-07T10:21:10.285522+0000","last_clean":"2024-03-07T10:21:10.285522+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:10.285522+0000","last_undegraded":"2024-03-07T10:21:10.285522+0000","last_fullsized":"2024-03-07T10:21:10.285522+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684573+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:10.684573+0000","last_peered":"2024-03-07T10:21:10.684573+0000","last_clean":"2024-03-07T10:21:10.684573+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:10.684573+0000","last_undegraded":"2024-03-07T10:21:10.684573+0000","last_fullsized":"2024-03-07T10:21:10.684573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285803+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:10.285803+0000","last_peered":"2024-03-07T10:21:10.285803+0000","last_clean":"2024-03-07T10:21:10.285803+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:10.285803+0000","last_undegraded":"2024-03-07T10:21:10.285803+0000","last_fullsized":"2024-03-07T10:21:10.285803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286194+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:10.286194+0000","last_peered":"2024-03-07T10:21:10.286194+0000","last_clean":"2024-03-07T10:21:10.286194+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:10.286194+0000","last_undegraded":"2024-03-07T10:21:10.286194+0000","last_fullsized":"2024-03-07T10:21:10.286194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285576+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:10.285576+0000","last_peered":"2024-03-07T10:21:10.285576+0000","last_clean":"2024-03-07T10:21:10.285576+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:10.285576+0000","last_undegraded":"2024-03-07T10:21:10.285576+0000","last_fullsized":"2024-03-07T10:21:10.285576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288264+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:10.288264+0000","last_peered":"2024-03-07T10:21:10.288264+0000","last_clean":"2024-03-07T10:21:10.288264+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:10.288264+0000","last_undegraded":"2024-03-07T10:21:10.288264+0000","last_fullsized":"2024-03-07T10:21:10.288264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679567+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:10.679567+0000","last_peered":"2024-03-07T10:21:10.679567+0000","last_clean":"2024-03-07T10:21:10.679567+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:10.679567+0000","last_undegraded":"2024-03-07T10:21:10.679567+0000","last_fullsized":"2024-03-07T10:21:10.679567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684568+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:10.684568+0000","last_peered":"2024-03-07T10:21:10.684568+0000","last_clean":"2024-03-07T10:21:10.684568+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:10.684568+0000","last_undegraded":"2024-03-07T10:21:10.684568+0000","last_fullsized":"2024-03-07T10:21:10.684568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684863+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:10.684863+0000","last_peered":"2024-03-07T10:21:10.684863+0000","last_clean":"2024-03-07T10:21:10.684863+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:10.684863+0000","last_undegraded":"2024-03-07T10:21:10.684863+0000","last_fullsized":"2024-03-07T10:21:10.684863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287708+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:10.287708+0000","last_peered":"2024-03-07T10:21:10.287708+0000","last_clean":"2024-03-07T10:21:10.287708+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:10.287708+0000","last_undegraded":"2024-03-07T10:21:10.287708+0000","last_fullsized":"2024-03-07T10:21:10.287708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326210+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:10.326210+0000","last_peered":"2024-03-07T10:21:10.326210+0000","last_clean":"2024-03-07T10:21:10.326210+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:10.326210+0000","last_undegraded":"2024-03-07T10:21:10.326210+0000","last_fullsized":"2024-03-07T10:21:10.326210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686265+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:10.686265+0000","last_peered":"2024-03-07T10:21:10.686265+0000","last_clean":"2024-03-07T10:21:10.686265+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:10.686265+0000","last_undegraded":"2024-03-07T10:21:10.686265+0000","last_fullsized":"2024-03-07T10:21:10.686265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287200+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:10.287200+0000","last_peered":"2024-03-07T10:21:10.287200+0000","last_clean":"2024-03-07T10:21:10.287200+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:10.287200+0000","last_undegraded":"2024-03-07T10:21:10.287200+0000","last_fullsized":"2024-03-07T10:21:10.287200+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684228+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:10.684228+0000","last_peered":"2024-03-07T10:21:10.684228+0000","last_clean":"2024-03-07T10:21:10.684228+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:10.684228+0000","last_undegraded":"2024-03-07T10:21:10.684228+0000","last_fullsized":"2024-03-07T10:21:10.684228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.288057+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:10.288057+0000","last_peered":"2024-03-07T10:21:10.288057+0000","last_clean":"2024-03-07T10:21:10.288057+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:10.288057+0000","last_undegraded":"2024-03-07T10:21:10.288057+0000","last_fullsized":"2024-03-07T10:21:10.288057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682253+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:10.682253+0000","last_peered":"2024-03-07T10:21:10.682253+0000","last_clean":"2024-03-07T10:21:10.682253+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:10.682253+0000","last_undegraded":"2024-03-07T10:21:10.682253+0000","last_fullsized":"2024-03-07T10:21:10.682253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287258+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:10.287258+0000","last_peered":"2024-03-07T10:21:10.287258+0000","last_clean":"2024-03-07T10:21:10.287258+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:10.287258+0000","last_undegraded":"2024-03-07T10:21:10.287258+0000","last_fullsized":"2024-03-07T10:21:10.287258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285886+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:10.285886+0000","last_peered":"2024-03-07T10:21:10.285886+0000","last_clean":"2024-03-07T10:21:10.285886+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:10.285886+0000","last_undegraded":"2024-03-07T10:21:10.285886+0000","last_fullsized":"2024-03-07T10:21:10.285886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289513+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:10.289513+0000","last_peered":"2024-03-07T10:21:10.289513+0000","last_clean":"2024-03-07T10:21:10.289513+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:10.289513+0000","last_undegraded":"2024-03-07T10:21:10.289513+0000","last_fullsized":"2024-03-07T10:21:10.289513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286013+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:10.286013+0000","last_peered":"2024-03-07T10:21:10.286013+0000","last_clean":"2024-03-07T10:21:10.286013+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:10.286013+0000","last_undegraded":"2024-03-07T10:21:10.286013+0000","last_fullsized":"2024-03-07T10:21:10.286013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682028+0000","last_change":"2024-03-07T10:20:58.148489+0000","last_active":"2024-03-07T10:21:10.682028+0000","last_peered":"2024-03-07T10:21:10.682028+0000","last_clean":"2024-03-07T10:21:10.682028+0000","last_became_active":"2024-03-07T10:20:58.147670+0000","last_became_peered":"2024-03-07T10:20:58.147670+0000","last_unstale":"2024-03-07T10:21:10.682028+0000","last_undegraded":"2024-03-07T10:21:10.682028+0000","last_fullsized":"2024-03-07T10:21:10.682028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683779+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:10.683779+0000","last_peered":"2024-03-07T10:21:10.683779+0000","last_clean":"2024-03-07T10:21:10.683779+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:10.683779+0000","last_undegraded":"2024-03-07T10:21:10.683779+0000","last_fullsized":"2024-03-07T10:21:10.683779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284741+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:10.284741+0000","last_peered":"2024-03-07T10:21:10.284741+0000","last_clean":"2024-03-07T10:21:10.284741+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:10.284741+0000","last_undegraded":"2024-03-07T10:21:10.284741+0000","last_fullsized":"2024-03-07T10:21:10.284741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679954+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:10.679954+0000","last_peered":"2024-03-07T10:21:10.679954+0000","last_clean":"2024-03-07T10:21:10.679954+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:10.679954+0000","last_undegraded":"2024-03-07T10:21:10.679954+0000","last_fullsized":"2024-03-07T10:21:10.679954+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684730+0000","last_change":"2024-03-07T10:20:58.149838+0000","last_active":"2024-03-07T10:21:10.684730+0000","last_peered":"2024-03-07T10:21:10.684730+0000","last_clean":"2024-03-07T10:21:10.684730+0000","last_became_active":"2024-03-07T10:20:58.149549+0000","last_became_peered":"2024-03-07T10:20:58.149549+0000","last_unstale":"2024-03-07T10:21:10.684730+0000","last_undegraded":"2024-03-07T10:21:10.684730+0000","last_fullsized":"2024-03-07T10:21:10.684730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285569+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:10.285569+0000","last_peered":"2024-03-07T10:21:10.285569+0000","last_clean":"2024-03-07T10:21:10.285569+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:10.285569+0000","last_undegraded":"2024-03-07T10:21:10.285569+0000","last_fullsized":"2024-03-07T10:21:10.285569+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.325987+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:10.325987+0000","last_peered":"2024-03-07T10:21:10.325987+0000","last_clean":"2024-03-07T10:21:10.325987+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:10.325987+0000","last_undegraded":"2024-03-07T10:21:10.325987+0000","last_fullsized":"2024-03-07T10:21:10.325987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684286+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:10.684286+0000","last_peered":"2024-03-07T10:21:10.684286+0000","last_clean":"2024-03-07T10:21:10.684286+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:10.684286+0000","last_undegraded":"2024-03-07T10:21:10.684286+0000","last_fullsized":"2024-03-07T10:21:10.684286+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286334+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:10.286334+0000","last_peered":"2024-03-07T10:21:10.286334+0000","last_clean":"2024-03-07T10:21:10.286334+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:10.286334+0000","last_undegraded":"2024-03-07T10:21:10.286334+0000","last_fullsized":"2024-03-07T10:21:10.286334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684011+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:10.684011+0000","last_peered":"2024-03-07T10:21:10.684011+0000","last_clean":"2024-03-07T10:21:10.684011+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:10.684011+0000","last_undegraded":"2024-03-07T10:21:10.684011+0000","last_fullsized":"2024-03-07T10:21:10.684011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685485+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:10.685485+0000","last_peered":"2024-03-07T10:21:10.685485+0000","last_clean":"2024-03-07T10:21:10.685485+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:10.685485+0000","last_undegraded":"2024-03-07T10:21:10.685485+0000","last_fullsized":"2024-03-07T10:21:10.685485+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683901+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:10.683901+0000","last_peered":"2024-03-07T10:21:10.683901+0000","last_clean":"2024-03-07T10:21:10.683901+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:10.683901+0000","last_undegraded":"2024-03-07T10:21:10.683901+0000","last_fullsized":"2024-03-07T10:21:10.683901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680027+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:10.680027+0000","last_peered":"2024-03-07T10:21:10.680027+0000","last_clean":"2024-03-07T10:21:10.680027+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:10.680027+0000","last_undegraded":"2024-03-07T10:21:10.680027+0000","last_fullsized":"2024-03-07T10:21:10.680027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324794+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:10.324794+0000","last_peered":"2024-03-07T10:21:10.324794+0000","last_clean":"2024-03-07T10:21:10.324794+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:10.324794+0000","last_undegraded":"2024-03-07T10:21:10.324794+0000","last_fullsized":"2024-03-07T10:21:10.324794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.687014+0000","last_change":"2024-03-07T10:20:58.169691+0000","last_active":"2024-03-07T10:21:10.687014+0000","last_peered":"2024-03-07T10:21:10.687014+0000","last_clean":"2024-03-07T10:21:10.687014+0000","last_became_active":"2024-03-07T10:20:58.169331+0000","last_became_peered":"2024-03-07T10:20:58.169331+0000","last_unstale":"2024-03-07T10:21:10.687014+0000","last_undegraded":"2024-03-07T10:21:10.687014+0000","last_fullsized":"2024-03-07T10:21:10.687014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289400+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:10.289400+0000","last_peered":"2024-03-07T10:21:10.289400+0000","last_clean":"2024-03-07T10:21:10.289400+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:10.289400+0000","last_undegraded":"2024-03-07T10:21:10.289400+0000","last_fullsized":"2024-03-07T10:21:10.289400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681886+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:10.681886+0000","last_peered":"2024-03-07T10:21:10.681886+0000","last_clean":"2024-03-07T10:21:10.681886+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:10.681886+0000","last_undegraded":"2024-03-07T10:21:10.681886+0000","last_fullsized":"2024-03-07T10:21:10.681886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684951+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:10.684951+0000","last_peered":"2024-03-07T10:21:10.684951+0000","last_clean":"2024-03-07T10:21:10.684951+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:10.684951+0000","last_undegraded":"2024-03-07T10:21:10.684951+0000","last_fullsized":"2024-03-07T10:21:10.684951+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287337+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:10.287337+0000","last_peered":"2024-03-07T10:21:10.287337+0000","last_clean":"2024-03-07T10:21:10.287337+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:10.287337+0000","last_undegraded":"2024-03-07T10:21:10.287337+0000","last_fullsized":"2024-03-07T10:21:10.287337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684310+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:10.684310+0000","last_peered":"2024-03-07T10:21:10.684310+0000","last_clean":"2024-03-07T10:21:10.684310+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:10.684310+0000","last_undegraded":"2024-03-07T10:21:10.684310+0000","last_fullsized":"2024-03-07T10:21:10.684310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.324787+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:10.324787+0000","last_peered":"2024-03-07T10:21:10.324787+0000","last_clean":"2024-03-07T10:21:10.324787+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:10.324787+0000","last_undegraded":"2024-03-07T10:21:10.324787+0000","last_fullsized":"2024-03-07T10:21:10.324787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684852+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:10.684852+0000","last_peered":"2024-03-07T10:21:10.684852+0000","last_clean":"2024-03-07T10:21:10.684852+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:10.684852+0000","last_undegraded":"2024-03-07T10:21:10.684852+0000","last_fullsized":"2024-03-07T10:21:10.684852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285216+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:10.285216+0000","last_peered":"2024-03-07T10:21:10.285216+0000","last_clean":"2024-03-07T10:21:10.285216+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:10.285216+0000","last_undegraded":"2024-03-07T10:21:10.285216+0000","last_fullsized":"2024-03-07T10:21:10.285216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284392+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:10.284392+0000","last_peered":"2024-03-07T10:21:10.284392+0000","last_clean":"2024-03-07T10:21:10.284392+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:10.284392+0000","last_undegraded":"2024-03-07T10:21:10.284392+0000","last_fullsized":"2024-03-07T10:21:10.284392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683772+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:10.683772+0000","last_peered":"2024-03-07T10:21:10.683772+0000","last_clean":"2024-03-07T10:21:10.683772+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:10.683772+0000","last_undegraded":"2024-03-07T10:21:10.683772+0000","last_fullsized":"2024-03-07T10:21:10.683772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.680958+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:10.680958+0000","last_peered":"2024-03-07T10:21:10.680958+0000","last_clean":"2024-03-07T10:21:10.680958+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:10.680958+0000","last_undegraded":"2024-03-07T10:21:10.680958+0000","last_fullsized":"2024-03-07T10:21:10.680958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286746+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:10.286746+0000","last_peered":"2024-03-07T10:21:10.286746+0000","last_clean":"2024-03-07T10:21:10.286746+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:10.286746+0000","last_undegraded":"2024-03-07T10:21:10.286746+0000","last_fullsized":"2024-03-07T10:21:10.286746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.683414+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:10.683414+0000","last_peered":"2024-03-07T10:21:10.683414+0000","last_clean":"2024-03-07T10:21:10.683414+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:10.683414+0000","last_undegraded":"2024-03-07T10:21:10.683414+0000","last_fullsized":"2024-03-07T10:21:10.683414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287229+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:10.287229+0000","last_peered":"2024-03-07T10:21:10.287229+0000","last_clean":"2024-03-07T10:21:10.287229+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:10.287229+0000","last_undegraded":"2024-03-07T10:21:10.287229+0000","last_fullsized":"2024-03-07T10:21:10.287229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682287+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:10.682287+0000","last_peered":"2024-03-07T10:21:10.682287+0000","last_clean":"2024-03-07T10:21:10.682287+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:10.682287+0000","last_undegraded":"2024-03-07T10:21:10.682287+0000","last_fullsized":"2024-03-07T10:21:10.682287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686299+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:10.686299+0000","last_peered":"2024-03-07T10:21:10.686299+0000","last_clean":"2024-03-07T10:21:10.686299+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:10.686299+0000","last_undegraded":"2024-03-07T10:21:10.686299+0000","last_fullsized":"2024-03-07T10:21:10.686299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.285806+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:10.285806+0000","last_peered":"2024-03-07T10:21:10.285806+0000","last_clean":"2024-03-07T10:21:10.285806+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:10.285806+0000","last_undegraded":"2024-03-07T10:21:10.285806+0000","last_fullsized":"2024-03-07T10:21:10.285806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.283983+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:10.283983+0000","last_peered":"2024-03-07T10:21:10.283983+0000","last_clean":"2024-03-07T10:21:10.283983+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:10.283983+0000","last_undegraded":"2024-03-07T10:21:10.283983+0000","last_fullsized":"2024-03-07T10:21:10.283983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.286880+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:10.286880+0000","last_peered":"2024-03-07T10:21:10.286880+0000","last_clean":"2024-03-07T10:21:10.286880+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:10.286880+0000","last_undegraded":"2024-03-07T10:21:10.286880+0000","last_fullsized":"2024-03-07T10:21:10.286880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682579+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:10.682579+0000","last_peered":"2024-03-07T10:21:10.682579+0000","last_clean":"2024-03-07T10:21:10.682579+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:10.682579+0000","last_undegraded":"2024-03-07T10:21:10.682579+0000","last_fullsized":"2024-03-07T10:21:10.682579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.287145+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:10.287145+0000","last_peered":"2024-03-07T10:21:10.287145+0000","last_clean":"2024-03-07T10:21:10.287145+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:10.287145+0000","last_undegraded":"2024-03-07T10:21:10.287145+0000","last_fullsized":"2024-03-07T10:21:10.287145+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684595+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:10.684595+0000","last_peered":"2024-03-07T10:21:10.684595+0000","last_clean":"2024-03-07T10:21:10.684595+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:10.684595+0000","last_undegraded":"2024-03-07T10:21:10.684595+0000","last_fullsized":"2024-03-07T10:21:10.684595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.685825+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:10.685825+0000","last_peered":"2024-03-07T10:21:10.685825+0000","last_clean":"2024-03-07T10:21:10.685825+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:10.685825+0000","last_undegraded":"2024-03-07T10:21:10.685825+0000","last_fullsized":"2024-03-07T10:21:10.685825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682261+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:10.682261+0000","last_peered":"2024-03-07T10:21:10.682261+0000","last_clean":"2024-03-07T10:21:10.682261+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:10.682261+0000","last_undegraded":"2024-03-07T10:21:10.682261+0000","last_fullsized":"2024-03-07T10:21:10.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.284788+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:10.284788+0000","last_peered":"2024-03-07T10:21:10.284788+0000","last_clean":"2024-03-07T10:21:10.284788+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:10.284788+0000","last_undegraded":"2024-03-07T10:21:10.284788+0000","last_fullsized":"2024-03-07T10:21:10.284788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.684796+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:10.684796+0000","last_peered":"2024-03-07T10:21:10.684796+0000","last_clean":"2024-03-07T10:21:10.684796+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:10.684796+0000","last_undegraded":"2024-03-07T10:21:10.684796+0000","last_fullsized":"2024-03-07T10:21:10.684796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.679707+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:10.679707+0000","last_peered":"2024-03-07T10:21:10.679707+0000","last_clean":"2024-03-07T10:21:10.679707+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:10.679707+0000","last_undegraded":"2024-03-07T10:21:10.679707+0000","last_fullsized":"2024-03-07T10:21:10.679707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.326644+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:10.326644+0000","last_peered":"2024-03-07T10:21:10.326644+0000","last_clean":"2024-03-07T10:21:10.326644+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:10.326644+0000","last_undegraded":"2024-03-07T10:21:10.326644+0000","last_fullsized":"2024-03-07T10:21:10.326644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.681923+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:10.681923+0000","last_peered":"2024-03-07T10:21:10.681923+0000","last_clean":"2024-03-07T10:21:10.681923+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:10.681923+0000","last_undegraded":"2024-03-07T10:21:10.681923+0000","last_fullsized":"2024-03-07T10:21:10.681923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.289526+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:10.289526+0000","last_peered":"2024-03-07T10:21:10.289526+0000","last_clean":"2024-03-07T10:21:10.289526+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:10.289526+0000","last_undegraded":"2024-03-07T10:21:10.289526+0000","last_fullsized":"2024-03-07T10:21:10.289526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.682347+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:10.682347+0000","last_peered":"2024-03-07T10:21:10.682347+0000","last_clean":"2024-03-07T10:21:10.682347+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:10.682347+0000","last_undegraded":"2024-03-07T10:21:10.682347+0000","last_fullsized":"2024-03-07T10:21:10.682347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-03-07T10:21:10.686295+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:10.686295+0000","last_peered":"2024-03-07T10:21:10.686295+0000","last_clean":"2024-03-07T10:21:10.686295+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:10.686295+0000","last_undegraded":"2024-03-07T10:21:10.686295+0000","last_fullsized":"2024-03-07T10:21:10.686295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":690301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":101489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":99491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":102507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":101055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":690267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:21.090 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-07T10:21:21.090 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-07T10:21:21.090 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-07T10:21:21.090 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-07T10:21:21.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.340+0000 7fb4b9600640 1 Processor -- start 2024-03-07T10:21:21.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.340+0000 7fb4b9600640 1 -- start start 2024-03-07T10:21:21.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4b40be5d0 0x7fb4b40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b40722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b40c79f0 con 0x7fb4b4158430 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b9600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b40736e0 con 0x7fb4b40be5d0 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40c7c90 con 0x7fb4b40c5e00 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4b40be5d0 0x7fb4b40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4b40be5d0 0x7fb4b40c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59318/0 (socket says 172.21.15.194:59318) 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 -- 172.21.15.194:0/3195091330 learned_addr learned my addr 172.21.15.194:0/3195091330 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4b8c00640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b40722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 -- 172.21.15.194:0/3195091330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 msgr2=0x7fb4b40722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b40722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.342+0000 7fb4abe00640 1 -- 172.21.15.194:0/3195091330 >> v1:172.21.15.196:6789/0 conn(0x7fb4b4158430 legacy=0x7fb4b4155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:21.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.343+0000 7fb4abe00640 1 -- 172.21.15.194:0/3195091330 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40c7f70 con 0x7fb4b40be5d0 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4abe00640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c58c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009870 tx=0x7fb49c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f763fb772c98a6f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b3400640 1 -- 172.21.15.194:0/3195091330 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c035020 con 0x7fb4b40be5d0 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b3400640 1 -- 172.21.15.194:0/3195091330 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c031640 con 0x7fb4b40be5d0 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b3400640 1 -- 172.21.15.194:0/3195091330 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c02d040 con 0x7fb4b40be5d0 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b9600640 1 -- 172.21.15.194:0/3195091330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 msgr2=0x7fb4b40c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b9600640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c58c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009870 tx=0x7fb49c02b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.344+0000 7fb4b9600640 1 -- 172.21.15.194:0/3195091330 shutdown_connections 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.345+0000 7fb4b9600640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b40722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.345+0000 7fb4b9600640 1 --2- 172.21.15.194:0/3195091330 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c58c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.345+0000 7fb4b9600640 1 -- 172.21.15.194:0/3195091330 >> 172.21.15.194:0/3195091330 conn(0x7fb4b40acc90 msgr2=0x7fb4b40ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:21.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.345+0000 7fb4b9600640 1 -- 172.21.15.194:0/3195091330 shutdown_connections 2024-03-07T10:21:21.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.345+0000 7fb4b9600640 1 -- 172.21.15.194:0/3195091330 wait complete. 2024-03-07T10:21:21.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.346+0000 7fb4b9600640 1 Processor -- start 2024-03-07T10:21:21.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.346+0000 7fb4b9600640 1 -- start start 2024-03-07T10:21:21.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b41ee640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4b4158430 0x7fb4b40caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40727e0 con 0x7fb4b40be5d0 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4158810 con 0x7fb4b4158430 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4072960 con 0x7fb4b40c5e00 2024-03-07T10:21:21.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59328/0 (socket says 172.21.15.194:59328) 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.347+0000 7fb4b3e00640 1 -- 172.21.15.194:0/1246380761 learned_addr learned my addr 172.21.15.194:0/1246380761 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4abe00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b41ee640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 -- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 msgr2=0x7fb4b41ee640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b41ee640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 -- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4b4158430 msgr2=0x7fb4b40caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4b4158430 0x7fb4b40caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 -- 172.21.15.194:0/1246380761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40c2540 con 0x7fb4b40be5d0 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b3e00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c340 tx=0x7fb4a400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4017070 con 0x7fb4b40be5d0 2024-03-07T10:21:21.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a40052d0 con 0x7fb4b40be5d0 2024-03-07T10:21:21.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a4003850 con 0x7fb4b40be5d0 2024-03-07T10:21:21.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b40cb990 con 0x7fb4b40be5d0 2024-03-07T10:21:21.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.348+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b41eeb80 con 0x7fb4b40be5d0 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.350+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b4075600 con 0x7fb4b40be5d0 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.350+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fb4a401a070 con 0x7fb4b40be5d0 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.351+0000 7fb4b0c00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 0x7fb49006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.351+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fb4a4089850 con 0x7fb4b40be5d0 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.352+0000 7fb4abe00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 0x7fb49006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.353+0000 7fb4abe00640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 0x7fb49006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb49c036000 tx=0x7fb49c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.355+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fb4a4058390 con 0x7fb4b40be5d0 2024-03-07T10:21:21.700 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.699+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb4b40732d0 con 0x7fb4b40be5d0 2024-03-07T10:21:21.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.699+0000 7fb4b0c00640 1 -- 172.21.15.194:0/1246380761 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb4a4057c90 con 0x7fb4b40be5d0 2024-03-07T10:21:21.701 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:21.701 INFO:teuthology.orchestra.run.smithi194.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-07T10:21:21.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 msgr2=0x7fb49006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 0x7fb49006d990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb49c036000 tx=0x7fb49c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:21.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 msgr2=0x7fb4b40c4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.703 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb4a400c340 tx=0x7fb4a400c800 comp rx=0 tx=0).stop 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 shutdown_connections 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fb49006b4d0 0x7fb49006d990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fb4b4158430 0x7fb4b40caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fb4b40c5e00 0x7fb4b41ee640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 --2- 172.21.15.194:0/1246380761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4b40be5d0 0x7fb4b40c4c30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 >> 172.21.15.194:0/1246380761 conn(0x7fb4b40acc90 msgr2=0x7fb4b40aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 shutdown_connections 2024-03-07T10:21:21.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.702+0000 7fb4b9600640 1 -- 172.21.15.194:0/1246380761 wait complete. 2024-03-07T10:21:21.721 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-07T10:21:21.722 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:21.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.920+0000 7f61f4e00640 1 Processor -- start 2024-03-07T10:21:21.921 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.920+0000 7f61f4e00640 1 -- start start 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.921+0000 7f61f4e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61f0150b70 0x7f61f00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.921+0000 7f61f4e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0156c20 0x7f61f006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61f4e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f0153980 con 0x7f61f00a9a10 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61f4e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f006e550 con 0x7f61f0150b70 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61f4e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0153c60 con 0x7f61f0156c20 2024-03-07T10:21:21.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61f0150b70 0x7f61f00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61f0150b70 0x7f61f00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59340/0 (socket says 172.21.15.194:59340) 2024-03-07T10:21:21.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ee800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f61f00a9a10 0x7f61f006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43786/0 (socket says 172.21.15.194:43786) 2024-03-07T10:21:21.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 -- 172.21.15.194:0/1216663069 learned_addr learned my addr 172.21.15.194:0/1216663069 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61e5400640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0156c20 0x7f61f006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 -- 172.21.15.194:0/1216663069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0156c20 msgr2=0x7f61f006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0156c20 0x7f61f006d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 -- 172.21.15.194:0/1216663069 >> v1:172.21.15.194:6789/0 conn(0x7f61f00a9a10 legacy=0x7f61f006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ede00640 1 -- 172.21.15.194:0/1216663069 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0153f40 con 0x7f61f0150b70 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.922+0000 7f61ed400640 1 -- 172.21.15.194:0/1216663069 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916457154 0 0) 0x7f61f0153980 con 0x7f61f00a9a10 2024-03-07T10:21:21.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.923+0000 7f61ede00640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f0150b70 0x7f61f00a94d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009e50 tx=0x7f61e002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1a1dd2b2d202a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61ed400640 1 -- 172.21.15.194:0/1216663069 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e002ca70 con 0x7f61f0150b70 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61ed400640 1 -- 172.21.15.194:0/1216663069 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e002cc10 con 0x7f61f0150b70 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61ed400640 1 -- 172.21.15.194:0/1216663069 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00343f0 con 0x7f61f0150b70 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 -- 172.21.15.194:0/1216663069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f0150b70 msgr2=0x7f61f00a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f0150b70 0x7f61f00a94d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009e50 tx=0x7f61e002bed0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 -- 172.21.15.194:0/1216663069 shutdown_connections 2024-03-07T10:21:21.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0156c20 0x7f61f006d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 --2- 172.21.15.194:0/1216663069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f0150b70 0x7f61f00a94d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.924+0000 7f61f4e00640 1 -- 172.21.15.194:0/1216663069 >> 172.21.15.194:0/1216663069 conn(0x7f61f006b840 msgr2=0x7f61f00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:21.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.925+0000 7f61f4e00640 1 -- 172.21.15.194:0/1216663069 shutdown_connections 2024-03-07T10:21:21.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.925+0000 7f61f4e00640 1 -- 172.21.15.194:0/1216663069 wait complete. 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.927+0000 7f61f4e00640 1 Processor -- start 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.927+0000 7f61f4e00640 1 -- start start 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0150b70 0x7f61f01556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 0x7f61f01ebaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0153630 con 0x7f61f00a9a10 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c7a30 con 0x7f61f0156c20 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61f4e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00ac460 con 0x7f61f0150b70 2024-03-07T10:21:21.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59348/0 (socket says 172.21.15.194:59348) 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 -- 172.21.15.194:0/927012338 learned_addr learned my addr 172.21.15.194:0/927012338 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61e5400640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0150b70 0x7f61f01556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ee800640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 0x7f61f01ebaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 -- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0150b70 msgr2=0x7f61f01556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0150b70 0x7f61f01556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 -- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 msgr2=0x7f61f01ebaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 0x7f61f01ebaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ede00640 1 -- 172.21.15.194:0/927012338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0148c10 con 0x7f61f00a9a10 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.928+0000 7f61ee800640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 0x7f61f01ebaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61ede00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009e50 tx=0x7f61e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0043030 con 0x7f61f00a9a10 2024-03-07T10:21:21.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e003e450 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f0148ed0 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0009510 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.929+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f0155be0 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.930+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00c1840 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.931+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f61e0046070 con 0x7f61f00a9a10 2024-03-07T10:21:21.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.932+0000 7f61e6a00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 0x7f61cc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:21.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.932+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f61e00acae0 con 0x7f61f00a9a10 2024-03-07T10:21:21.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.933+0000 7f61e5400640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 0x7f61cc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:21.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.934+0000 7f61e5400640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 0x7f61cc06d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:21.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:21.936+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f61e004d070 con 0x7f61f00a9a10 2024-03-07T10:21:22.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.126+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61f0068170 con 0x7f61f00a9a10 2024-03-07T10:21:22.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.128+0000 7f61e6a00640 1 -- 172.21.15.194:0/927012338 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7f61e00333a0 con 0x7f61f00a9a10 2024-03-07T10:21:22.130 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:22.130 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 msgr2=0x7f61cc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 0x7f61cc06d990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f61d8006fd0 tx=0x7f61d8008040 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 msgr2=0x7f61f01ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009e50 tx=0x7f61e0004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 shutdown_connections 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61cc06b4d0 0x7f61cc06d990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61f0156c20 0x7f61f01ebaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61f0150b70 0x7f61f01556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 --2- 172.21.15.194:0/927012338 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61f00a9a10 0x7f61f01ef360 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 >> 172.21.15.194:0/927012338 conn(0x7f61f006b840 msgr2=0x7f61f014cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:22.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 shutdown_connections 2024-03-07T10:21:22.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.131+0000 7f61f4e00640 1 -- 172.21.15.194:0/927012338 wait complete. 2024-03-07T10:21:22.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:22.151 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:22.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.344+0000 7f54aa200640 1 Processor -- start 2024-03-07T10:21:22.346 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.344+0000 7f54aa200640 1 -- start start 2024-03-07T10:21:22.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.346+0000 7f54aa200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f54a414d6e0 0x7f54a406e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.346+0000 7f54aa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 0x7f54a40a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.346+0000 7f54aa200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a4153760 con 0x7f54a40ab7c0 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.346+0000 7f54aa200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a406daf0 con 0x7f54a414d6e0 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.346+0000 7f54aa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a406dd40 con 0x7f54a40ab340 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 0x7f54a40a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a3e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f54a40ab7c0 0x7f54a4156b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49812/0 (socket says 172.21.15.194:49812) 2024-03-07T10:21:22.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a3e00640 1 -- 172.21.15.194:0/1646990490 learned_addr learned my addr 172.21.15.194:0/1646990490 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a3400640 1 --2- 172.21.15.194:0/1646990490 >> v2:172.21.15.196:3300/0 conn(0x7f54a414d6e0 0x7f54a406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2000640 1 -- 172.21.15.194:0/1646990490 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812101753 0 0) 0x7f54a4153760 con 0x7f54a40ab7c0 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2000640 1 -- 172.21.15.194:0/1646990490 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5488003520 con 0x7f54a40ab7c0 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2a00640 1 -- 172.21.15.194:0/1646990490 >> v2:172.21.15.196:3300/0 conn(0x7f54a414d6e0 msgr2=0x7f54a406e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2a00640 1 --2- 172.21.15.194:0/1646990490 >> v2:172.21.15.196:3300/0 conn(0x7f54a414d6e0 0x7f54a406e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2a00640 1 -- 172.21.15.194:0/1646990490 >> v1:172.21.15.196:6789/0 conn(0x7f54a40ab7c0 legacy=0x7f54a4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.347+0000 7f54a2a00640 1 -- 172.21.15.194:0/1646990490 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a406e020 con 0x7f54a40ab340 2024-03-07T10:21:22.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.349+0000 7f54a2a00640 1 --2- 172.21.15.194:0/1646990490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 0x7f54a40a94d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54a406dc70 tx=0x7f548c02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9d862575316c2d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54a2000640 1 -- 172.21.15.194:0/1646990490 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031770 con 0x7f54a40ab340 2024-03-07T10:21:22.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54a2000640 1 -- 172.21.15.194:0/1646990490 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c037070 con 0x7f54a40ab340 2024-03-07T10:21:22.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54a2000640 1 -- 172.21.15.194:0/1646990490 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031b10 con 0x7f54a40ab340 2024-03-07T10:21:22.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 -- 172.21.15.194:0/1646990490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 msgr2=0x7f54a40a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 --2- 172.21.15.194:0/1646990490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 0x7f54a40a94d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54a406dc70 tx=0x7f548c02b810 comp rx=0 tx=0).stop 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 -- 172.21.15.194:0/1646990490 shutdown_connections 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 --2- 172.21.15.194:0/1646990490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab340 0x7f54a40a94d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 --2- 172.21.15.194:0/1646990490 >> v2:172.21.15.196:3300/0 conn(0x7f54a414d6e0 0x7f54a406e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.350+0000 7f54aa200640 1 -- 172.21.15.194:0/1646990490 >> 172.21.15.194:0/1646990490 conn(0x7f54a406b860 msgr2=0x7f54a40c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.351+0000 7f54aa200640 1 -- 172.21.15.194:0/1646990490 shutdown_connections 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.351+0000 7f54aa200640 1 -- 172.21.15.194:0/1646990490 wait complete. 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.352+0000 7f54aa200640 1 Processor -- start 2024-03-07T10:21:22.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.352+0000 7f54aa200640 1 -- start start 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab7c0 0x7f54a4148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a414d6e0 0x7f54a41e9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40aae10 con 0x7f54a40ab340 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c79c0 con 0x7f54a414d6e0 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54aa200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a406ce70 con 0x7f54a40ab7c0 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59352/0 (socket says 172.21.15.194:59352) 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.353+0000 7f54a3400640 1 -- 172.21.15.194:0/2872033907 learned_addr learned my addr 172.21.15.194:0/2872033907 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:22.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a2a00640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab7c0 0x7f54a4148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3e00640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a414d6e0 0x7f54a41e9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 -- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab7c0 msgr2=0x7f54a4148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab7c0 0x7f54a4148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 -- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a414d6e0 msgr2=0x7f54a41e9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a414d6e0 0x7f54a41e9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 -- 172.21.15.194:0/2872033907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a41e94a0 con 0x7f54a40ab340 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54a3400640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f549c009db0 tx=0x7f549c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c018020 con 0x7f54a40ab340 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c014480 con 0x7f54a40ab340 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c014850 con 0x7f54a40ab340 2024-03-07T10:21:22.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a41dce90 con 0x7f54a40ab340 2024-03-07T10:21:22.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.354+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a41ed4c0 con 0x7f54a40ab340 2024-03-07T10:21:22.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.356+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4073050 con 0x7f54a40ab340 2024-03-07T10:21:22.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.357+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f549c005d10 con 0x7f54a40ab340 2024-03-07T10:21:22.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.358+0000 7f549b400640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 0x7f548006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.358+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f549c08b070 con 0x7f54a40ab340 2024-03-07T10:21:22.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.358+0000 7f54a2a00640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 0x7f548006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.360+0000 7f54a2a00640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 0x7f548006d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f548c036000 tx=0x7f548c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.367+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f54a4073050 con 0x7f54a40ab340 2024-03-07T10:21:22.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.561+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54a40c6d70 con 0x7f54a40ab340 2024-03-07T10:21:22.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.562+0000 7f549b400640 1 -- 172.21.15.194:0/2872033907 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54a40c6d70 con 0x7f54a40ab340 2024-03-07T10:21:22.564 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 msgr2=0x7f548006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 0x7f548006d9c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f548c036000 tx=0x7f548c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 msgr2=0x7f54a41ea910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f549c009db0 tx=0x7f549c00c490 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 shutdown_connections 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f548006b500 0x7f548006d9c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f54a414d6e0 0x7f54a41e9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f54a40ab7c0 0x7f54a4148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 --2- 172.21.15.194:0/2872033907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54a40ab340 0x7f54a41ea910 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 >> 172.21.15.194:0/2872033907 conn(0x7f54a406b860 msgr2=0x7f54a406e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 shutdown_connections 2024-03-07T10:21:22.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.565+0000 7f54aa200640 1 -- 172.21.15.194:0/2872033907 wait complete. 2024-03-07T10:21:22.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:22.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.802+0000 7fa2f9600640 1 Processor -- start 2024-03-07T10:21:22.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.803+0000 7fa2f9600640 1 -- start start 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2f406fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40c7820 con 0x7fa2f4156660 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f9600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f40c7560 con 0x7fa2f40701d0 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40aab70 con 0x7fa2f40c6110 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f2a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa2f4156660 0x7fa2f40c6e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43796/0 (socket says 172.21.15.194:43796) 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.805+0000 7fa2f2a00640 1 -- 172.21.15.194:0/833022816 learned_addr learned my addr 172.21.15.194:0/833022816 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:22.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2ebe00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2f406fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769721937 0 0) 0x7fa2f40c7820 con 0x7fa2f4156660 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d8003520 con 0x7fa2f4156660 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098780461 0 0) 0x7fa2d8003520 con 0x7fa2f4156660 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 msgr2=0x7fa2f406fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2f406fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 >> v1:172.21.15.196:6789/0 conn(0x7fa2f40701d0 legacy=0x7fa2f40ab000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f40c7ac0 con 0x7fa2f4156660 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fa2e4001690 con 0x7fa2f4156660 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 >> v1:172.21.15.194:6789/0 conn(0x7fa2f4156660 legacy=0x7fa2f40c6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d80039e0 0x7fa2d8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.806+0000 7fa2f2000640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d8004800 0x7fa2d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2000640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2d8005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40aab70 con 0x7fa2d80039e0 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bb50 con 0x7fa2d8004800 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bd50 con 0x7fa2f40c6110 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d80039e0 0x7fa2d8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f3400640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2d8005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 -- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 msgr2=0x7fa2d8005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2d8005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 -- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d8004800 msgr2=0x7fa2d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2ebe00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d8004800 0x7fa2d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d8004800 0x7fa2d8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f2a00640 1 -- 172.21.15.194:0/833022816 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8003520 con 0x7fa2d80039e0 2024-03-07T10:21:22.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.807+0000 7fa2f3400640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f40c6110 0x7fa2d8005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:22.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.808+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d80039e0 0x7fa2d8003e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c160 tx=0x7fa2d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3daf38367ea28b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.808+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4007c60 con 0x7fa2d80039e0 2024-03-07T10:21:22.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e4030070 con 0x7fa2d80039e0 2024-03-07T10:21:22.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f2000640 1 -- 172.21.15.194:0/833022816 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4005d10 con 0x7fa2d80039e0 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 -- 172.21.15.194:0/833022816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d80039e0 msgr2=0x7fa2d8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 --2- 172.21.15.194:0/833022816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2d80039e0 0x7fa2d8003e00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c160 tx=0x7fa2d8005830 comp rx=0 tx=0).stop 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f3400640 1 -- 172.21.15.194:0/833022816 reap_dead start 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 -- 172.21.15.194:0/833022816 shutdown_connections 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 -- 172.21.15.194:0/833022816 >> 172.21.15.194:0/833022816 conn(0x7fa2f406eca0 msgr2=0x7fa2f406f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 -- 172.21.15.194:0/833022816 shutdown_connections 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.809+0000 7fa2f9600640 1 -- 172.21.15.194:0/833022816 wait complete. 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.811+0000 7fa2f9600640 1 Processor -- start 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.811+0000 7fa2f9600640 1 -- start start 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 0x7fa2f40ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f4157580 0x7fa2f4153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c41a0 con 0x7fa2f41ec070 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c8080 con 0x7fa2d80039e0 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f9600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f40c4320 con 0x7fa2f4157580 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59372/0 (socket says 172.21.15.194:59372) 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f3400640 1 -- 172.21.15.194:0/3701060646 learned_addr learned my addr 172.21.15.194:0/3701060646 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2ebe00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f4157580 0x7fa2f4153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.812+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 0x7fa2f40ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 -- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f4157580 msgr2=0x7fa2f4153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f4157580 0x7fa2f4153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 -- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 msgr2=0x7fa2f40ad120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:22.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 0x7fa2f40ad120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 -- 172.21.15.194:0/3701060646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f4156be0 con 0x7fa2f41ec070 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 0x7fa2f40ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f3400640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40abd00 tx=0x7fa2ec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec006b50 con 0x7fa2f41ec070 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec006d10 con 0x7fa2f41ec070 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec003bb0 con 0x7fa2f41ec070 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f4156ec0 con 0x7fa2f41ec070 2024-03-07T10:21:22.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.813+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f40ad660 con 0x7fa2f41ec070 2024-03-07T10:21:22.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.814+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f4070800 con 0x7fa2f41ec070 2024-03-07T10:21:22.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.815+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa2ec01a020 con 0x7fa2f41ec070 2024-03-07T10:21:22.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.816+0000 7fa2eaa00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:22.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.816+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa2ec089ce0 con 0x7fa2f41ec070 2024-03-07T10:21:22.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.817+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:22.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.818+0000 7fa2f2a00640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c160 tx=0x7fa2e4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:22.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:22.820+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa2f4070800 con 0x7fa2f41ec070 2024-03-07T10:21:23.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.019+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2f40a9070 con 0x7fa2f41ec070 2024-03-07T10:21:23.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.019+0000 7fa2eaa00640 1 -- 172.21.15.194:0/3701060646 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7fa2f40a9070 con 0x7fa2f41ec070 2024-03-07T10:21:23.021 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 msgr2=0x7fa2d006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 0x7fa2d006d990 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400c160 tx=0x7fa2e4009030 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 msgr2=0x7fa2f4150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40abd00 tx=0x7fa2ec00dc00 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 shutdown_connections 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa2d006b4d0 0x7fa2d006d990 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2f41ec070 0x7fa2f4150fc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa2f4157580 0x7fa2f4153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 --2- 172.21.15.194:0/3701060646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa2d80039e0 0x7fa2f40ad120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 >> 172.21.15.194:0/3701060646 conn(0x7fa2f406eca0 msgr2=0x7fa2f4155850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 shutdown_connections 2024-03-07T10:21:23.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.022+0000 7fa2f9600640 1 -- 172.21.15.194:0/3701060646 wait complete. 2024-03-07T10:21:23.043 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:23.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.246+0000 7ff69fc00640 1 Processor -- start 2024-03-07T10:21:23.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.246+0000 7ff69fc00640 1 -- start start 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.248+0000 7ff69fc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff6980cb7a0 0x7ff6981560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.248+0000 7ff69fc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff698153180 con 0x7ff698152da0 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.248+0000 7ff69fc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff698158f70 con 0x7ff6980cb380 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.248+0000 7ff69fc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6980cbc10 con 0x7ff6980cb7a0 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff69d200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff698152da0 0x7ff6980c8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43800/0 (socket says 172.21.15.194:43800) 2024-03-07T10:21:23.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff69d200640 1 -- 172.21.15.194:0/1807542323 learned_addr learned my addr 172.21.15.194:0/1807542323 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728021797 0 0) 0x7ff698153180 con 0x7ff698152da0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff680003520 con 0x7ff698152da0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff69dc00640 1 --2- 172.21.15.194:0/1807542323 >> v2:172.21.15.196:3300/0 conn(0x7ff6980cb7a0 0x7ff6981560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1061903773 0 0) 0x7ff680003520 con 0x7ff698152da0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 >> v2:172.21.15.196:3300/0 conn(0x7ff6980cb7a0 msgr2=0x7ff6981560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 --2- 172.21.15.194:0/1807542323 >> v2:172.21.15.196:3300/0 conn(0x7ff6980cb7a0 0x7ff6981560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 >> v1:172.21.15.196:6789/0 conn(0x7ff6980cb380 legacy=0x7ff698155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff698159250 con 0x7ff698152da0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7ff68c001670 con 0x7ff698152da0 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 >> v1:172.21.15.194:6789/0 conn(0x7ff698152da0 legacy=0x7ff6980c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff680003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff680004800 0x7ff680004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6800051c0 0x7ff68000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980cbc10 con 0x7ff6800039b0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff68000c0f0 con 0x7ff680004800 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.249+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68000c2f0 con 0x7ff6800051c0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff680003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff697e00640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff680004800 0x7ff680004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 -- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6800051c0 msgr2=0x7ff68000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6800051c0 0x7ff68000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 -- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff680004800 msgr2=0x7ff680004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff680004800 0x7ff680004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69dc00640 1 -- 172.21.15.194:0/1807542323 reap_dead start 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff69d200640 1 -- 172.21.15.194:0/1807542323 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680003520 con 0x7ff6800039b0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.250+0000 7ff697e00640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff680004800 0x7ff680004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.251+0000 7ff69d200640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff680003db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c210 tx=0x7ff680005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a3060d0539c118 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.251+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c007d10 con 0x7ff6800039b0 2024-03-07T10:21:23.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.251+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c030070 con 0x7ff6800039b0 2024-03-07T10:21:23.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.251+0000 7ff697400640 1 -- 172.21.15.194:0/1807542323 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c005d90 con 0x7ff6800039b0 2024-03-07T10:21:23.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 -- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 msgr2=0x7ff680003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff680003db0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c210 tx=0x7ff680005830 comp rx=0 tx=0).stop 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 -- 172.21.15.194:0/1807542323 shutdown_connections 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 --2- 172.21.15.194:0/1807542323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff680003db0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 -- 172.21.15.194:0/1807542323 >> 172.21.15.194:0/1807542323 conn(0x7ff698066f70 msgr2=0x7ff698067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 -- 172.21.15.194:0/1807542323 shutdown_connections 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.252+0000 7ff69fc00640 1 -- 172.21.15.194:0/1807542323 wait complete. 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.254+0000 7ff69fc00640 1 Processor -- start 2024-03-07T10:21:23.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.254+0000 7ff69fc00640 1 -- start start 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 0x7ff6981ec810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 0x7ff6980bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980be8c0 con 0x7ff6800039b0 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff698159810 con 0x7ff6981ecd50 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69fc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6980c8f10 con 0x7ff6981eec70 2024-03-07T10:21:23.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59388/0 (socket says 172.21.15.194:59388) 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 -- 172.21.15.194:0/2329499759 learned_addr learned my addr 172.21.15.194:0/2329499759 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff697e00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 0x7ff6981ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69dc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 0x7ff6980bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 -- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 msgr2=0x7ff6981ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 0x7ff6981ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 -- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 msgr2=0x7ff6980bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 0x7ff6980bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69d200640 1 -- 172.21.15.194:0/2329499759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6980c0e20 con 0x7ff6800039b0 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff69dc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 0x7ff6980bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.255+0000 7ff697e00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 0x7ff6981ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff69d200640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c300 tx=0x7ff6980adc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c045070 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0049f0 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c001c50 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6981ef0f0 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.256+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6980c1370 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.257+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff698068170 con 0x7ff6800039b0 2024-03-07T10:21:23.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.259+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff68c007070 con 0x7ff6800039b0 2024-03-07T10:21:23.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.260+0000 7ff694c00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 0x7ff67806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.260+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff68c0ab0f0 con 0x7ff6800039b0 2024-03-07T10:21:23.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.260+0000 7ff697e00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 0x7ff67806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.261+0000 7ff697e00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 0x7ff67806d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff684007fd0 tx=0x7ff684009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.265+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff68c079680 con 0x7ff6800039b0 2024-03-07T10:21:23.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.504+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7ff69806d5a0 con 0x7ff6800039b0 2024-03-07T10:21:23.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.504+0000 7ff694c00640 1 -- 172.21.15.194:0/2329499759 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7ff68c07d720 con 0x7ff6800039b0 2024-03-07T10:21:23.506 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:23.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.506+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 msgr2=0x7ff67806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.506+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 0x7ff67806d9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff684007fd0 tx=0x7ff684009040 comp rx=0 tx=0).stop 2024-03-07T10:21:23.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 msgr2=0x7ff6981ee730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c300 tx=0x7ff6980adc20 comp rx=0 tx=0).stop 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 shutdown_connections 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff67806b500 0x7ff67806d9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff6981ecd50 0x7ff6980bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff6981eec70 0x7ff6981ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 --2- 172.21.15.194:0/2329499759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6800039b0 0x7ff6981ee730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 >> 172.21.15.194:0/2329499759 conn(0x7ff698066f70 msgr2=0x7ff6981518e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 shutdown_connections 2024-03-07T10:21:23.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.507+0000 7ff69fc00640 1 -- 172.21.15.194:0/2329499759 wait complete. 2024-03-07T10:21:23.526 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:23.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.730+0000 7f5d1d200640 1 Processor -- start 2024-03-07T10:21:23.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.730+0000 7f5d1d200640 1 -- start start 2024-03-07T10:21:23.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d1d200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5d18153280 0x7f5d18156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d1d200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d180a5f50 0x7f5d180a8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d1d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d180c3160 con 0x7f5d180a8b60 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d1d200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180c33d0 con 0x7f5d180a5f50 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d1d200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180c36b0 con 0x7f5d18153280 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d17e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5d180a8b60 0x7f5d180c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43810/0 (socket says 172.21.15.194:43810) 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d0ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5d180a5f50 0x7f5d180a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d17e00640 1 -- 172.21.15.194:0/1529913720 learned_addr learned my addr 172.21.15.194:0/1529913720 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.732+0000 7f5d17400640 1 --2- 172.21.15.194:0/1529913720 >> v2:172.21.15.196:3300/0 conn(0x7f5d18153280 0x7f5d18156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.735 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.733+0000 7f5d0ea00640 1 -- 172.21.15.194:0/1529913720 >> v2:172.21.15.196:3300/0 conn(0x7f5d18153280 msgr2=0x7f5d18156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:23.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.733+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/1529913720 >> v2:172.21.15.196:3300/0 conn(0x7f5d18153280 0x7f5d18156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.733+0000 7f5d0ea00640 1 -- 172.21.15.194:0/1529913720 >> v1:172.21.15.194:6789/0 conn(0x7f5d180a8b60 legacy=0x7f5d180c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.733+0000 7f5d0ea00640 1 -- 172.21.15.194:0/1529913720 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180c3990 con 0x7f5d180a5f50 2024-03-07T10:21:23.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.733+0000 7f5d16a00640 1 -- 172.21.15.194:0/1529913720 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052904959 0 0) 0x7f5d180c3160 con 0x7f5d180a8b60 2024-03-07T10:21:23.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.734+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/1529913720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a8620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c45a0 tx=0x7f5d0002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ddc9dc8e6a872c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.734+0000 7f5d16a00640 1 -- 172.21.15.194:0/1529913720 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000315a0 con 0x7f5d180a5f50 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.734+0000 7f5d16a00640 1 -- 172.21.15.194:0/1529913720 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d00037070 con 0x7f5d180a5f50 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.734+0000 7f5d16a00640 1 -- 172.21.15.194:0/1529913720 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00031960 con 0x7f5d180a5f50 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 -- 172.21.15.194:0/1529913720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 msgr2=0x7f5d180a8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 --2- 172.21.15.194:0/1529913720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a8620 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c45a0 tx=0x7f5d0002b840 comp rx=0 tx=0).stop 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 -- 172.21.15.194:0/1529913720 shutdown_connections 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 --2- 172.21.15.194:0/1529913720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a8620 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 --2- 172.21.15.194:0/1529913720 >> v2:172.21.15.196:3300/0 conn(0x7f5d18153280 0x7f5d18156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 -- 172.21.15.194:0/1529913720 >> 172.21.15.194:0/1529913720 conn(0x7f5d1806cd60 msgr2=0x7f5d1806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 -- 172.21.15.194:0/1529913720 shutdown_connections 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.735+0000 7f5d1d200640 1 -- 172.21.15.194:0/1529913720 wait complete. 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.736+0000 7f5d1d200640 1 Processor -- start 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 -- start start 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 0x7f5d180a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d18153280 0x7f5d18149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d18153660 con 0x7f5d180a5f50 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180c3f50 con 0x7f5d18153280 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.737+0000 7f5d1d200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180c1b10 con 0x7f5d180a8b60 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59414/0 (socket says 172.21.15.194:59414) 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 -- 172.21.15.194:0/2141303232 learned_addr learned my addr 172.21.15.194:0/2141303232 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 0x7f5d180a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.745 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17e00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d18153280 0x7f5d18149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 -- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 msgr2=0x7f5d180a73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 0x7f5d180a73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 -- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d18153280 msgr2=0x7f5d18149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d18153280 0x7f5d18149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 -- 172.21.15.194:0/2141303232 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180a87f0 con 0x7f5d180a5f50 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 0x7f5d180a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:23.746 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.738+0000 7f5d17400640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e870 tx=0x7f5d0800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.739+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08017070 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.739+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0800c940 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.739+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800cd30 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.739+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d181463e0 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.739+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d181469a0 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.740+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d180c5600 con 0x7f5d180a5f50 2024-03-07T10:21:23.747 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.741+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5d0801a070 con 0x7f5d180a5f50 2024-03-07T10:21:23.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.742+0000 7f5d0fe00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 0x7f5cf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:23.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.742+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5d0808a360 con 0x7f5d180a5f50 2024-03-07T10:21:23.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.742+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 0x7f5cf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:23.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.744+0000 7f5d0ea00640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 0x7f5cf406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d00036000 tx=0x7f5d00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:23.749 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.746+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5d180c5600 con 0x7f5d180a5f50 2024-03-07T10:21:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.940+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d18075600 con 0x7f5d180a5f50 2024-03-07T10:21:23.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.941+0000 7f5d0fe00640 1 -- 172.21.15.194:0/2141303232 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f5d08058f40 con 0x7f5d180a5f50 2024-03-07T10:21:23.942 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 msgr2=0x7f5cf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 0x7f5cf406d990 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5d00036000 tx=0x7f5d00008030 comp rx=0 tx=0).stop 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 msgr2=0x7f5d180a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800e870 tx=0x7f5d0800ed30 comp rx=0 tx=0).stop 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 shutdown_connections 2024-03-07T10:21:23.945 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5cf406b4d0 0x7f5cf406d990 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5d18153280 0x7f5d18149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5d180a8b60 0x7f5d180a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 --2- 172.21.15.194:0/2141303232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5d180a5f50 0x7f5d180a6e60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.943+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 >> 172.21.15.194:0/2141303232 conn(0x7f5d1806cd60 msgr2=0x7f5d180c1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.944+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 shutdown_connections 2024-03-07T10:21:23.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:23.944+0000 7f5d1d200640 1 -- 172.21.15.194:0/2141303232 wait complete. 2024-03-07T10:21:23.964 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:24.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.165+0000 7f7d49800640 1 Processor -- start 2024-03-07T10:21:24.167 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.165+0000 7f7d49800640 1 -- start start 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.167+0000 7f7d49800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7d44155cc0 0x7f7d441560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.167+0000 7f7d49800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d44072f90 0x7f7d44153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.167+0000 7f7d49800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d440c7cb0 con 0x7f7d4406e360 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.167+0000 7f7d49800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4406d630 con 0x7f7d44155cc0 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.167+0000 7f7d49800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4406d880 con 0x7f7d44072f90 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d43400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7d4406e360 0x7f7d44148ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43818/0 (socket says 172.21.15.194:43818) 2024-03-07T10:21:24.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d43400640 1 -- 172.21.15.194:0/4198523107 learned_addr learned my addr 172.21.15.194:0/4198523107 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d42000640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d44072f90 0x7f7d44153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d42a00640 1 --2- 172.21.15.194:0/4198523107 >> v2:172.21.15.196:3300/0 conn(0x7f7d44155cc0 0x7f7d441560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859724568 0 0) 0x7f7d440c7cb0 con 0x7f7d4406e360 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.168+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d28005730 con 0x7f7d4406e360 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3908614258 0 0) 0x7f7d28005730 con 0x7f7d4406e360 2024-03-07T10:21:24.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d44072f90 msgr2=0x7f7d44153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d44072f90 0x7f7d44153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 >> v2:172.21.15.196:3300/0 conn(0x7f7d44155cc0 msgr2=0x7f7d441560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 --2- 172.21.15.194:0/4198523107 >> v2:172.21.15.196:3300/0 conn(0x7f7d44155cc0 0x7f7d441560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4406db60 con 0x7f7d4406e360 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f7d3c0019f0 con 0x7f7d4406e360 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 >> v1:172.21.15.194:6789/0 conn(0x7f7d4406e360 legacy=0x7f7d44148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d28005bc0 0x7f7d28005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28006a10 0x7f7d28006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d28007390 0x7f7d2800dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4406d630 con 0x7f7d28005bc0 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4406d880 con 0x7f7d28007390 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28006840 con 0x7f7d28006a10 2024-03-07T10:21:24.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d28005bc0 0x7f7d28005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42000640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28006a10 0x7f7d28006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d43400640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d28007390 0x7f7d2800dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 -- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28006a10 msgr2=0x7f7d28006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28006a10 0x7f7d28006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 -- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d28007390 msgr2=0x7f7d2800dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d28007390 0x7f7d2800dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.169+0000 7f7d42a00640 1 -- 172.21.15.194:0/4198523107 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d28005730 con 0x7f7d28005bc0 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.170+0000 7f7d42a00640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d28005bc0 0x7f7d28005fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009ac0 tx=0x7f7d28007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818a50bf395236d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34039070 con 0x7f7d28005bc0 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3402c710 con 0x7f7d28005bc0 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d41600640 1 -- 172.21.15.194:0/4198523107 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34009690 con 0x7f7d28005bc0 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d49800640 1 -- 172.21.15.194:0/4198523107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d28005bc0 msgr2=0x7f7d28005fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d49800640 1 --2- 172.21.15.194:0/4198523107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d28005bc0 0x7f7d28005fe0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009ac0 tx=0x7f7d28007a40 comp rx=0 tx=0).stop 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d43400640 1 -- 172.21.15.194:0/4198523107 reap_dead start 2024-03-07T10:21:24.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d49800640 1 -- 172.21.15.194:0/4198523107 shutdown_connections 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d49800640 1 -- 172.21.15.194:0/4198523107 >> 172.21.15.194:0/4198523107 conn(0x7f7d4406b860 msgr2=0x7f7d440c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.171+0000 7f7d49800640 1 -- 172.21.15.194:0/4198523107 shutdown_connections 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.172+0000 7f7d49800640 1 -- 172.21.15.194:0/4198523107 wait complete. 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.173+0000 7f7d49800640 1 Processor -- start 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.173+0000 7f7d49800640 1 -- start start 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28005bc0 0x7f7d44152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 0x7f7d441eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440c7a90 con 0x7f7d441ef0e0 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440c7910 con 0x7f7d44152fe0 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d49800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d441565e0 con 0x7f7d28005bc0 2024-03-07T10:21:24.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d43400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d43400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59436/0 (socket says 172.21.15.194:59436) 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.174+0000 7f7d43400640 1 -- 172.21.15.194:0/1428955936 learned_addr learned my addr 172.21.15.194:0/1428955936 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d42a00640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28005bc0 0x7f7d44152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 -- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28005bc0 msgr2=0x7f7d44152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28005bc0 0x7f7d44152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d42000640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 0x7f7d441eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 -- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 msgr2=0x7f7d441eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 0x7f7d441eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 -- 172.21.15.194:0/1428955936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d441ef620 con 0x7f7d441ef0e0 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d42000640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 0x7f7d441eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d43400640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007730 tx=0x7f7d3c007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c00ebf0 con 0x7f7d441ef0e0 2024-03-07T10:21:24.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c00ed90 con 0x7f7d441ef0e0 2024-03-07T10:21:24.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c014670 con 0x7f7d441ef0e0 2024-03-07T10:21:24.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d441dba10 con 0x7f7d441ef0e0 2024-03-07T10:21:24.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.175+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44150ad0 con 0x7f7d441ef0e0 2024-03-07T10:21:24.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.177+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d441568d0 con 0x7f7d441ef0e0 2024-03-07T10:21:24.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.178+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7d3c014810 con 0x7f7d441ef0e0 2024-03-07T10:21:24.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.179+0000 7f7d3aa00640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 0x7f7d2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.179+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f7d3c08a270 con 0x7f7d441ef0e0 2024-03-07T10:21:24.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.180+0000 7f7d42a00640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 0x7f7d2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.181+0000 7f7d42a00640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 0x7f7d2406d9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d34036000 tx=0x7f7d34030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.185+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7d441568d0 con 0x7f7d441ef0e0 2024-03-07T10:21:24.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.375+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f7d44068170 con 0x7f7d441ef0e0 2024-03-07T10:21:24.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.375+0000 7f7d3aa00640 1 -- 172.21.15.194:0/1428955936 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7f7d3c058e50 con 0x7f7d441ef0e0 2024-03-07T10:21:24.377 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:24.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 msgr2=0x7f7d2406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 0x7f7d2406d9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7d34036000 tx=0x7f7d34030000 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 msgr2=0x7f7d44143f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c007730 tx=0x7f7d3c007bf0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 shutdown_connections 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d2406b500 0x7f7d2406d9c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d441ef0e0 0x7f7d44143f40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d44152fe0 0x7f7d441eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 --2- 172.21.15.194:0/1428955936 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d28005bc0 0x7f7d44152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 >> 172.21.15.194:0/1428955936 conn(0x7f7d4406b860 msgr2=0x7f7d44147510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 shutdown_connections 2024-03-07T10:21:24.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.378+0000 7f7d49800640 1 -- 172.21.15.194:0/1428955936 wait complete. 2024-03-07T10:21:24.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:24.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.612+0000 7f69d1600640 1 Processor -- start 2024-03-07T10:21:24.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.612+0000 7f69d1600640 1 -- start start 2024-03-07T10:21:24.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.615+0000 7f69d1600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69cc150b70 0x7f69cc0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.615+0000 7f69d1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc0a9a10 0x7f69cc06e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.615+0000 7f69d1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69cc153980 con 0x7f69cc156c20 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.615+0000 7f69d1600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69cc06e550 con 0x7f69cc150b70 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.615+0000 7f69d1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc153c60 con 0x7f69cc0a9a10 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69cc150b70 0x7f69cc0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f69cc150b70 0x7f69cc0a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59448/0 (socket says 172.21.15.194:59448) 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69ca000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f69cc156c20 0x7f69cc06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43832/0 (socket says 172.21.15.194:43832) 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 -- 172.21.15.194:0/1741938014 learned_addr learned my addr 172.21.15.194:0/1741938014 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69cb400640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc0a9a10 0x7f69cc06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 -- 172.21.15.194:0/1741938014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc0a9a10 msgr2=0x7f69cc06e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:24.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc0a9a10 0x7f69cc06e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 -- 172.21.15.194:0/1741938014 >> v1:172.21.15.194:6789/0 conn(0x7f69cc156c20 legacy=0x7f69cc06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.616+0000 7f69caa00640 1 -- 172.21.15.194:0/1741938014 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc153f40 con 0x7f69cc150b70 2024-03-07T10:21:24.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.617+0000 7f69caa00640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc150b70 0x7f69cc0a94d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009870 tx=0x7f69bc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4498c88e02fd2c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69c9600640 1 -- 172.21.15.194:0/1741938014 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc035020 con 0x7f69cc150b70 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69c9600640 1 -- 172.21.15.194:0/1741938014 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc031640 con 0x7f69cc150b70 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69c9600640 1 -- 172.21.15.194:0/1741938014 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc02d040 con 0x7f69cc150b70 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69d1600640 1 -- 172.21.15.194:0/1741938014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc150b70 msgr2=0x7f69cc0a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69d1600640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc150b70 0x7f69cc0a94d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f69bc009870 tx=0x7f69bc02b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.618+0000 7f69d1600640 1 -- 172.21.15.194:0/1741938014 shutdown_connections 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.619+0000 7f69d1600640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc0a9a10 0x7f69cc06e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.619+0000 7f69d1600640 1 --2- 172.21.15.194:0/1741938014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc150b70 0x7f69cc0a94d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.619+0000 7f69d1600640 1 -- 172.21.15.194:0/1741938014 >> 172.21.15.194:0/1741938014 conn(0x7f69cc06b840 msgr2=0x7f69cc0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:24.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.619+0000 7f69d1600640 1 -- 172.21.15.194:0/1741938014 shutdown_connections 2024-03-07T10:21:24.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.619+0000 7f69d1600640 1 -- 172.21.15.194:0/1741938014 wait complete. 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.621+0000 7f69d1600640 1 Processor -- start 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.621+0000 7f69d1600640 1 -- start start 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69cc150b70 0x7f69cc1eecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc156c20 0x7f69cc0715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc153630 con 0x7f69cc0a9a10 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0c7a30 con 0x7f69cc150b70 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69d1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc0ac460 con 0x7f69cc156c20 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59462/0 (socket says 172.21.15.194:59462) 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 -- 172.21.15.194:0/1575762925 learned_addr learned my addr 172.21.15.194:0/1575762925 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 -- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc156c20 msgr2=0x7f69cc0715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc156c20 0x7f69cc0715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 -- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69cc150b70 msgr2=0x7f69cc1eecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69cc150b70 0x7f69cc1eecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.623+0000 7f69caa00640 1 -- 172.21.15.194:0/1575762925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc0c5b10 con 0x7f69cc0a9a10 2024-03-07T10:21:24.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69caa00640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02b930 tx=0x7f69bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc040070 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69bc03e070 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc1ef500 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc035040 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.624+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc0c57a0 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.625+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc068170 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.626+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f69bc038020 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.627+0000 7f69c2a00640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 0x7f69ac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.627+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f69bc0abf00 con 0x7f69cc0a9a10 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.628+0000 7f69ca000640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 0x7f69ac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:24.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.629+0000 7f69ca000640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 0x7f69ac06d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000f60 tx=0x7f69b8007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:24.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.631+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f69bc07aae0 con 0x7f69cc0a9a10 2024-03-07T10:21:24.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.867+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69cc06cd20 con 0x7f69cc0a9a10 2024-03-07T10:21:24.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.868+0000 7f69c2a00640 1 -- 172.21.15.194:0/1575762925 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f69bc043e40 con 0x7f69cc0a9a10 2024-03-07T10:21:24.870 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:24.870 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:24.871 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:24.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 msgr2=0x7f69ac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 0x7f69ac06d9c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f69b8000f60 tx=0x7f69b8007a00 comp rx=0 tx=0).stop 2024-03-07T10:21:24.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 msgr2=0x7f69cc0727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:24.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f69bc02b930 tx=0x7f69bc0046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 shutdown_connections 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69ac06b500 0x7f69ac06d9c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f69cc156c20 0x7f69cc0715b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f69cc150b70 0x7f69cc1eecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 --2- 172.21.15.194:0/1575762925 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69cc0a9a10 0x7f69cc0727b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 >> 172.21.15.194:0/1575762925 conn(0x7f69cc06b840 msgr2=0x7f69cc0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.871+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 shutdown_connections 2024-03-07T10:21:24.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:24.872+0000 7f69d1600640 1 -- 172.21.15.194:0/1575762925 wait complete. 2024-03-07T10:21:24.894 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:25.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.094+0000 7fea01200640 1 Processor -- start 2024-03-07T10:21:25.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.094+0000 7fea01200640 1 -- start start 2024-03-07T10:21:25.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fea01200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fe9fc0c7cf0 0x7fe9fc1535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fea01200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc072e80 con 0x7fe9fc0c6590 2024-03-07T10:21:25.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fea01200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc157780 con 0x7fe9fc150be0 2024-03-07T10:21:25.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fea01200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc072c30 con 0x7fe9fc0c7cf0 2024-03-07T10:21:25.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fe9fa800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe9fc0c6590 0x7fe9fc15df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43834/0 (socket says 172.21.15.194:43834) 2024-03-07T10:21:25.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fe9fa800640 1 -- 172.21.15.194:0/2412475761 learned_addr learned my addr 172.21.15.194:0/2412475761 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:25.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.096+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2412475761 >> v2:172.21.15.196:3300/0 conn(0x7fe9fc0c7cf0 0x7fe9fc1535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492101927 0 0) 0x7fe9fc072e80 con 0x7fe9fc0c6590 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e0003520 con 0x7fe9fc0c6590 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3521151674 0 0) 0x7fe9e0003520 con 0x7fe9fc0c6590 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 >> v2:172.21.15.196:3300/0 conn(0x7fe9fc0c7cf0 msgr2=0x7fe9fc1535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 --2- 172.21.15.194:0/2412475761 >> v2:172.21.15.196:3300/0 conn(0x7fe9fc0c7cf0 0x7fe9fc1535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 >> v1:172.21.15.196:6789/0 conn(0x7fe9fc150be0 legacy=0x7fe9fc0ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc0c6070 con 0x7fe9fc0c6590 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fe9f40019f0 con 0x7fe9fc0c6590 2024-03-07T10:21:25.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 >> v1:172.21.15.194:6789/0 conn(0x7fe9fc0c6590 legacy=0x7fe9fc15df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc072c30 con 0x7fe9e0004800 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e000c060 con 0x7fe9e00051c0 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e000c260 con 0x7fe9e00039b0 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.097+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9e00640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9400640 1 -- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e00039b0 msgr2=0x7fe9e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e00039b0 0x7fe9e0003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9400640 1 -- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9e00051c0 msgr2=0x7fe9e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:25.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9e00051c0 0x7fe9e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9f9400640 1 -- 172.21.15.194:0/2412475761 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e0003520 con 0x7fe9e0004800 2024-03-07T10:21:25.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.098+0000 7fe9fa800640 1 -- 172.21.15.194:0/2412475761 reap_dead start 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.099+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009ac0 tx=0x7fe9e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e6b890c526a6c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8039070 con 0x7fe9e0004800 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e802c6d0 con 0x7fe9e0004800 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fe9f8a00640 1 -- 172.21.15.194:0/2412475761 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e8009690 con 0x7fe9e0004800 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 -- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 msgr2=0x7fe9e0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8009ac0 tx=0x7fe9e0005830 comp rx=0 tx=0).stop 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 -- 172.21.15.194:0/2412475761 shutdown_connections 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 --2- 172.21.15.194:0/2412475761 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9e0004800 0x7fe9e0004c80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 -- 172.21.15.194:0/2412475761 >> 172.21.15.194:0/2412475761 conn(0x7fe9fc0c4bd0 msgr2=0x7fe9fc0c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 -- 172.21.15.194:0/2412475761 shutdown_connections 2024-03-07T10:21:25.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.100+0000 7fea01200640 1 -- 172.21.15.194:0/2412475761 wait complete. 2024-03-07T10:21:25.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.102+0000 7fea01200640 1 Processor -- start 2024-03-07T10:21:25.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.102+0000 7fea01200640 1 -- start start 2024-03-07T10:21:25.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e0004800 0x7fe9fc1469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9fc150010 0x7fe9fc146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc157a60 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0c2710 con 0x7fe9fc150010 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fea01200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0a96f0 con 0x7fe9e0004800 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fe9fa800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fe9fa800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59478/0 (socket says 172.21.15.194:59478) 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.103+0000 7fe9fa800640 1 -- 172.21.15.194:0/2409604981 learned_addr learned my addr 172.21.15.194:0/2409604981 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9f9e00640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e0004800 0x7fe9fc1469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9f9400640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9fc150010 0x7fe9fc146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 -- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e0004800 msgr2=0x7fe9fc1469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e0004800 0x7fe9fc1469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 -- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9fc150010 msgr2=0x7fe9fc146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9fc150010 0x7fe9fc146f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 -- 172.21.15.194:0/2409604981 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc1560f0 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9fa800640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc073c90 tx=0x7fe9f400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400ce70 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400a610 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc155b30 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400aa00 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.104+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc14cb50 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.106+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc073600 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.106+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe9f4011070 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.108+0000 7fe9f2000640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 0x7fe9dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.108+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe9f4089ca0 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.108+0000 7fe9f9e00640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 0x7fe9dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.109+0000 7fe9f9e00640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 0x7fe9dc06d9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.112+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe9fc073600 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.379+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9fc0ae190 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.383+0000 7fe9f2000640 1 -- 172.21.15.194:0/2409604981 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7fe9fc1560f0 con 0x7fe9fc1ea9e0 2024-03-07T10:21:25.384 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:25.385 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 msgr2=0x7fe9dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 0x7fe9dc06d9c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec000c00 tx=0x7fe9ec009040 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 msgr2=0x7fe9fc1eae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc073c90 tx=0x7fe9f400cc20 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 shutdown_connections 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe9dc06b500 0x7fe9dc06d9c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9fc1ea9e0 0x7fe9fc1eae60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe9fc150010 0x7fe9fc146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 --2- 172.21.15.194:0/2409604981 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe9e0004800 0x7fe9fc1469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.385+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 >> 172.21.15.194:0/2409604981 conn(0x7fe9fc0c4bd0 msgr2=0x7fe9fc153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.386+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 shutdown_connections 2024-03-07T10:21:25.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.386+0000 7fea01200640 1 -- 172.21.15.194:0/2409604981 wait complete. 2024-03-07T10:21:25.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:25.407 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:25.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.604+0000 7f3f63200640 1 Processor -- start 2024-03-07T10:21:25.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.604+0000 7f3f63200640 1 -- start start 2024-03-07T10:21:25.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f63200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f640c8d90 0x7f3f64155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f63200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f63200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f641599f0 con 0x7f3f6414f7c0 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f63200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f64155b30 con 0x7f3f640c8d90 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f63200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f64155e10 con 0x7f3f64159020 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f59400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f640c8d90 0x7f3f64155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f59400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f640c8d90 0x7f3f64155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59490/0 (socket says 172.21.15.194:59490) 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f59400640 1 -- 172.21.15.194:0/2286779961 learned_addr learned my addr 172.21.15.194:0/2286779961 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f62800640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.607+0000 7f3f59400640 1 -- 172.21.15.194:0/2286779961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 msgr2=0x7f3f641594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.608+0000 7f3f59400640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.608+0000 7f3f59400640 1 -- 172.21.15.194:0/2286779961 >> v1:172.21.15.196:6789/0 conn(0x7f3f6414f7c0 legacy=0x7f3f640c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:25.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.608+0000 7f3f59400640 1 -- 172.21.15.194:0/2286779961 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f641560f0 con 0x7f3f640c8d90 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.609+0000 7f3f59400640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f640c8d90 0x7f3f64155550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009870 tx=0x7f3f4c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21c4f8658e34235 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.609+0000 7f3f61400640 1 -- 172.21.15.194:0/2286779961 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0317c0 con 0x7f3f640c8d90 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.609+0000 7f3f61400640 1 -- 172.21.15.194:0/2286779961 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c037070 con 0x7f3f640c8d90 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.609+0000 7f3f61400640 1 -- 172.21.15.194:0/2286779961 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031b80 con 0x7f3f640c8d90 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 -- 172.21.15.194:0/2286779961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f640c8d90 msgr2=0x7f3f64155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f640c8d90 0x7f3f64155550 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c009870 tx=0x7f3f4c02b860 comp rx=0 tx=0).stop 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 -- 172.21.15.194:0/2286779961 shutdown_connections 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 --2- 172.21.15.194:0/2286779961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f640c8d90 0x7f3f64155550 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 -- 172.21.15.194:0/2286779961 >> 172.21.15.194:0/2286779961 conn(0x7f3f6406b4a0 msgr2=0x7f3f6406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:25.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 -- 172.21.15.194:0/2286779961 shutdown_connections 2024-03-07T10:21:25.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.610+0000 7f3f63200640 1 -- 172.21.15.194:0/2286779961 wait complete. 2024-03-07T10:21:25.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.612+0000 7f3f63200640 1 Processor -- start 2024-03-07T10:21:25.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.612+0000 7f3f63200640 1 -- start start 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f640c8d90 0x7f3f641ee870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641ecb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f64072890 con 0x7f3f6414f7c0 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c9740 con 0x7f3f640c8d90 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f63200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f640c5f20 con 0x7f3f64159020 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59500/0 (socket says 172.21.15.194:59500) 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 -- 172.21.15.194:0/3670779429 learned_addr learned my addr 172.21.15.194:0/3670779429 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f62800640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641ecb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f61e00640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f640c8d90 0x7f3f641ee870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 -- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 msgr2=0x7f3f641ecb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641ecb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 -- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f640c8d90 msgr2=0x7f3f641ee870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f640c8d90 0x7f3f641ee870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.613+0000 7f3f59400640 1 -- 172.21.15.194:0/3670779429 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f640c2140 con 0x7f3f6414f7c0 2024-03-07T10:21:25.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f59400640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c02b8a0 tx=0x7f3f4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c032650 con 0x7f3f6414f7c0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c032810 con 0x7f3f6414f7c0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c032c00 con 0x7f3f6414f7c0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f640c2420 con 0x7f3f6414f7c0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.614+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f640c1090 con 0x7f3f6414f7c0 2024-03-07T10:21:25.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.616+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f64075600 con 0x7f3f6414f7c0 2024-03-07T10:21:25.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.616+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3f4c04c060 con 0x7f3f6414f7c0 2024-03-07T10:21:25.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.617+0000 7f3f5aa00640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 0x7f3f4006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:25.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.617+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3f4c0abfa0 con 0x7f3f6414f7c0 2024-03-07T10:21:25.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.618+0000 7f3f61e00640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 0x7f3f4006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:25.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.619+0000 7f3f61e00640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 0x7f3f4006d9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f640b0fc0 tx=0x7f3f540094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:25.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.621+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3f4c040070 con 0x7f3f6414f7c0 2024-03-07T10:21:25.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.916+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f64072590 con 0x7f3f6414f7c0 2024-03-07T10:21:25.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.917+0000 7f3f5aa00640 1 -- 172.21.15.194:0/3670779429 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f4c07ab80 con 0x7f3f6414f7c0 2024-03-07T10:21:25.918 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:25.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 msgr2=0x7f3f4006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 0x7f3f4006d9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3f640b0fc0 tx=0x7f3f540094d0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 msgr2=0x7f3f641eedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:25.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c02b8a0 tx=0x7f3f4c0046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 shutdown_connections 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3f4006b500 0x7f3f4006d9c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f64159020 0x7f3f641ecb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f6414f7c0 0x7f3f641eedb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.920+0000 7f3f63200640 1 --2- 172.21.15.194:0/3670779429 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f640c8d90 0x7f3f641ee870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.921+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 >> 172.21.15.194:0/3670779429 conn(0x7f3f6406b4a0 msgr2=0x7f3f640c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.921+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 shutdown_connections 2024-03-07T10:21:25.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:25.921+0000 7f3f63200640 1 -- 172.21.15.194:0/3670779429 wait complete. 2024-03-07T10:21:25.941 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:26.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.144+0000 7f5beac00640 1 Processor -- start 2024-03-07T10:21:26.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.145+0000 7f5beac00640 1 -- start start 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5beac00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5be40c7540 0x7f5be4157620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5beac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40c2820 con 0x7f5be406c300 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5beac00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be40c2b00 con 0x7f5be4154620 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5beac00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be4157b60 con 0x7f5be40c7540 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5be9800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5be406c300 0x7f5be4153f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43840/0 (socket says 172.21.15.194:43840) 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.147+0000 7f5be9800640 1 -- 172.21.15.194:0/388849913 learned_addr learned my addr 172.21.15.194:0/388849913 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> v2:172.21.15.196:3300/0 conn(0x7f5be40c7540 0x7f5be4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478201971 0 0) 0x7f5be40c2820 con 0x7f5be406c300 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bcc003520 con 0x7f5be406c300 2024-03-07T10:21:26.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 786851865 0 0) 0x7f5bcc003520 con 0x7f5be406c300 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 >> v2:172.21.15.196:3300/0 conn(0x7f5be40c7540 msgr2=0x7f5be4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 --2- 172.21.15.194:0/388849913 >> v2:172.21.15.196:3300/0 conn(0x7f5be40c7540 0x7f5be4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 >> v1:172.21.15.196:6789/0 conn(0x7f5be4154620 legacy=0x7f5be40c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be40c2de0 con 0x7f5be406c300 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f5bd8001670 con 0x7f5be406c300 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> v2:172.21.15.196:3300/0 conn(0x7f5be40c7540 0x7f5be4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 >> v1:172.21.15.194:6789/0 conn(0x7f5be406c300 legacy=0x7f5be4153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bcc003a00 0x7f5bcc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bcc004800 0x7f5bcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5bcc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4157b60 con 0x7f5bcc005210 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc00c160 con 0x7f5bcc003a00 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.148+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc00c360 con 0x7f5bcc004800 2024-03-07T10:21:26.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5bcc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5be8e00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bcc004800 0x7f5bcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5be9800640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bcc003a00 0x7f5bcc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 -- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bcc004800 msgr2=0x7f5bcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5bcc004800 0x7f5bcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 -- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bcc003a00 msgr2=0x7f5bcc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5bcc003a00 0x7f5bcc003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.149+0000 7f5bea200640 1 -- 172.21.15.194:0/388849913 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc003520 con 0x7f5bcc005210 2024-03-07T10:21:26.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.150+0000 7f5bea200640 1 -- 172.21.15.194:0/388849913 reap_dead start 2024-03-07T10:21:26.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.150+0000 7f5bea200640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5bcc00b9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0073e0 tx=0x7f5bcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad78ce2bf66edbd9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.151+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc039070 con 0x7f5bcc005210 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.151+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc02ce00 con 0x7f5bcc005210 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.151+0000 7f5be3e00640 1 -- 172.21.15.194:0/388849913 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc009c80 con 0x7f5bcc005210 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.151+0000 7f5beac00640 1 -- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 msgr2=0x7f5bcc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.151+0000 7f5beac00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5bcc00b9c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc0073e0 tx=0x7f5bcc005830 comp rx=0 tx=0).stop 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.152+0000 7f5beac00640 1 -- 172.21.15.194:0/388849913 shutdown_connections 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.152+0000 7f5beac00640 1 --2- 172.21.15.194:0/388849913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5bcc00b9c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.152+0000 7f5beac00640 1 -- 172.21.15.194:0/388849913 >> 172.21.15.194:0/388849913 conn(0x7f5be40c4670 msgr2=0x7f5be40c4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:26.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.152+0000 7f5beac00640 1 -- 172.21.15.194:0/388849913 shutdown_connections 2024-03-07T10:21:26.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.152+0000 7f5beac00640 1 -- 172.21.15.194:0/388849913 wait complete. 2024-03-07T10:21:26.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.153+0000 7f5beac00640 1 Processor -- start 2024-03-07T10:21:26.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.153+0000 7f5beac00640 1 -- start start 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5be409b480 0x7f5be40ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4150320 0x7f5be40abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be406c6e0 con 0x7f5bcc005210 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40c33a0 con 0x7f5be4150320 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5beac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be406c860 con 0x7f5be409b480 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5be9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5be9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59520/0 (socket says 172.21.15.194:59520) 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.154+0000 7f5be9800640 1 -- 172.21.15.194:0/567459051 learned_addr learned my addr 172.21.15.194:0/567459051 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be8e00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5be409b480 0x7f5be40ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5bea200640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4150320 0x7f5be40abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 -- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5be409b480 msgr2=0x7f5be40ab630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5be409b480 0x7f5be40ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 -- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4150320 msgr2=0x7f5be40abb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4150320 0x7f5be40abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 -- 172.21.15.194:0/567459051 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4156ec0 con 0x7f5bcc005210 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be9800640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800d7a0 tx=0x7f5bd800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8019070 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd80072d0 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd80047e0 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be414fe70 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.155+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be4154a70 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.157+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40adf10 con 0x7f5bcc005210 2024-03-07T10:21:26.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.158+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5bd8004980 con 0x7f5bcc005210 2024-03-07T10:21:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.158+0000 7f5be1600640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 0x7f5bc406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.159+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5bd8089e40 con 0x7f5bcc005210 2024-03-07T10:21:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.159+0000 7f5be8e00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 0x7f5bc406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.160+0000 7f5be8e00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 0x7f5bc406d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5be4156760 tx=0x7f5bd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.163+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5be40adf10 con 0x7f5bcc005210 2024-03-07T10:21:26.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.510+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5be4075600 con 0x7f5bcc005210 2024-03-07T10:21:26.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.511+0000 7f5be1600640 1 -- 172.21.15.194:0/567459051 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f5bd80588f0 con 0x7f5bcc005210 2024-03-07T10:21:26.512 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 msgr2=0x7f5bc406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 0x7f5bc406d990 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5be4156760 tx=0x7f5bd0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 msgr2=0x7f5be41ee8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5bd800d7a0 tx=0x7f5bd800dc60 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 shutdown_connections 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5bc406b4d0 0x7f5bc406d990 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5be4150320 0x7f5be40abb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5be409b480 0x7f5be40ab630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 --2- 172.21.15.194:0/567459051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5bcc005210 0x7f5be41ee8f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 >> 172.21.15.194:0/567459051 conn(0x7f5be40c4670 msgr2=0x7f5be40c1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:26.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.513+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 shutdown_connections 2024-03-07T10:21:26.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.514+0000 7f5beac00640 1 -- 172.21.15.194:0/567459051 wait complete. 2024-03-07T10:21:26.532 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:26.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.725+0000 7fa9a7000640 1 Processor -- start 2024-03-07T10:21:26.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.725+0000 7fa9a7000640 1 -- start start 2024-03-07T10:21:26.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a7000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9a013ee30 0x7fa9a00c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a7000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0155920 con 0x7fa9a0159a30 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a7000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a0158f50 con 0x7fa9a0070410 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a7000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a0158d00 con 0x7fa9a013ee30 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa99fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9a013ee30 0x7fa9a00c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a5000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa9a0159a30 0x7fa9a006f720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43854/0 (socket says 172.21.15.194:43854) 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa99fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9a013ee30 0x7fa9a00c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59528/0 (socket says 172.21.15.194:59528) 2024-03-07T10:21:26.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.727+0000 7fa9a5000640 1 -- 172.21.15.194:0/1392550028 learned_addr learned my addr 172.21.15.194:0/1392550028 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.728+0000 7fa99fe00640 1 -- 172.21.15.194:0/1392550028 >> v1:172.21.15.196:6789/0 conn(0x7fa9a0070410 legacy=0x7fa9a006f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.728+0000 7fa99fe00640 1 -- 172.21.15.194:0/1392550028 >> v1:172.21.15.194:6789/0 conn(0x7fa9a0159a30 legacy=0x7fa9a006f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.728+0000 7fa99fe00640 1 -- 172.21.15.194:0/1392550028 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0159230 con 0x7fa9a013ee30 2024-03-07T10:21:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.729+0000 7fa99fe00640 1 --2- 172.21.15.194:0/1392550028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a013ee30 0x7fa9a00c1390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097a0 tx=0x7fa99002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b02fa4974f0a52a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.732 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa99f400640 1 -- 172.21.15.194:0/1392550028 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990035020 con 0x7fa9a013ee30 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa99f400640 1 -- 172.21.15.194:0/1392550028 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa990031830 con 0x7fa9a013ee30 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa99f400640 1 -- 172.21.15.194:0/1392550028 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990031c00 con 0x7fa9a013ee30 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa9a7000640 1 -- 172.21.15.194:0/1392550028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a013ee30 msgr2=0x7fa9a00c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa9a7000640 1 --2- 172.21.15.194:0/1392550028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a013ee30 0x7fa9a00c1390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa9900097a0 tx=0x7fa99002b8d0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa9a7000640 1 -- 172.21.15.194:0/1392550028 shutdown_connections 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa9a7000640 1 --2- 172.21.15.194:0/1392550028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a013ee30 0x7fa9a00c1390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.730+0000 7fa9a7000640 1 -- 172.21.15.194:0/1392550028 >> 172.21.15.194:0/1392550028 conn(0x7fa9a00c4a60 msgr2=0x7fa9a00c4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.731+0000 7fa9a7000640 1 -- 172.21.15.194:0/1392550028 shutdown_connections 2024-03-07T10:21:26.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.731+0000 7fa9a7000640 1 -- 172.21.15.194:0/1392550028 wait complete. 2024-03-07T10:21:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.732+0000 7fa9a7000640 1 Processor -- start 2024-03-07T10:21:26.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.732+0000 7fa9a7000640 1 -- start start 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9a013ee30 0x7fa9a0138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9a0155420 0x7fa9a01e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00c18d0 con 0x7fa9a0159a30 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a01595a0 con 0x7fa9a0155420 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a7000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a00c1a50 con 0x7fa9a013ee30 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa997400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa997400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59536/0 (socket says 172.21.15.194:59536) 2024-03-07T10:21:26.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa997400640 1 -- 172.21.15.194:0/2674825555 learned_addr learned my addr 172.21.15.194:0/2674825555 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa99fe00640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9a013ee30 0x7fa9a0138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.734+0000 7fa9a5000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9a0155420 0x7fa9a01e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 -- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9a013ee30 msgr2=0x7fa9a0138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9a013ee30 0x7fa9a0138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 -- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9a0155420 msgr2=0x7fa9a01e18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9a0155420 0x7fa9a01e18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 -- 172.21.15.194:0/2674825555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a01551e0 con 0x7fa9a0159a30 2024-03-07T10:21:26.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa997400640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c400 tx=0x7fa98800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988017070 con 0x7fa9a0159a30 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880052d0 con 0x7fa9a0159a30 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a01e2b00 con 0x7fa9a0159a30 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988003830 con 0x7fa9a0159a30 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.735+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a01ebd70 con 0x7fa9a0159a30 2024-03-07T10:21:26.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.737+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a0068880 con 0x7fa9a0159a30 2024-03-07T10:21:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.737+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa98801a070 con 0x7fa9a0159a30 2024-03-07T10:21:26.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.738+0000 7fa99cc00640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 0x7fa97c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:26.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.738+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fa988089800 con 0x7fa9a0159a30 2024-03-07T10:21:26.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.739+0000 7fa99fe00640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 0x7fa97c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:26.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.740+0000 7fa99fe00640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 0x7fa97c06d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa990036000 tx=0x7fa990008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:26.748 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.747+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa9880583e0 con 0x7fa9a0159a30 2024-03-07T10:21:26.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.976+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fa9a00c5580 con 0x7fa9a0159a30 2024-03-07T10:21:26.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.977+0000 7fa99cc00640 1 -- 172.21.15.194:0/2674825555 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7fa988087e20 con 0x7fa9a0159a30 2024-03-07T10:21:26.979 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 msgr2=0x7fa97c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 0x7fa97c06d990 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa990036000 tx=0x7fa990008030 comp rx=0 tx=0).stop 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 msgr2=0x7fa9a0157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa98800c400 tx=0x7fa98800c8c0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 shutdown_connections 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa97c06b4d0 0x7fa97c06d990 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa9a0155420 0x7fa9a01e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9a0159a30 0x7fa9a0157dc0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 --2- 172.21.15.194:0/2674825555 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa9a013ee30 0x7fa9a0138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:26.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.980+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 >> 172.21.15.194:0/2674825555 conn(0x7fa9a00c4a60 msgr2=0x7fa9a00c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:26.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.981+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 shutdown_connections 2024-03-07T10:21:26.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:26.981+0000 7fa9a7000640 1 -- 172.21.15.194:0/2674825555 wait complete. 2024-03-07T10:21:27.001 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:27.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.197+0000 7f0d44e00640 1 Processor -- start 2024-03-07T10:21:27.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.197+0000 7f0d44e00640 1 -- start start 2024-03-07T10:21:27.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.198+0000 7f0d44e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0d40152da0 0x7f0d400c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d44e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 0x7f0d401560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d44e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d40153180 con 0x7f0d400cb380 2024-03-07T10:21:27.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d44e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40158f70 con 0x7f0d40152da0 2024-03-07T10:21:27.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d44e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40159250 con 0x7f0d400cb7a0 2024-03-07T10:21:27.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d3e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 0x7f0d401560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d3d400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f0d400cb380 0x7f0d40155990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49888/0 (socket says 172.21.15.194:49888) 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d3d400640 1 -- 172.21.15.194:0/490282601 learned_addr learned my addr 172.21.15.194:0/490282601 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.199+0000 7f0d3de00640 1 --2- 172.21.15.194:0/490282601 >> v2:172.21.15.196:3300/0 conn(0x7f0d40152da0 0x7f0d400c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3ca00640 1 -- 172.21.15.194:0/490282601 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2100377254 0 0) 0x7f0d40153180 con 0x7f0d400cb380 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3ca00640 1 -- 172.21.15.194:0/490282601 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d24003520 con 0x7f0d400cb380 2024-03-07T10:21:27.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3e800640 1 -- 172.21.15.194:0/490282601 >> v2:172.21.15.196:3300/0 conn(0x7f0d40152da0 msgr2=0x7f0d400c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:27.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3e800640 1 --2- 172.21.15.194:0/490282601 >> v2:172.21.15.196:3300/0 conn(0x7f0d40152da0 0x7f0d400c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3e800640 1 -- 172.21.15.194:0/490282601 >> v1:172.21.15.196:6789/0 conn(0x7f0d400cb380 legacy=0x7f0d40155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.200+0000 7f0d3e800640 1 -- 172.21.15.194:0/490282601 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40159530 con 0x7f0d400cb7a0 2024-03-07T10:21:27.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.203+0000 7f0d3e800640 1 --2- 172.21.15.194:0/490282601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 0x7f0d401560a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7784d8a7878091a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.203+0000 7f0d3ca00640 1 -- 172.21.15.194:0/490282601 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38039070 con 0x7f0d400cb7a0 2024-03-07T10:21:27.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.203+0000 7f0d3ca00640 1 -- 172.21.15.194:0/490282601 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3802cc50 con 0x7f0d400cb7a0 2024-03-07T10:21:27.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.203+0000 7f0d3ca00640 1 -- 172.21.15.194:0/490282601 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d38034440 con 0x7f0d400cb7a0 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 -- 172.21.15.194:0/490282601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 msgr2=0x7f0d401560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 --2- 172.21.15.194:0/490282601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 0x7f0d401560a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3802bea0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 -- 172.21.15.194:0/490282601 shutdown_connections 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 --2- 172.21.15.194:0/490282601 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d400cb7a0 0x7f0d401560a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 --2- 172.21.15.194:0/490282601 >> v2:172.21.15.196:3300/0 conn(0x7f0d40152da0 0x7f0d400c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 -- 172.21.15.194:0/490282601 >> 172.21.15.194:0/490282601 conn(0x7f0d40066f70 msgr2=0x7f0d40067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:27.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 -- 172.21.15.194:0/490282601 shutdown_connections 2024-03-07T10:21:27.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.204+0000 7f0d44e00640 1 -- 172.21.15.194:0/490282601 wait complete. 2024-03-07T10:21:27.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.207+0000 7f0d44e00640 1 Processor -- start 2024-03-07T10:21:27.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.207+0000 7f0d44e00640 1 -- start start 2024-03-07T10:21:27.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d400cb380 0x7f0d400c3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d40152da0 0x7f0d40154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400be8c0 con 0x7f0d400cb7a0 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d401565e0 con 0x7f0d400cb380 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.208+0000 7f0d44e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400c9450 con 0x7f0d40152da0 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59542/0 (socket says 172.21.15.194:59542) 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 -- 172.21.15.194:0/4020851170 learned_addr learned my addr 172.21.15.194:0/4020851170 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3de00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d400cb380 0x7f0d400c3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3e800640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d40152da0 0x7f0d40154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 -- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d40152da0 msgr2=0x7f0d40154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d40152da0 0x7f0d40154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.215 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 -- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d400cb380 msgr2=0x7f0d400c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d400cb380 0x7f0d400c3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.209+0000 7f0d3d400640 1 -- 172.21.15.194:0/4020851170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400c4f70 con 0x7f0d400cb7a0 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d3d400640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c430 tx=0x7f0d2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c017070 con 0x7f0d400cb7a0 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2c005ce0 con 0x7f0d400cb7a0 2024-03-07T10:21:27.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d2c0072f0 con 0x7f0d400cb7a0 2024-03-07T10:21:27.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d400c3f70 con 0x7f0d400cb7a0 2024-03-07T10:21:27.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.210+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d401eb020 con 0x7f0d400cb7a0 2024-03-07T10:21:27.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.211+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d400c1470 con 0x7f0d400cb7a0 2024-03-07T10:21:27.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.212+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0d2c01a070 con 0x7f0d400cb7a0 2024-03-07T10:21:27.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.213+0000 7f0d36000640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.214+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0d2c089a50 con 0x7f0d400cb7a0 2024-03-07T10:21:27.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.214+0000 7f0d3de00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.215+0000 7f0d3de00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 0x7f0d2006d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009a30 tx=0x7f0d30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.217+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0d400c1470 con 0x7f0d400cb7a0 2024-03-07T10:21:27.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.413+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d401eab30 con 0x7f0d400cb7a0 2024-03-07T10:21:27.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.414+0000 7f0d36000640 1 -- 172.21.15.194:0/4020851170 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f0d2c058510 con 0x7f0d400cb7a0 2024-03-07T10:21:27.415 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 msgr2=0x7f0d2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 0x7f0d2006d990 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009a30 tx=0x7f0d30008040 comp rx=0 tx=0).stop 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 msgr2=0x7f0d400c4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c00c430 tx=0x7f0d2c00c8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 shutdown_connections 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0d2006b4d0 0x7f0d2006d990 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0d40152da0 0x7f0d40154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.418 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d400cb7a0 0x7f0d400c4a30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 --2- 172.21.15.194:0/4020851170 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0d400cb380 0x7f0d400c3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 >> 172.21.15.194:0/4020851170 conn(0x7f0d40066f70 msgr2=0x7f0d400c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 shutdown_connections 2024-03-07T10:21:27.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.416+0000 7f0d44e00640 1 -- 172.21.15.194:0/4020851170 wait complete. 2024-03-07T10:21:27.434 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:27.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.641+0000 7fdca0c00640 1 Processor -- start 2024-03-07T10:21:27.642 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.641+0000 7fdca0c00640 1 -- start start 2024-03-07T10:21:27.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.642+0000 7fdca0c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 0x7fdc9c158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.642+0000 7fdca0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 0x7fdc9c157660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.642+0000 7fdca0c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9c0c7bd0 con 0x7fdc9c071230 2024-03-07T10:21:27.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.642+0000 7fdca0c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc9c0c64f0 con 0x7fdc9c1566b0 2024-03-07T10:21:27.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.642+0000 7fdca0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c070cf0 con 0x7fdc9c159490 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.643+0000 7fdc9a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 0x7fdc9c157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.643+0000 7fdc99e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 0x7fdc9c158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.643+0000 7fdc93e00640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7fdc9c071230 0x7fdc9c156f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49896/0 (socket says 172.21.15.194:49896) 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.643+0000 7fdc93e00640 1 -- 172.21.15.194:0/3836712031 learned_addr learned my addr 172.21.15.194:0/3836712031 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.644+0000 7fdc9a800640 1 -- 172.21.15.194:0/3836712031 >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 msgr2=0x7fdc9c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.644+0000 7fdc9a800640 1 --2- 172.21.15.194:0/3836712031 >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 0x7fdc9c158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.644+0000 7fdc9a800640 1 -- 172.21.15.194:0/3836712031 >> v1:172.21.15.196:6789/0 conn(0x7fdc9c071230 legacy=0x7fdc9c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.644+0000 7fdc9a800640 1 -- 172.21.15.194:0/3836712031 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c0709c0 con 0x7fdc9c159490 2024-03-07T10:21:27.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.644+0000 7fdc99e00640 1 --2- 172.21.15.194:0/3836712031 >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 0x7fdc9c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:27.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.645+0000 7fdc9a800640 1 --2- 172.21.15.194:0/3836712031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 0x7fdc9c157660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c070e70 tx=0x7fdc9402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69ec6e3a9ac1814e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.645+0000 7fdc99400640 1 -- 172.21.15.194:0/3836712031 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94039070 con 0x7fdc9c159490 2024-03-07T10:21:27.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.645+0000 7fdc99400640 1 -- 172.21.15.194:0/3836712031 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9402cbb0 con 0x7fdc9c159490 2024-03-07T10:21:27.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.645+0000 7fdc99400640 1 -- 172.21.15.194:0/3836712031 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94034440 con 0x7fdc9c159490 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 -- 172.21.15.194:0/3836712031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 msgr2=0x7fdc9c157660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 --2- 172.21.15.194:0/3836712031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 0x7fdc9c157660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c070e70 tx=0x7fdc9402be00 comp rx=0 tx=0).stop 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 -- 172.21.15.194:0/3836712031 shutdown_connections 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 --2- 172.21.15.194:0/3836712031 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c159490 0x7fdc9c157660 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 --2- 172.21.15.194:0/3836712031 >> v2:172.21.15.196:3300/0 conn(0x7fdc9c1566b0 0x7fdc9c158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 -- 172.21.15.194:0/3836712031 >> 172.21.15.194:0/3836712031 conn(0x7fdc9c0c8e50 msgr2=0x7fdc9c0c9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 -- 172.21.15.194:0/3836712031 shutdown_connections 2024-03-07T10:21:27.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.646+0000 7fdca0c00640 1 -- 172.21.15.194:0/3836712031 wait complete. 2024-03-07T10:21:27.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.649+0000 7fdca0c00640 1 Processor -- start 2024-03-07T10:21:27.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.649+0000 7fdca0c00640 1 -- start start 2024-03-07T10:21:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c071230 0x7fdc9c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c1566b0 0x7fdc9c1df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c159b00 con 0x7fdc9c159490 2024-03-07T10:21:27.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c157ba0 con 0x7fdc9c071230 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdca0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9c159de0 con 0x7fdc9c1566b0 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdc9a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdc9a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59548/0 (socket says 172.21.15.194:59548) 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdc9a800640 1 -- 172.21.15.194:0/514891545 learned_addr learned my addr 172.21.15.194:0/514891545 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdc99e00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c071230 0x7fdc9c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.650+0000 7fdc93e00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c1566b0 0x7fdc9c1df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 -- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c1566b0 msgr2=0x7fdc9c1df7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c1566b0 0x7fdc9c1df7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 -- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c071230 msgr2=0x7fdc9c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c071230 0x7fdc9c1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 -- 172.21.15.194:0/514891545 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c1eb3b0 con 0x7fdc9c159490 2024-03-07T10:21:27.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc9a800640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402c410 tx=0x7fdc94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94039050 con 0x7fdc9c159490 2024-03-07T10:21:27.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94045070 con 0x7fdc9c159490 2024-03-07T10:21:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94009450 con 0x7fdc9c159490 2024-03-07T10:21:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.651+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9c0a8140 con 0x7fdc9c159490 2024-03-07T10:21:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.652+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9c1ef350 con 0x7fdc9c159490 2024-03-07T10:21:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.653+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9c068170 con 0x7fdc9c159490 2024-03-07T10:21:27.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.654+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fdc9403e850 con 0x7fdc9c159490 2024-03-07T10:21:27.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.655+0000 7fdc92000640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 0x7fdc7806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:27.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.655+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fdc940ad370 con 0x7fdc9c159490 2024-03-07T10:21:27.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.656+0000 7fdc99e00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 0x7fdc7806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:27.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.657+0000 7fdc99e00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 0x7fdc7806d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009560 tx=0x7fdc8c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:27.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.659+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdc9407bfd0 con 0x7fdc9c159490 2024-03-07T10:21:27.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.878+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fdc9c0c6670 con 0x7fdc9c159490 2024-03-07T10:21:27.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.879+0000 7fdc92000640 1 -- 172.21.15.194:0/514891545 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7fdc9407b8d0 con 0x7fdc9c159490 2024-03-07T10:21:27.881 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:27.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.881+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 msgr2=0x7fdc7806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.881+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 0x7fdc7806d990 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c009560 tx=0x7fdc8c009190 comp rx=0 tx=0).stop 2024-03-07T10:21:27.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.881+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 msgr2=0x7fdc9c14c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.881+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdc9402c410 tx=0x7fdc94004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 shutdown_connections 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdc7806b4d0 0x7fdc7806d990 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc9c159490 0x7fdc9c14c380 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdc9c1566b0 0x7fdc9c1df7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 --2- 172.21.15.194:0/514891545 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdc9c071230 0x7fdc9c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 >> 172.21.15.194:0/514891545 conn(0x7fdc9c0c8e50 msgr2=0x7fdc9c154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 shutdown_connections 2024-03-07T10:21:27.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:27.882+0000 7fdca0c00640 1 -- 172.21.15.194:0/514891545 wait complete. 2024-03-07T10:21:27.902 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:28.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.096+0000 7ffbf6e00640 1 Processor -- start 2024-03-07T10:21:28.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.096+0000 7ffbf6e00640 1 -- start start 2024-03-07T10:21:28.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.097+0000 7ffbf6e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbf6e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 0x7ffbf0071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbf6e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbf0159dc0 con 0x7ffbf00c12a0 2024-03-07T10:21:28.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbf6e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbf0156610 con 0x7ffbf0071b90 2024-03-07T10:21:28.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbf6e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf0155a00 con 0x7ffbf0152dc0 2024-03-07T10:21:28.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbefe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbefe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:41426/0 (socket says 172.21.15.194:41426) 2024-03-07T10:21:28.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbefe00640 1 -- 172.21.15.194:0/3223924772 learned_addr learned my addr 172.21.15.194:0/3223924772 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:28.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbe7e00640 1 --1- 172.21.15.194:0/3223924772 >> v1:172.21.15.196:6789/0 conn(0x7ffbf00c12a0 0x7ffbf00c03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:49906/0 (socket says 172.21.15.194:49906) 2024-03-07T10:21:28.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.098+0000 7ffbf4e00640 1 --2- 172.21.15.194:0/3223924772 >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 0x7ffbf0071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.099+0000 7ffbefe00640 1 -- 172.21.15.194:0/3223924772 >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 msgr2=0x7ffbf0071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:28.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.099+0000 7ffbefe00640 1 --2- 172.21.15.194:0/3223924772 >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 0x7ffbf0071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.099+0000 7ffbefe00640 1 -- 172.21.15.194:0/3223924772 >> v1:172.21.15.196:6789/0 conn(0x7ffbf00c12a0 legacy=0x7ffbf00c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.099+0000 7ffbefe00640 1 -- 172.21.15.194:0/3223924772 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf0155ce0 con 0x7ffbf0152dc0 2024-03-07T10:21:28.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.099+0000 7ffbf4e00640 1 --2- 172.21.15.194:0/3223924772 >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 0x7ffbf0071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:28.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.101+0000 7ffbefe00640 1 --2- 172.21.15.194:0/3223924772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009870 tx=0x7ffbe002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887202dec86f0751 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.101+0000 7ffbef400640 1 -- 172.21.15.194:0/3223924772 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00317c0 con 0x7ffbf0152dc0 2024-03-07T10:21:28.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.101+0000 7ffbef400640 1 -- 172.21.15.194:0/3223924772 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe0037070 con 0x7ffbf0152dc0 2024-03-07T10:21:28.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.101+0000 7ffbef400640 1 -- 172.21.15.194:0/3223924772 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0031b80 con 0x7ffbf0152dc0 2024-03-07T10:21:28.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 -- 172.21.15.194:0/3223924772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 msgr2=0x7ffbf0159880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/3223924772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009870 tx=0x7ffbe002b860 comp rx=0 tx=0).stop 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 -- 172.21.15.194:0/3223924772 shutdown_connections 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/3223924772 >> v2:172.21.15.196:3300/0 conn(0x7ffbf0071b90 0x7ffbf0071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/3223924772 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0152dc0 0x7ffbf0159880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 -- 172.21.15.194:0/3223924772 >> 172.21.15.194:0/3223924772 conn(0x7ffbf006b840 msgr2=0x7ffbf00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 -- 172.21.15.194:0/3223924772 shutdown_connections 2024-03-07T10:21:28.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.102+0000 7ffbf6e00640 1 -- 172.21.15.194:0/3223924772 wait complete. 2024-03-07T10:21:28.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.104+0000 7ffbf6e00640 1 Processor -- start 2024-03-07T10:21:28.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.104+0000 7ffbf6e00640 1 -- start start 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 0x7ffbf0157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbf0152dc0 0x7ffbf01e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00c0b00 con 0x7ffbf00c12a0 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf01562a0 con 0x7ffbf0152dc0 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf6e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbf00c0c80 con 0x7ffbf0071b90 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59560/0 (socket says 172.21.15.194:59560) 2024-03-07T10:21:28.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 -- 172.21.15.194:0/883880575 learned_addr learned my addr 172.21.15.194:0/883880575 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbefe00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 0x7ffbf0157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbf4e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbf0152dc0 0x7ffbf01e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 -- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 msgr2=0x7ffbf0157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 0x7ffbf0157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 -- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbf0152dc0 msgr2=0x7ffbf01e83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbf0152dc0 0x7ffbf01e83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbe7e00640 1 -- 172.21.15.194:0/883880575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbf00a9720 con 0x7ffbf00c12a0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.105+0000 7ffbefe00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 0x7ffbf0157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbe7e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c3c0 tx=0x7ffbd800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd80074e0 con 0x7ffbf00c12a0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd8007680 con 0x7ffbf00c12a0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbf00a9a00 con 0x7ffbf00c12a0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd8004a00 con 0x7ffbf00c12a0 2024-03-07T10:21:28.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.106+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbf00c61c0 con 0x7ffbf00c12a0 2024-03-07T10:21:28.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.107+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbf00a9c20 con 0x7ffbf00c12a0 2024-03-07T10:21:28.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.109+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ffbd801a020 con 0x7ffbf00c12a0 2024-03-07T10:21:28.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.110+0000 7ffbecc00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 0x7ffbcc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.110+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ffbd8089c70 con 0x7ffbf00c12a0 2024-03-07T10:21:28.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.111+0000 7ffbefe00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 0x7ffbcc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.112+0000 7ffbefe00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 0x7ffbcc06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0036000 tx=0x7ffbe003d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.115+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffbd80587b0 con 0x7ffbf00c12a0 2024-03-07T10:21:28.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.348+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbf0068170 con 0x7ffbf00c12a0 2024-03-07T10:21:28.350 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.349+0000 7ffbecc00640 1 -- 172.21.15.194:0/883880575 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7ffbd80580b0 con 0x7ffbf00c12a0 2024-03-07T10:21:28.350 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:28.350 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:28.351 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.351+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 msgr2=0x7ffbcc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.351+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 0x7ffbcc06d990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0036000 tx=0x7ffbe003d040 comp rx=0 tx=0).stop 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.351+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 msgr2=0x7ffbf00c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.351+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800c3c0 tx=0x7ffbd800c880 comp rx=0 tx=0).stop 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 shutdown_connections 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffbcc06b4d0 0x7ffbcc06d990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffbf0152dc0 0x7ffbf01e83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbf00c12a0 0x7ffbf00c5c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 --2- 172.21.15.194:0/883880575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffbf0071b90 0x7ffbf0157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 >> 172.21.15.194:0/883880575 conn(0x7ffbf006b840 msgr2=0x7ffbf0153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 shutdown_connections 2024-03-07T10:21:28.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.352+0000 7ffbf6e00640 1 -- 172.21.15.194:0/883880575 wait complete. 2024-03-07T10:21:28.373 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:28.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.566+0000 7fe76da00640 1 Processor -- start 2024-03-07T10:21:28.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.566+0000 7fe76da00640 1 -- start start 2024-03-07T10:21:28.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.567+0000 7fe76da00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe768152d70 0x7fe76806e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.567+0000 7fe76da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe76806b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe76da00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7680c41f0 con 0x7fe76806b930 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe76da00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680c2600 con 0x7fe768152d70 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe76da00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768156080 con 0x7fe76806e970 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe768152d70 0x7fe76806e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe768152d70 0x7fe76806e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59562/0 (socket says 172.21.15.194:59562) 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 -- 172.21.15.194:0/3236522717 learned_addr learned my addr 172.21.15.194:0/3236522717 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767400640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe76806b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 -- 172.21.15.194:0/3236522717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 msgr2=0x7fe76806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe76806b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 -- 172.21.15.194:0/3236522717 >> v1:172.21.15.194:6789/0 conn(0x7fe76806b930 legacy=0x7fe768158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe767e00640 1 -- 172.21.15.194:0/3236522717 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7680c2320 con 0x7fe768152d70 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.568+0000 7fe766a00640 1 -- 172.21.15.194:0/3236522717 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055923324 0 0) 0x7fe7680c41f0 con 0x7fe76806b930 2024-03-07T10:21:28.571 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.569+0000 7fe767e00640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe768152d70 0x7fe76806e430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe758009870 tx=0x7fe75802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76972c142342bbab server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe766a00640 1 -- 172.21.15.194:0/3236522717 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758035020 con 0x7fe768152d70 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe766a00640 1 -- 172.21.15.194:0/3236522717 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758031640 con 0x7fe768152d70 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe766a00640 1 -- 172.21.15.194:0/3236522717 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75802d040 con 0x7fe768152d70 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 -- 172.21.15.194:0/3236522717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe768152d70 msgr2=0x7fe76806e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe768152d70 0x7fe76806e430 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe758009870 tx=0x7fe75802b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 -- 172.21.15.194:0/3236522717 shutdown_connections 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe76806b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 --2- 172.21.15.194:0/3236522717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe768152d70 0x7fe76806e430 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 -- 172.21.15.194:0/3236522717 >> 172.21.15.194:0/3236522717 conn(0x7fe7680c4980 msgr2=0x7fe7680c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 -- 172.21.15.194:0/3236522717 shutdown_connections 2024-03-07T10:21:28.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.570+0000 7fe76da00640 1 -- 172.21.15.194:0/3236522717 wait complete. 2024-03-07T10:21:28.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.572+0000 7fe76da00640 1 Processor -- start 2024-03-07T10:21:28.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.572+0000 7fe76da00640 1 -- start start 2024-03-07T10:21:28.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe768159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe768152d70 0x7fe7681e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c8d20 con 0x7fe76806b930 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7681565b0 con 0x7fe768152d70 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe76da00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76806fc50 con 0x7fe76806e970 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe767e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe767e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:59578/0 (socket says 172.21.15.194:59578) 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.573+0000 7fe767e00640 1 -- 172.21.15.194:0/1796794011 learned_addr learned my addr 172.21.15.194:0/1796794011 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767400640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe768159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 -- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 msgr2=0x7fe768159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe768159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 -- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe768152d70 msgr2=0x7fe7681e8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe768152d70 0x7fe7681e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 -- 172.21.15.194:0/1796794011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76814e430 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe767e00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe758000c00 tx=0x7fe7580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758040070 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7580399f0 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76814e710 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758035040 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.574+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76814ecd0 con 0x7fe76806b930 2024-03-07T10:21:28.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.575+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe768068880 con 0x7fe76806b930 2024-03-07T10:21:28.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.577+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe758038020 con 0x7fe76806b930 2024-03-07T10:21:28.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.578+0000 7fe75fe00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.578+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7fe7580abf50 con 0x7fe76806b930 2024-03-07T10:21:28.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.578+0000 7fe767400640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.580+0000 7fe767400640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe768159c30 tx=0x7fe754008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.582+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe75807aa00 con 0x7fe76806b930 2024-03-07T10:21:28.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.764+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7680c5700 con 0x7fe76806b930 2024-03-07T10:21:28.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.767+0000 7fe75fe00640 1 -- 172.21.15.194:0/1796794011 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7fe75807a300 con 0x7fe76806b930 2024-03-07T10:21:28.771 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:28.772 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:28.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 msgr2=0x7fe74806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 0x7fe74806d990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe768159c30 tx=0x7fe754008040 comp rx=0 tx=0).stop 2024-03-07T10:21:28.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 msgr2=0x7fe7681eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe758000c00 tx=0x7fe7580046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 shutdown_connections 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe74806b4d0 0x7fe74806d990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe768152d70 0x7fe7681e8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe76806e970 0x7fe768159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 --2- 172.21.15.194:0/1796794011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76806b930 0x7fe7681eeca0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 >> 172.21.15.194:0/1796794011 conn(0x7fe7680c4980 msgr2=0x7fe76806de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 shutdown_connections 2024-03-07T10:21:28.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.770+0000 7fe76da00640 1 -- 172.21.15.194:0/1796794011 wait complete. 2024-03-07T10:21:28.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:28.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.973+0000 7ffb4a600640 1 Processor -- start 2024-03-07T10:21:28.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.973+0000 7ffb4a600640 1 -- start start 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb4a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffb44152dc0 0x7ffb440c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb4a600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ffb440c7d40 0x7ffb44156350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb4a600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb44159140 con 0x7ffb440c6250 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb4a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb440c3e80 con 0x7ffb44152dc0 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb4a600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb44159420 con 0x7ffb440c7d40 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb3be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ffb440c6250 0x7ffb44155c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38188/0 (socket says 172.21.15.194:38188) 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.974+0000 7ffb3be00640 1 -- 172.21.15.194:0/1958434706 learned_addr learned my addr 172.21.15.194:0/1958434706 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43400640 1 --2- 172.21.15.194:0/1958434706 >> v2:172.21.15.194:3300/0 conn(0x7ffb44152dc0 0x7ffb440c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43e00640 1 --2- 172.21.15.194:0/1958434706 >> v2:172.21.15.196:3300/0 conn(0x7ffb440c7d40 0x7ffb44156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43400640 1 -- 172.21.15.194:0/1958434706 >> v2:172.21.15.196:3300/0 conn(0x7ffb440c7d40 msgr2=0x7ffb44156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43400640 1 --2- 172.21.15.194:0/1958434706 >> v2:172.21.15.196:3300/0 conn(0x7ffb440c7d40 0x7ffb44156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43400640 1 -- 172.21.15.194:0/1958434706 >> v1:172.21.15.194:6789/0 conn(0x7ffb440c6250 legacy=0x7ffb44155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb43400640 1 -- 172.21.15.194:0/1958434706 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb44159700 con 0x7ffb44152dc0 2024-03-07T10:21:28.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.975+0000 7ffb42a00640 1 -- 172.21.15.194:0/1958434706 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631868077 0 0) 0x7ffb44159140 con 0x7ffb440c6250 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.976+0000 7ffb43400640 1 --2- 172.21.15.194:0/1958434706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb440c7800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffb4406e330 tx=0x7ffb3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5a29cf3378ba13 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.976+0000 7ffb42a00640 1 -- 172.21.15.194:0/1958434706 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34035020 con 0x7ffb44152dc0 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.976+0000 7ffb42a00640 1 -- 172.21.15.194:0/1958434706 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb34031830 con 0x7ffb44152dc0 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.976+0000 7ffb42a00640 1 -- 172.21.15.194:0/1958434706 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb34031c00 con 0x7ffb44152dc0 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 -- 172.21.15.194:0/1958434706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 msgr2=0x7ffb440c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 --2- 172.21.15.194:0/1958434706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb440c7800 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffb4406e330 tx=0x7ffb3402b8d0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 -- 172.21.15.194:0/1958434706 shutdown_connections 2024-03-07T10:21:28.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 --2- 172.21.15.194:0/1958434706 >> v2:172.21.15.196:3300/0 conn(0x7ffb440c7d40 0x7ffb44156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 --2- 172.21.15.194:0/1958434706 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb440c7800 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 -- 172.21.15.194:0/1958434706 >> 172.21.15.194:0/1958434706 conn(0x7ffb440c8fc0 msgr2=0x7ffb440c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:28.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 -- 172.21.15.194:0/1958434706 shutdown_connections 2024-03-07T10:21:28.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.977+0000 7ffb4a600640 1 -- 172.21.15.194:0/1958434706 wait complete. 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 Processor -- start 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 -- start start 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb440c6250 0x7ffb441ef340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 0x7ffb440ac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44158d60 con 0x7ffb44152dc0 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb441531a0 con 0x7ffb440c6250 2024-03-07T10:21:28.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.979+0000 7ffb4a600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb44158ee0 con 0x7ffb440c7d40 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60718/0 (socket says 172.21.15.194:60718) 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 -- 172.21.15.194:0/959046147 learned_addr learned my addr 172.21.15.194:0/959046147 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43400640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb440c6250 0x7ffb441ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb3be00640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 0x7ffb440ac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 -- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 msgr2=0x7ffb440ac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 0x7ffb440ac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 -- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb440c6250 msgr2=0x7ffb441ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb440c6250 0x7ffb441ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 -- 172.21.15.194:0/959046147 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440ab7b0 con 0x7ffb44152dc0 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb3be00640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 0x7ffb440ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.980+0000 7ffb43e00640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00efc0 tx=0x7ffb3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.981+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c018020 con 0x7ffb44152dc0 2024-03-07T10:21:28.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.981+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c014480 con 0x7ffb44152dc0 2024-03-07T10:21:28.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.981+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c014870 con 0x7ffb44152dc0 2024-03-07T10:21:28.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.981+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb440aa8e0 con 0x7ffb44152dc0 2024-03-07T10:21:28.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.981+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb44151c60 con 0x7ffb44152dc0 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.982+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb44068170 con 0x7ffb44152dc0 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.983+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ffb3c005d10 con 0x7ffb44152dc0 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.983+0000 7ffb3b400640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.984+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ffb3c08b3c0 con 0x7ffb44152dc0 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.984+0000 7ffb43400640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:28.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.985+0000 7ffb43400640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffb34036000 tx=0x7ffb3403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:28.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:28.988+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ffb3c022030 con 0x7ffb44152dc0 2024-03-07T10:21:29.307 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.306+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb440c7380 con 0x7ffb44152dc0 2024-03-07T10:21:29.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.307+0000 7ffb3b400640 1 -- 172.21.15.194:0/959046147 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7ffb3c010040 con 0x7ffb44152dc0 2024-03-07T10:21:29.309 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:29.309 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:29.309 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:29.311 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 msgr2=0x7ffb2006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 0x7ffb2006d990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffb34036000 tx=0x7ffb3403c040 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 msgr2=0x7ffb44151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00efc0 tx=0x7ffb3c00c490 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 shutdown_connections 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ffb2006b4d0 0x7ffb2006d990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb44152dc0 0x7ffb44151720 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ffb440c7d40 0x7ffb440ac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 --2- 172.21.15.194:0/959046147 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ffb440c6250 0x7ffb441ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 >> 172.21.15.194:0/959046147 conn(0x7ffb440c8fc0 msgr2=0x7ffb4406db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 shutdown_connections 2024-03-07T10:21:29.312 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.310+0000 7ffb4a600640 1 -- 172.21.15.194:0/959046147 wait complete. 2024-03-07T10:21:29.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-07T10:20:57.593298+0000', 'modified': '2024-03-07T10:21:01.661187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4266}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4266': {'gid': 4266, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.196:6835/1848630458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.196:6834', 'nonce': 1848630458}, {'type': 'v1', 'addr': '172.21.15.196:6835', 'nonce': 1848630458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4266, 'qdb_cluster': [4266]} 2024-03-07T10:21:29.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-07T10:21:29.731 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-07T10:21:29.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.937+0000 7f0855600640 1 Processor -- start 2024-03-07T10:21:29.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.937+0000 7f0855600640 1 -- start start 2024-03-07T10:21:29.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.938+0000 7f0855600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0850148f40 0x7f08501539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f0855600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0850156200 0x7f0850153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f0855600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0850156640 con 0x7f08500c19c0 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f0855600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0850073240 con 0x7f0850148f40 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f0855600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085006e000 con 0x7f0850156200 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0850148f40 0x7f08501539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0850148f40 0x7f08501539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60724/0 (socket says 172.21.15.194:60724) 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 -- 172.21.15.194:0/1268012174 learned_addr learned my addr 172.21.15.194:0/1268012174 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 -- 172.21.15.194:0/1268012174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0850156200 msgr2=0x7f0850153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 --2- 172.21.15.194:0/1268012174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0850156200 0x7f0850153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 -- 172.21.15.194:0/1268012174 >> v1:172.21.15.196:6789/0 conn(0x7f08500c19c0 legacy=0x7f0850155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.939+0000 7f084ea00640 1 -- 172.21.15.194:0/1268012174 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08501568e0 con 0x7f0850148f40 2024-03-07T10:21:29.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.940+0000 7f084ea00640 1 --2- 172.21.15.194:0/1268012174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850148f40 0x7f08501539f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ea495a7744dba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.940+0000 7f084e000640 1 -- 172.21.15.194:0/1268012174 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840035020 con 0x7f0850148f40 2024-03-07T10:21:29.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.940+0000 7f084e000640 1 -- 172.21.15.194:0/1268012174 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840031640 con 0x7f0850148f40 2024-03-07T10:21:29.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.940+0000 7f084e000640 1 -- 172.21.15.194:0/1268012174 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084002d040 con 0x7f0850148f40 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 -- 172.21.15.194:0/1268012174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850148f40 msgr2=0x7f08501539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 --2- 172.21.15.194:0/1268012174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850148f40 0x7f08501539f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0840009870 tx=0x7f084002b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 -- 172.21.15.194:0/1268012174 shutdown_connections 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 --2- 172.21.15.194:0/1268012174 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0850156200 0x7f0850153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 --2- 172.21.15.194:0/1268012174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850148f40 0x7f08501539f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 -- 172.21.15.194:0/1268012174 >> 172.21.15.194:0/1268012174 conn(0x7f085006b840 msgr2=0x7f08500c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 -- 172.21.15.194:0/1268012174 shutdown_connections 2024-03-07T10:21:29.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.941+0000 7f0855600640 1 -- 172.21.15.194:0/1268012174 wait complete. 2024-03-07T10:21:29.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.943+0000 7f0855600640 1 Processor -- start 2024-03-07T10:21:29.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.943+0000 7f0855600640 1 -- start start 2024-03-07T10:21:29.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08500c19c0 0x7f085014cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 0x7f08500c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085006dc90 con 0x7f0850156200 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085006d9b0 con 0x7f0850148f40 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0855600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0850149320 con 0x7f08500c19c0 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60730/0 (socket says 172.21.15.194:60730) 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 -- 172.21.15.194:0/1608170196 learned_addr learned my addr 172.21.15.194:0/1608170196 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084ea00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08500c19c0 0x7f085014cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0847e00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 0x7f08500c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 -- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08500c19c0 msgr2=0x7f085014cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08500c19c0 0x7f085014cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 -- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 msgr2=0x7f08500c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 0x7f08500c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f084f400640 1 -- 172.21.15.194:0/1608170196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08501ec9d0 con 0x7f0850156200 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.944+0000 7f0847e00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 0x7f08500c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f084f400640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f084800b970 tx=0x7f084800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f0846a00640 1 -- 172.21.15.194:0/1608170196 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848019070 con 0x7f0850156200 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f0846a00640 1 -- 172.21.15.194:0/1608170196 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800cb60 con 0x7f0850156200 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f0846a00640 1 -- 172.21.15.194:0/1608170196 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848014440 con 0x7f0850156200 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08501eccb0 con 0x7f0850156200 2024-03-07T10:21:29.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.945+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08501ed270 con 0x7f0850156200 2024-03-07T10:21:29.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.948+0000 7f0846a00640 1 -- 172.21.15.194:0/1608170196 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f084801c070 con 0x7f0850156200 2024-03-07T10:21:29.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.949+0000 7f0858568740 1 Processor -- start 2024-03-07T10:21:29.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.949+0000 7f0858568740 1 -- start start 2024-03-07T10:21:29.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0846a00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 0x7f082c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0846a00640 1 -- 172.21.15.194:0/1608170196 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f084808a1e0 con 0x7f0850156200 2024-03-07T10:21:29.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a40c0 0x559f3b7df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b79d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b7076c0 con 0x559f3b79ea30 2024-03-07T10:21:29.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b6b09b0 con 0x559f3b7a3200 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f3b703760 con 0x559f3b7a40c0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f0847e00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 0x7f082c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.950+0000 7f084ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60734/0 (socket says 172.21.15.194:60734) 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 -- 172.21.15.194:0/1701595115 learned_addr learned my addr 172.21.15.194:0/1701595115 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f0847e00640 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a40c0 0x559f3b7df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084f400640 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b79d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 -- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a40c0 msgr2=0x559f3b7df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a40c0 0x559f3b7df240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 -- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 msgr2=0x559f3b79d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b79d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 -- 172.21.15.194:0/1701595115 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f3b6a46f0 con 0x559f3b79ea30 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.951+0000 7f084ea00640 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f0840008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71180623fc3fae3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f083f000640 1 -- 172.21.15.194:0/1701595115 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840031a80 con 0x559f3b79ea30 2024-03-07T10:21:29.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f083f000640 1 -- 172.21.15.194:0/1701595115 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840049070 con 0x559f3b79ea30 2024-03-07T10:21:29.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f083f000640 1 -- 172.21.15.194:0/1701595115 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840031e20 con 0x559f3b79ea30 2024-03-07T10:21:29.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0847e00640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 0x7f082c06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x559f3b79f480 tx=0x7f083800a320 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 -- 172.21.15.194:0/1701595115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 msgr2=0x559f3b7ded00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0840000c00 tx=0x7f0840008030 comp rx=0 tx=0).stop 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 -- 172.21.15.194:0/1701595115 shutdown_connections 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b79d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a40c0 0x559f3b7df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 --2- 172.21.15.194:0/1701595115 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b79ea30 0x559f3b7ded00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 -- 172.21.15.194:0/1701595115 >> 172.21.15.194:0/1701595115 conn(0x559f3b79f700 msgr2=0x559f3b7c4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 -- 172.21.15.194:0/1701595115 shutdown_connections 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.952+0000 7f0858568740 1 -- 172.21.15.194:0/1701595115 wait complete. 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.953+0000 7f0858568740 1 -- start start 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.953+0000 7f0858568740 1 Processor -- start 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b7e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 0x559f3b7c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b79ee10 con 0x559f3b7a40c0 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b6c3df0 con 0x559f3b7a3200 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f3b7dea10 con 0x559f3b7db600 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0858568740 10 client.0 _ll_register_callbacks cb 0x559f3b6fe8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0847e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0847e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60746/0 (socket says 172.21.15.194:60746) 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.954+0000 7f0847e00640 1 -- 172.21.15.194:0/1152329229 learned_addr learned my addr 172.21.15.194:0/1152329229 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f084ea00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b7e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f084f400640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 0x559f3b7c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 -- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 msgr2=0x559f3b7c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 0x559f3b7c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 -- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 msgr2=0x559f3b7e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b7e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 -- 172.21.15.194:0/1152329229 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f3b41c2d0 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f084f400640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 0x559f3b7c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0847e00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08380166b0 tx=0x7f08380046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6d6c75d6226cfb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0833400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838026060 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mon.0 v2:172.21.15.194:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0838013830 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.955+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0840049070 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f083802c050 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 10 client.4797 fetch_fsmap learned FSMap version 15 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x559f3b4e66b0 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mon.0 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0840049070 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mon.0 v2:172.21.15.194:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f0838015070 con 0x559f3b7a40c0 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 10 client.4797 fetch_fsmap finished waiting for FSMap version 15 2024-03-07T10:21:29.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 10 client.4797 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 20 client.4797 populate_metadata read hostname 'smithi194' 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b7c4290 0x559f3b7d91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 4 client.4797 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.956+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 --> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f3b714c00 con 0x559f3b7c4290 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.957+0000 7f084ea00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b7c4290 0x559f3b7d91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.957+0000 7f084ea00640 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b7c4290 0x559f3b7d91f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27413b62ba3f3d89 server_cookie=a5b7c359f0183d31 in_seq=0 out_seq=0 2024-03-07T10:21:29.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.957+0000 7f0833400640 10 client.4797 ms_handle_connect on v2:172.21.15.196:6834/1848630458 2024-03-07T10:21:29.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.959+0000 7f0833400640 1 -- 172.21.15.194:0/1152329229 <== mds.0 v2:172.21.15.196:6834/1848630458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x559f3b714c00 con 0x559f3b7c4290 2024-03-07T10:21:29.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.959+0000 7f0833400640 10 client.4797 handle_command_reply: tid=0 2024-03-07T10:21:29.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 client.4797 shutdown 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 msgr2=0x559f3b7f38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f08380166b0 tx=0x7f08380046f0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 shutdown_connections 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7db600 0x559f3b7c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b7c4290 0x559f3b7d91f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7f38e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 --2- 172.21.15.194:0/1152329229 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a3200 0x559f3b7e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 >> 172.21.15.194:0/1152329229 conn(0x559f3b79ea30 msgr2=0x559f3b79d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0833400640 0 client.4797 ms_handle_reset on v2:172.21.15.196:6834/1848630458 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 shutdown_connections 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 1 -- 172.21.15.194:0/1152329229 wait complete. 2024-03-07T10:21:29.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.960+0000 7f0858568740 20 client.4797 trim_cache size 0 max 16384 2024-03-07T10:21:29.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.977+0000 7f0858568740 1 Processor -- start 2024-03-07T10:21:29.979 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.977+0000 7f0858568740 1 -- start start 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7dd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7db600 0x559f3b7dec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08501f6a10 con 0x559f3b7a40c0 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08500abed0 con 0x559f3b7db600 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08501f4ed0 con 0x559f3b7a3200 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0847e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0847e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60760/0 (socket says 172.21.15.194:60760) 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f0847e00640 1 -- 172.21.15.194:0/3811407056 learned_addr learned my addr 172.21.15.194:0/3811407056 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.978+0000 7f084ea00640 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7dd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 -- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 msgr2=0x559f3b7dd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7dd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 -- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7db600 msgr2=0x559f3b7dec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7db600 0x559f3b7dec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 -- 172.21.15.194:0/3811407056 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f3b7a3ba0 con 0x559f3b7a40c0 2024-03-07T10:21:29.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f0847e00640 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0838008010 tx=0x7f083801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfdd12b59690d9f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f083e600640 1 -- 172.21.15.194:0/3811407056 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0838035070 con 0x559f3b7a40c0 2024-03-07T10:21:29.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f083e600640 1 -- 172.21.15.194:0/3811407056 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838013630 con 0x559f3b7a40c0 2024-03-07T10:21:29.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.979+0000 7f083e600640 1 -- 172.21.15.194:0/3811407056 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083800f040 con 0x559f3b7a40c0 2024-03-07T10:21:29.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- 172.21.15.194:0/3811407056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 msgr2=0x559f3b7de730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0838008010 tx=0x7f083801e000 comp rx=0 tx=0).stop 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- 172.21.15.194:0/3811407056 shutdown_connections 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7db600 0x559f3b7dec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7a40c0 0x559f3b7de730 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 --2- 172.21.15.194:0/3811407056 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7dd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- 172.21.15.194:0/3811407056 >> 172.21.15.194:0/3811407056 conn(0x559f3b79ea30 msgr2=0x559f3b7e63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- 172.21.15.194:0/3811407056 shutdown_connections 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- 172.21.15.194:0/3811407056 wait complete. 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 -- start start 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.980+0000 7f0858568740 1 Processor -- start 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7deb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 0x559f3b7fd290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b7f3e20 con 0x559f3b7db600 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f3b7f7860 con 0x559f3b7a40c0 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x559f3b7dc140 con 0x559f3b7a3200 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.981+0000 7f0858568740 10 client.0 _ll_register_callbacks cb 0x7f083800a5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60776/0 (socket says 172.21.15.194:60776) 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 -- 172.21.15.194:0/2788479786 learned_addr learned my addr 172.21.15.194:0/2788479786 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084ea00640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0847e00640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 0x559f3b7fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 -- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 msgr2=0x559f3b7deb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7deb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 -- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 msgr2=0x559f3b7fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 0x559f3b7fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 -- 172.21.15.194:0/2788479786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559f3b8080f0 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0847e00640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 0x559f3b7fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f084f400640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08480583c0 tx=0x7f0848058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb131f2fdc7f60f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0833400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848060dd0 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mon.0 v2:172.21.15.194:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0848060940 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.982+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0838013630 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0848088050 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 10 client.4803 fetch_fsmap learned FSMap version 15 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x559f3b7df5e0 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mon.0 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0838013630 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mon.0 v2:172.21.15.194:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f0848057b10 con 0x559f3b7db600 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 10 client.4803 fetch_fsmap finished waiting for FSMap version 15 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 10 client.4803 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-07T10:21:29.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 20 client.4803 populate_metadata read hostname 'smithi194' 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b8506b0 0x559f3b850a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 4 client.4803 mds_command: new command op to 4266 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.983+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 --> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f3b7f70d0 con 0x559f3b8506b0 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.984+0000 7f084ea00640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b8506b0 0x559f3b850a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.984+0000 7f084ea00640 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b8506b0 0x559f3b850a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbfbf221c3be31d8 server_cookie=d57161afb7c6b84e in_seq=0 out_seq=0 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.984+0000 7f0833400640 10 client.4803 ms_handle_connect on v2:172.21.15.196:6834/1848630458 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0833400640 1 -- 172.21.15.194:0/2788479786 <== mds.0 v2:172.21.15.196:6834/1848630458 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559f3b7f70d0 con 0x559f3b8506b0 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0833400640 10 client.4803 handle_command_reply: tid=0 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 client.4803 shutdown 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 msgr2=0x559f3b7fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08480583c0 tx=0x7f0848058f00 comp rx=0 tx=0).stop 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 shutdown_connections 2024-03-07T10:21:29.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:6834/1848630458,v1:172.21.15.196:6835/1848630458] conn(0x559f3b8506b0 0x559f3b850a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x559f3b7db600 0x559f3b7fc710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0833400640 0 client.4803 ms_handle_reset on v2:172.21.15.196:6834/1848630458 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x559f3b7a40c0 0x559f3b7fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 --2- 172.21.15.194:0/2788479786 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x559f3b7a3200 0x559f3b7deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 >> 172.21.15.194:0/2788479786 conn(0x559f3b79ea30 msgr2=0x559f3b79c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 shutdown_connections 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 1 -- 172.21.15.194:0/2788479786 wait complete. 2024-03-07T10:21:29.992 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.985+0000 7f0858568740 20 client.4803 trim_cache size 0 max 16384 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "cluster_fsid": "4f04f9a7-36ed-4153-a852-b0f479c9f76c", 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "whoami": 0, 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 4266, 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "want_state": "up:active", 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "state": "up:active", 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "a", 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "rank_uptime": 31.836934188000001, 2024-03-07T10:21:29.993 INFO:teuthology.orchestra.run.smithi194.stdout: "mdsmap_epoch": 9, 2024-03-07T10:21:29.994 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_epoch": 24, 2024-03-07T10:21:29.994 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_epoch_barrier": 20, 2024-03-07T10:21:29.994 INFO:teuthology.orchestra.run.smithi194.stdout: "uptime": 37.072514822000002 2024-03-07T10:21:29.994 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:21:29.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 msgr2=0x7f082c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 0x7f082c06d990 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x559f3b79f480 tx=0x7f083800a320 comp rx=0 tx=0).stop 2024-03-07T10:21:29.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 msgr2=0x7f08501e9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:29.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f084800b970 tx=0x7f084800be30 comp rx=0 tx=0).stop 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 shutdown_connections 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f082c06b4d0 0x7f082c06d990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0850156200 0x7f08501e9480 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0850148f40 0x7f08500c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 --2- 172.21.15.194:0/1608170196 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f08500c19c0 0x7f085014cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 >> 172.21.15.194:0/1608170196 conn(0x7f085006b840 msgr2=0x7f08500c2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 shutdown_connections 2024-03-07T10:21:29.996 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:29.986+0000 7f0855600640 1 -- 172.21.15.194:0/1608170196 wait complete. 2024-03-07T10:21:30.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:30.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.199+0000 7ff24ae00640 1 Processor -- start 2024-03-07T10:21:30.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.200+0000 7ff24ae00640 1 -- start start 2024-03-07T10:21:30.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff24ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244150b70 0x7ff2440a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff24ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2440a9a10 0x7ff24406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff24ae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff244153980 con 0x7ff244156c20 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff24ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff24406e550 con 0x7ff2440a9a10 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff24ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff244153c60 con 0x7ff244150b70 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff23be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff244156c20 0x7ff24406d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38204/0 (socket says 172.21.15.194:38204) 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.201+0000 7ff23be00640 1 -- 172.21.15.194:0/205497705 learned_addr learned my addr 172.21.15.194:0/205497705 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff248e00640 1 --2- 172.21.15.194:0/205497705 >> v2:172.21.15.194:3300/0 conn(0x7ff2440a9a10 0x7ff24406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff243e00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244150b70 0x7ff2440a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff243400640 1 -- 172.21.15.194:0/205497705 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466077981 0 0) 0x7ff244153980 con 0x7ff244156c20 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff243400640 1 -- 172.21.15.194:0/205497705 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff228003520 con 0x7ff244156c20 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff248e00640 1 -- 172.21.15.194:0/205497705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244150b70 msgr2=0x7ff2440a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff248e00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244150b70 0x7ff2440a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff248e00640 1 -- 172.21.15.194:0/205497705 >> v1:172.21.15.194:6789/0 conn(0x7ff244156c20 legacy=0x7ff24406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.202+0000 7ff248e00640 1 -- 172.21.15.194:0/205497705 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244153f40 con 0x7ff2440a9a10 2024-03-07T10:21:30.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.204+0000 7ff248e00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2440a9a10 0x7ff24406e010 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009d90 tx=0x7ff23c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f59966627ddb801 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.204+0000 7ff243400640 1 -- 172.21.15.194:0/205497705 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c039070 con 0x7ff2440a9a10 2024-03-07T10:21:30.206 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.204+0000 7ff243400640 1 -- 172.21.15.194:0/205497705 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23c02cbc0 con 0x7ff2440a9a10 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.204+0000 7ff243400640 1 -- 172.21.15.194:0/205497705 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c034440 con 0x7ff2440a9a10 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 -- 172.21.15.194:0/205497705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2440a9a10 msgr2=0x7ff24406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2440a9a10 0x7ff24406e010 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009d90 tx=0x7ff23c02be10 comp rx=0 tx=0).stop 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 -- 172.21.15.194:0/205497705 shutdown_connections 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2440a9a10 0x7ff24406e010 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 --2- 172.21.15.194:0/205497705 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244150b70 0x7ff2440a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 -- 172.21.15.194:0/205497705 >> 172.21.15.194:0/205497705 conn(0x7ff24406b840 msgr2=0x7ff2440c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 -- 172.21.15.194:0/205497705 shutdown_connections 2024-03-07T10:21:30.207 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.205+0000 7ff24ae00640 1 -- 172.21.15.194:0/205497705 wait complete. 2024-03-07T10:21:30.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.206+0000 7ff24ae00640 1 Processor -- start 2024-03-07T10:21:30.208 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.206+0000 7ff24ae00640 1 -- start start 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2440a9a10 0x7ff244152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 0x7ff2441eef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff244153630 con 0x7ff244150b70 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440c7a30 con 0x7ff2440a9a10 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff24ae00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2440ac460 con 0x7ff244156c20 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.207+0000 7ff23be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60800/0 (socket says 172.21.15.194:60800) 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 -- 172.21.15.194:0/1710292479 learned_addr learned my addr 172.21.15.194:0/1710292479 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:30.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff248e00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 0x7ff2441eef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff243e00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2440a9a10 0x7ff244152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 -- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 msgr2=0x7ff2441eef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 0x7ff2441eef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 -- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2440a9a10 msgr2=0x7ff244152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2440a9a10 0x7ff244152930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 -- 172.21.15.194:0/1710292479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244072610 con 0x7ff244150b70 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff248e00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 0x7ff2441eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff23be00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c390 tx=0x7ff22c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c017070 con 0x7ff244150b70 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c005ce0 con 0x7ff244150b70 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c0072f0 con 0x7ff244150b70 2024-03-07T10:21:30.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.208+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2440728f0 con 0x7ff244150b70 2024-03-07T10:21:30.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.209+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff244152e70 con 0x7ff244150b70 2024-03-07T10:21:30.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.210+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff244068170 con 0x7ff244150b70 2024-03-07T10:21:30.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.211+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff22c01a070 con 0x7ff244150b70 2024-03-07T10:21:30.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.211+0000 7ff240c00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 0x7ff22006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.211+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff22c0898e0 con 0x7ff244150b70 2024-03-07T10:21:30.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.212+0000 7ff243e00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 0x7ff22006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.213+0000 7ff243e00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 0x7ff22006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff234009970 tx=0x7ff234008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.216+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff22c058420 con 0x7ff244150b70 2024-03-07T10:21:30.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.413+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff24406cd20 con 0x7ff244150b70 2024-03-07T10:21:30.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.416+0000 7ff240c00640 1 -- 172.21.15.194:0/1710292479 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7ff22c057d20 con 0x7ff244150b70 2024-03-07T10:21:30.418 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:30.418 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:30.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.418+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 msgr2=0x7ff22006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.418+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 0x7ff22006d990 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff234009970 tx=0x7ff234008040 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.418+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 msgr2=0x7ff2441ee9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.418+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00c390 tx=0x7ff22c00c850 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 shutdown_connections 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff22006b4d0 0x7ff22006d990 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff244156c20 0x7ff2441eef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff244150b70 0x7ff2441ee9c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 --2- 172.21.15.194:0/1710292479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff2440a9a10 0x7ff244152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 >> 172.21.15.194:0/1710292479 conn(0x7ff24406b840 msgr2=0x7ff24414dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:30.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 shutdown_connections 2024-03-07T10:21:30.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.419+0000 7ff24ae00640 1 -- 172.21.15.194:0/1710292479 wait complete. 2024-03-07T10:21:30.440 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:30.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:30.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.643+0000 7f22e2c00640 1 Processor -- start 2024-03-07T10:21:30.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.643+0000 7f22e2c00640 1 -- start start 2024-03-07T10:21:30.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e2c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f22dc159020 0x7f22dc1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e2c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22dc1599f0 con 0x7f22dc14f7c0 2024-03-07T10:21:30.646 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e2c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22dc155b30 con 0x7f22dc159020 2024-03-07T10:21:30.647 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc155e10 con 0x7f22dc0c8d90 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e0e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e0e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:54608/0 (socket says 172.21.15.194:54608) 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.645+0000 7f22e0e00640 1 -- 172.21.15.194:0/752500594 learned_addr learned my addr 172.21.15.194:0/752500594 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.646+0000 7f22e2200640 1 --2- 172.21.15.194:0/752500594 >> v2:172.21.15.196:3300/0 conn(0x7f22dc159020 0x7f22dc1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.646+0000 7f22e0e00640 1 -- 172.21.15.194:0/752500594 >> v2:172.21.15.196:3300/0 conn(0x7f22dc159020 msgr2=0x7f22dc1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.646+0000 7f22e0e00640 1 --2- 172.21.15.194:0/752500594 >> v2:172.21.15.196:3300/0 conn(0x7f22dc159020 0x7f22dc1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.646+0000 7f22e0e00640 1 -- 172.21.15.194:0/752500594 >> v1:172.21.15.196:6789/0 conn(0x7f22dc14f7c0 legacy=0x7f22dc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.646+0000 7f22e0e00640 1 -- 172.21.15.194:0/752500594 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc1560f0 con 0x7f22dc0c8d90 2024-03-07T10:21:30.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.647+0000 7f22e0e00640 1 --2- 172.21.15.194:0/752500594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a93e4435c91f6c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.648+0000 7f22dbe00640 1 -- 172.21.15.194:0/752500594 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8035020 con 0x7f22dc0c8d90 2024-03-07T10:21:30.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.648+0000 7f22dbe00640 1 -- 172.21.15.194:0/752500594 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8031640 con 0x7f22dc0c8d90 2024-03-07T10:21:30.649 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.648+0000 7f22dbe00640 1 -- 172.21.15.194:0/752500594 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c802d040 con 0x7f22dc0c8d90 2024-03-07T10:21:30.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.648+0000 7f22e2c00640 1 -- 172.21.15.194:0/752500594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 msgr2=0x7f22dc155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.648+0000 7f22e2c00640 1 --2- 172.21.15.194:0/752500594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f22c8009870 tx=0x7f22c802b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 -- 172.21.15.194:0/752500594 shutdown_connections 2024-03-07T10:21:30.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 --2- 172.21.15.194:0/752500594 >> v2:172.21.15.196:3300/0 conn(0x7f22dc159020 0x7f22dc1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 --2- 172.21.15.194:0/752500594 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc155550 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 -- 172.21.15.194:0/752500594 >> 172.21.15.194:0/752500594 conn(0x7f22dc06b4a0 msgr2=0x7f22dc06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:30.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 -- 172.21.15.194:0/752500594 shutdown_connections 2024-03-07T10:21:30.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.649+0000 7f22e2c00640 1 -- 172.21.15.194:0/752500594 wait complete. 2024-03-07T10:21:30.652 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.651+0000 7f22e2c00640 1 Processor -- start 2024-03-07T10:21:30.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.652+0000 7f22e2c00640 1 -- start start 2024-03-07T10:21:30.655 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc1ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22dc14f7c0 0x7f22dc0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc072890 con 0x7f22dc159020 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c9740 con 0x7f22dc14f7c0 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc0c5f20 con 0x7f22dc0c8d90 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60814/0 (socket says 172.21.15.194:60814) 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.653+0000 7f22e2200640 1 -- 172.21.15.194:0/3107932954 learned_addr learned my addr 172.21.15.194:0/3107932954 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:30.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e1800640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc1ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e0e00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22dc14f7c0 0x7f22dc0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 -- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 msgr2=0x7f22dc1ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc1ee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 -- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22dc14f7c0 msgr2=0x7f22dc0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22dc14f7c0 0x7f22dc0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 -- 172.21.15.194:0/3107932954 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc1ef220 con 0x7f22dc159020 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e1800640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc1ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:30.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.654+0000 7f22e2200640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f22d400efc0 tx=0x7f22d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.655+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4018020 con 0x7f22dc159020 2024-03-07T10:21:30.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.655+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d4014480 con 0x7f22dc159020 2024-03-07T10:21:30.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.655+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc1ef500 con 0x7f22dc159020 2024-03-07T10:21:30.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.655+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d4014870 con 0x7f22dc159020 2024-03-07T10:21:30.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.655+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc1eef20 con 0x7f22dc159020 2024-03-07T10:21:30.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.656+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc075600 con 0x7f22dc159020 2024-03-07T10:21:30.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.658+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f22d4005d10 con 0x7f22dc159020 2024-03-07T10:21:30.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.659+0000 7f22d9600640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 0x7f22bc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:30.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.659+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f22d408b450 con 0x7f22dc159020 2024-03-07T10:21:30.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.660+0000 7f22e1800640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 0x7f22bc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:30.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.661+0000 7f22e1800640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 0x7f22bc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001660 tx=0x7f22d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:30.665 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.664+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f22d4022030 con 0x7f22dc159020 2024-03-07T10:21:30.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.862+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22dc072590 con 0x7f22dc159020 2024-03-07T10:21:30.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.863+0000 7f22d9600640 1 -- 172.21.15.194:0/3107932954 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22d4010040 con 0x7f22dc159020 2024-03-07T10:21:30.864 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:30.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.865+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 msgr2=0x7f22bc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.865+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 0x7f22bc06d990 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001660 tx=0x7f22d0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.865+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 msgr2=0x7f22dc0c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.865+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f22d400efc0 tx=0x7f22d400c490 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 shutdown_connections 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f22bc06b4d0 0x7f22bc06d990 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22dc159020 0x7f22dc0c3d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22dc14f7c0 0x7f22dc0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 --2- 172.21.15.194:0/3107932954 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22dc0c8d90 0x7f22dc1ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 >> 172.21.15.194:0/3107932954 conn(0x7f22dc06b4a0 msgr2=0x7f22dc152ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 shutdown_connections 2024-03-07T10:21:30.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:30.866+0000 7f22e2c00640 1 -- 172.21.15.194:0/3107932954 wait complete. 2024-03-07T10:21:30.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:31.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.081+0000 7f0f3be00640 1 Processor -- start 2024-03-07T10:21:31.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.081+0000 7f0f3be00640 1 -- start start 2024-03-07T10:21:31.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f3be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f3c0c8d90 0x7f0f3c155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 0x7f0f3c1594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f3be00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c1599f0 con 0x7f0f3c14f7c0 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f3be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c155b30 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f3be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c155e10 con 0x7f0f3c159020 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.082+0000 7f0f33e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f3c0c8d90 0x7f0f3c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f3c0c8d90 0x7f0f3c155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60816/0 (socket says 172.21.15.194:60816) 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 -- 172.21.15.194:0/3729026765 learned_addr learned my addr 172.21.15.194:0/3729026765 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f3b400640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 0x7f0f3c1594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 -- 172.21.15.194:0/3729026765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 msgr2=0x7f0f3c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 0x7f0f3c1594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 -- 172.21.15.194:0/3729026765 >> v1:172.21.15.196:6789/0 conn(0x7f0f3c14f7c0 legacy=0x7f0f3c0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f33e00640 1 -- 172.21.15.194:0/3729026765 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c1560f0 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.083+0000 7f0f3b400640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 0x7f0f3c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:31.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.084+0000 7f0f33e00640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c155550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a215b164f40e67ff server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.084+0000 7f0f3a000640 1 -- 172.21.15.194:0/3729026765 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24035020 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.084+0000 7f0f3a000640 1 -- 172.21.15.194:0/3729026765 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24031640 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.084+0000 7f0f3a000640 1 -- 172.21.15.194:0/3729026765 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2402d040 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 -- 172.21.15.194:0/3729026765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c0c8d90 msgr2=0x7f0f3c155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c155550 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009870 tx=0x7f0f2402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 -- 172.21.15.194:0/3729026765 shutdown_connections 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c159020 0x7f0f3c1594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 --2- 172.21.15.194:0/3729026765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c155550 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 -- 172.21.15.194:0/3729026765 >> 172.21.15.194:0/3729026765 conn(0x7f0f3c06b4a0 msgr2=0x7f0f3c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 -- 172.21.15.194:0/3729026765 shutdown_connections 2024-03-07T10:21:31.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.085+0000 7f0f3be00640 1 -- 172.21.15.194:0/3729026765 wait complete. 2024-03-07T10:21:31.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.087+0000 7f0f3be00640 1 Processor -- start 2024-03-07T10:21:31.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.087+0000 7f0f3be00640 1 -- start start 2024-03-07T10:21:31.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c1582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 0x7f0f3c1eb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c072890 con 0x7f0f3c159020 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0c9740 con 0x7f0f3c0c8d90 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3be00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0c5f20 con 0x7f0f3c14f7c0 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60818/0 (socket says 172.21.15.194:60818) 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3b400640 1 -- 172.21.15.194:0/2473992004 learned_addr learned my addr 172.21.15.194:0/2473992004 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f3aa00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c1582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.088+0000 7f0f33e00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 0x7f0f3c1eb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 -- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 msgr2=0x7f0f3c1eb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 0x7f0f3c1eb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 -- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f3c0c8d90 msgr2=0x7f0f3c1582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c1582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 -- 172.21.15.194:0/2473992004 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c1ee720 con 0x7f0f3c159020 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f33e00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 0x7f0f3c1eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3b400640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400cd80 tx=0x7f0f3400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400f680 con 0x7f0f3c159020 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3400f840 con 0x7f0f3c159020 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400fc30 con 0x7f0f3c159020 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.089+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c1eea00 con 0x7f0f3c159020 2024-03-07T10:21:31.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.090+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c1eefc0 con 0x7f0f3c159020 2024-03-07T10:21:31.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.091+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c075600 con 0x7f0f3c159020 2024-03-07T10:21:31.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.092+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0f3400e3e0 con 0x7f0f3c159020 2024-03-07T10:21:31.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.093+0000 7f0f32a00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 0x7f0f1806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.093+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0f3408b1b0 con 0x7f0f3c159020 2024-03-07T10:21:31.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.094+0000 7f0f3aa00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 0x7f0f1806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.095+0000 7f0f3aa00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 0x7f0f1806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0016e0 tx=0x7f0f2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.098+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0f34014030 con 0x7f0f3c159020 2024-03-07T10:21:31.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.293+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f3c072590 con 0x7f0f3c159020 2024-03-07T10:21:31.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.294+0000 7f0f32a00640 1 -- 172.21.15.194:0/2473992004 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f0f34059d90 con 0x7f0f3c159020 2024-03-07T10:21:31.295 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:31.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 msgr2=0x7f0f1806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 0x7f0f1806d9c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0016e0 tx=0x7f0f2c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:31.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 msgr2=0x7f0f3c1eb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400cd80 tx=0x7f0f3400a650 comp rx=0 tx=0).stop 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 shutdown_connections 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0f1806b500 0x7f0f1806d9c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.296+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f3c159020 0x7f0f3c1eb710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.297+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0f3c14f7c0 0x7f0f3c1eb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.297+0000 7f0f3be00640 1 --2- 172.21.15.194:0/2473992004 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0f3c0c8d90 0x7f0f3c1582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.297+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 >> 172.21.15.194:0/2473992004 conn(0x7f0f3c06b4a0 msgr2=0x7f0f3c06b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.297+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 shutdown_connections 2024-03-07T10:21:31.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.297+0000 7f0f3be00640 1 -- 172.21.15.194:0/2473992004 wait complete. 2024-03-07T10:21:31.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:31.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.514+0000 7f61e0a00640 1 Processor -- start 2024-03-07T10:21:31.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.514+0000 7f61e0a00640 1 -- start start 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61e0a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61dc152e60 0x7f61dc155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61e0a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61dc155b90 con 0x7f61dc0c5da0 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61e0a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61dc0c8490 con 0x7f61dc152e60 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61e0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c6910 con 0x7f61dc0ad420 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61db400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61dc152e60 0x7f61dc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61db400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61dc152e60 0x7f61dc155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60830/0 (socket says 172.21.15.194:60830) 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.516+0000 7f61db400640 1 -- 172.21.15.194:0/3781232635 learned_addr learned my addr 172.21.15.194:0/3781232635 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.517+0000 7f61db400640 1 -- 172.21.15.194:0/3781232635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 msgr2=0x7f61dc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.517+0000 7f61db400640 1 --2- 172.21.15.194:0/3781232635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.517+0000 7f61db400640 1 -- 172.21.15.194:0/3781232635 >> v1:172.21.15.196:6789/0 conn(0x7f61dc0c5da0 legacy=0x7f61dc1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.517+0000 7f61db400640 1 -- 172.21.15.194:0/3781232635 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc158dc0 con 0x7f61dc152e60 2024-03-07T10:21:31.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.518+0000 7f61db400640 1 --2- 172.21.15.194:0/3781232635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc155650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009870 tx=0x7f61cc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba930227a89be422 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.519+0000 7f61da000640 1 -- 172.21.15.194:0/3781232635 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0317c0 con 0x7f61dc152e60 2024-03-07T10:21:31.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.519+0000 7f61da000640 1 -- 172.21.15.194:0/3781232635 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc037070 con 0x7f61dc152e60 2024-03-07T10:21:31.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.519+0000 7f61da000640 1 -- 172.21.15.194:0/3781232635 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc031b80 con 0x7f61dc152e60 2024-03-07T10:21:31.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 -- 172.21.15.194:0/3781232635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 msgr2=0x7f61dc155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 --2- 172.21.15.194:0/3781232635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc155650 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61cc009870 tx=0x7f61cc02b860 comp rx=0 tx=0).stop 2024-03-07T10:21:31.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 -- 172.21.15.194:0/3781232635 shutdown_connections 2024-03-07T10:21:31.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 --2- 172.21.15.194:0/3781232635 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 --2- 172.21.15.194:0/3781232635 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc155650 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 -- 172.21.15.194:0/3781232635 >> 172.21.15.194:0/3781232635 conn(0x7f61dc06b6b0 msgr2=0x7f61dc0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:31.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 -- 172.21.15.194:0/3781232635 shutdown_connections 2024-03-07T10:21:31.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.520+0000 7f61e0a00640 1 -- 172.21.15.194:0/3781232635 wait complete. 2024-03-07T10:21:31.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.522+0000 7f61e0a00640 1 Processor -- start 2024-03-07T10:21:31.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.522+0000 7f61e0a00640 1 -- start start 2024-03-07T10:21:31.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc1ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc0c5da0 0x7f61dc1ec020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc1563f0 con 0x7f61dc152e60 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc156110 con 0x7f61dc0c5da0 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61e0a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61dc0c9000 con 0x7f61dc0ad420 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60842/0 (socket says 172.21.15.194:60842) 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61dbe00640 1 -- 172.21.15.194:0/899166219 learned_addr learned my addr 172.21.15.194:0/899166219 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61db400640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc1ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.524+0000 7f61daa00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc0c5da0 0x7f61dc1ec020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 -- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 msgr2=0x7f61dc1ef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc1ef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 -- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc0c5da0 msgr2=0x7f61dc1ec020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc0c5da0 0x7f61dc1ec020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 -- 172.21.15.194:0/899166219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61dc1ec560 con 0x7f61dc152e60 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61dbe00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c780 tx=0x7f61d400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d4004b60 con 0x7f61dc152e60 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4004d00 con 0x7f61dc152e60 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61dc0ac3f0 con 0x7f61dc152e60 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d400aa90 con 0x7f61dc152e60 2024-03-07T10:21:31.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.525+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61dc1eede0 con 0x7f61dc152e60 2024-03-07T10:21:31.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.527+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61dc075600 con 0x7f61dc152e60 2024-03-07T10:21:31.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.527+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f61d400ac30 con 0x7f61dc152e60 2024-03-07T10:21:31.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.529+0000 7f61d3400640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 0x7f61bc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:31.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.529+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f61d408a750 con 0x7f61dc152e60 2024-03-07T10:21:31.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.529+0000 7f61db400640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 0x7f61bc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:31.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.530+0000 7f61db400640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 0x7f61bc06d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:31.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.536+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f61d4020070 con 0x7f61dc152e60 2024-03-07T10:21:31.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.776+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f61dc0b0e60 con 0x7f61dc152e60 2024-03-07T10:21:31.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.777+0000 7f61d3400640 1 -- 172.21.15.194:0/899166219 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7f61dc1ec560 con 0x7f61dc152e60 2024-03-07T10:21:31.779 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 msgr2=0x7f61bc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 0x7f61bc06d9c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f61cc036000 tx=0x7f61cc03d040 comp rx=0 tx=0).stop 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 msgr2=0x7f61dc154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c780 tx=0x7f61d400cc40 comp rx=0 tx=0).stop 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 shutdown_connections 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f61bc06b500 0x7f61bc06d9c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61dc152e60 0x7f61dc154760 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f61dc0c5da0 0x7f61dc1ec020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 --2- 172.21.15.194:0/899166219 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f61dc0ad420 0x7f61dc1ef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:31.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 >> 172.21.15.194:0/899166219 conn(0x7f61dc06b6b0 msgr2=0x7f61dc150d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:31.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 shutdown_connections 2024-03-07T10:21:31.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:31.780+0000 7f61e0a00640 1 -- 172.21.15.194:0/899166219 wait complete. 2024-03-07T10:21:31.800 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:32.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.000+0000 7f3f13600640 1 Processor -- start 2024-03-07T10:21:32.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.000+0000 7f3f13600640 1 -- start start 2024-03-07T10:21:32.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f13600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c14d6e0 0x7f3f0c06e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f13600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f0c0ab7c0 0x7f3f0c15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f13600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c153760 con 0x7f3f0c0ab340 2024-03-07T10:21:32.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f13600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c06daf0 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f13600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c06dd40 con 0x7f3f0c14d6e0 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.002+0000 7f3f11600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f0c0ab7c0 0x7f3f0c15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f0be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3f0c0ab340 0x7f3f0c0a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38210/0 (socket says 172.21.15.194:38210) 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f0be00640 1 -- 172.21.15.194:0/203528185 learned_addr learned my addr 172.21.15.194:0/203528185 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f10c00640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c14d6e0 0x7f3f0c06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f11600640 1 -- 172.21.15.194:0/203528185 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c14d6e0 msgr2=0x7f3f0c06e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f11600640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c14d6e0 0x7f3f0c06e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f11600640 1 -- 172.21.15.194:0/203528185 >> v1:172.21.15.194:6789/0 conn(0x7f3f0c0ab340 legacy=0x7f3f0c0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f11600640 1 -- 172.21.15.194:0/203528185 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c06e020 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.003+0000 7f3f0b400640 1 -- 172.21.15.194:0/203528185 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 934807813 0 0) 0x7f3f0c153760 con 0x7f3f0c0ab340 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.004+0000 7f3f11600640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab7c0 0x7f3f0c15ded0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c06dc70 tx=0x7f3f0402be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fb40091a65c2bb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.004+0000 7f3f0b400640 1 -- 172.21.15.194:0/203528185 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04039070 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.004+0000 7f3f0b400640 1 -- 172.21.15.194:0/203528185 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0402cbb0 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.004+0000 7f3f0b400640 1 -- 172.21.15.194:0/203528185 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04034440 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 -- 172.21.15.194:0/203528185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab7c0 msgr2=0x7f3f0c15ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab7c0 0x7f3f0c15ded0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c06dc70 tx=0x7f3f0402be00 comp rx=0 tx=0).stop 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 -- 172.21.15.194:0/203528185 shutdown_connections 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab7c0 0x7f3f0c15ded0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 --2- 172.21.15.194:0/203528185 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c14d6e0 0x7f3f0c06e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 -- 172.21.15.194:0/203528185 >> 172.21.15.194:0/203528185 conn(0x7f3f0c06b860 msgr2=0x7f3f0c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:32.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 -- 172.21.15.194:0/203528185 shutdown_connections 2024-03-07T10:21:32.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.005+0000 7f3f13600640 1 -- 172.21.15.194:0/203528185 wait complete. 2024-03-07T10:21:32.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.008+0000 7f3f13600640 1 Processor -- start 2024-03-07T10:21:32.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.008+0000 7f3f13600640 1 -- start start 2024-03-07T10:21:32.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 0x7f3f0c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f0c14d6e0 0x7f3f0c155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0aae10 con 0x7f3f0c0ab340 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c79c0 con 0x7f3f0c14d6e0 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f13600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0a9be0 con 0x7f3f0c0ab7c0 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60852/0 (socket says 172.21.15.194:60852) 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 -- 172.21.15.194:0/2104160616 learned_addr learned my addr 172.21.15.194:0/2104160616 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f11600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f0c14d6e0 0x7f3f0c155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f0be00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 0x7f3f0c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 -- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 msgr2=0x7f3f0c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 0x7f3f0c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 -- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f0c14d6e0 msgr2=0x7f3f0c155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f0c14d6e0 0x7f3f0c155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f10c00640 1 -- 172.21.15.194:0/2104160616 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c155c40 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.010+0000 7f3f0be00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 0x7f3f0c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f10c00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9e0 tx=0x7f3f0000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00017070 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000c9d0 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000cdc0 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c155f20 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.011+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1df980 con 0x7f3f0c0ab340 2024-03-07T10:21:32.014 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.013+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c068170 con 0x7f3f0c0ab340 2024-03-07T10:21:32.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.013+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3f0001a070 con 0x7f3f0c0ab340 2024-03-07T10:21:32.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.014+0000 7f3f08c00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 0x7f3eec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.015+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f3f0008a920 con 0x7f3f0c0ab340 2024-03-07T10:21:32.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.015+0000 7f3f0be00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 0x7f3eec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.016+0000 7f3f0be00640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 0x7f3eec06d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c1ea090 tx=0x7f3ef8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.018+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3f000593d0 con 0x7f3f0c0ab340 2024-03-07T10:21:32.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.239+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3f0c0ac550 con 0x7f3f0c0ab340 2024-03-07T10:21:32.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.240+0000 7f3f08c00640 1 -- 172.21.15.194:0/2104160616 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v24) v1 ==== 99+0+11 (secure 0 0 0) 0x7f3f0005f0d0 con 0x7f3f0c0ab340 2024-03-07T10:21:32.244 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:32.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.242+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 msgr2=0x7f3eec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.242+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 0x7f3eec06d9c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c1ea090 tx=0x7f3ef8009040 comp rx=0 tx=0).stop 2024-03-07T10:21:32.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.242+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 msgr2=0x7f3f0c1482a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.242+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000e9e0 tx=0x7f3f0000eea0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 shutdown_connections 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3eec06b500 0x7f3eec06d9c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3f0c14d6e0 0x7f3f0c155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3f0c0ab7c0 0x7f3f0c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 --2- 172.21.15.194:0/2104160616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f0c0ab340 0x7f3f0c1482a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 >> 172.21.15.194:0/2104160616 conn(0x7f3f0c06b860 msgr2=0x7f3f0c0a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 shutdown_connections 2024-03-07T10:21:32.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.243+0000 7f3f13600640 1 -- 172.21.15.194:0/2104160616 wait complete. 2024-03-07T10:21:32.263 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:32.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.476+0000 7ff958e00640 1 Processor -- start 2024-03-07T10:21:32.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.477+0000 7ff958e00640 1 -- start start 2024-03-07T10:21:32.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.478+0000 7ff958e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.478+0000 7ff958e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff9540a9a10 0x7ff95415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.478+0000 7ff958e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9540aba50 con 0x7ff95414d6e0 2024-03-07T10:21:32.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.478+0000 7ff958e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff95406daf0 con 0x7ff9540a9a10 2024-03-07T10:21:32.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.478+0000 7ff958e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406eca0 con 0x7ff95406e820 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.479+0000 7ff949400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.479+0000 7ff949400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:54666/0 (socket says 172.21.15.194:54666) 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.479+0000 7ff949400640 1 -- 172.21.15.194:0/4097203518 learned_addr learned my addr 172.21.15.194:0/4097203518 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.479+0000 7ff952800640 1 --2- 172.21.15.194:0/4097203518 >> v2:172.21.15.196:3300/0 conn(0x7ff9540a9a10 0x7ff95415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.479+0000 7ff952800640 1 -- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 msgr2=0x7ff9540a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:32.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.480+0000 7ff952800640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.480+0000 7ff952800640 1 -- 172.21.15.194:0/4097203518 >> v1:172.21.15.196:6789/0 conn(0x7ff95414d6e0 legacy=0x7ff9540ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.480+0000 7ff952800640 1 -- 172.21.15.194:0/4097203518 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954153760 con 0x7ff9540a9a10 2024-03-07T10:21:32.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.480+0000 7ff949400640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:32.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.481+0000 7ff952800640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9540a9a10 0x7ff95415ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0097a0 tx=0x7ff94c02b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faeaaac21d3ab73d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.481+0000 7ff951400640 1 -- 172.21.15.194:0/4097203518 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c031780 con 0x7ff9540a9a10 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.481+0000 7ff951400640 1 -- 172.21.15.194:0/4097203518 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94c037070 con 0x7ff9540a9a10 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.481+0000 7ff951400640 1 -- 172.21.15.194:0/4097203518 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94c031b40 con 0x7ff9540a9a10 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 -- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9540a9a10 msgr2=0x7ff95415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9540a9a10 0x7ff95415ded0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0097a0 tx=0x7ff94c02b820 comp rx=0 tx=0).stop 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 -- 172.21.15.194:0/4097203518 shutdown_connections 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff9540a9a10 0x7ff95415ded0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 --2- 172.21.15.194:0/4097203518 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9540a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 -- 172.21.15.194:0/4097203518 >> 172.21.15.194:0/4097203518 conn(0x7ff95406b860 msgr2=0x7ff9540c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 -- 172.21.15.194:0/4097203518 shutdown_connections 2024-03-07T10:21:32.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.482+0000 7ff958e00640 1 -- 172.21.15.194:0/4097203518 wait complete. 2024-03-07T10:21:32.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.484+0000 7ff958e00640 1 Processor -- start 2024-03-07T10:21:32.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.484+0000 7ff958e00640 1 -- start start 2024-03-07T10:21:32.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9541eb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff95414d6e0 0x7ff954148630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406e300 con 0x7ff9540a9a10 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95406e020 con 0x7ff95414d6e0 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff958e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9540c79c0 con 0x7ff95406e820 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60868/0 (socket says 172.21.15.194:60868) 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 -- 172.21.15.194:0/3306784096 learned_addr learned my addr 172.21.15.194:0/3306784096 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff951e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9541eb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff952800640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff95414d6e0 0x7ff954148630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 -- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 msgr2=0x7ff9541eb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9541eb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 -- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff95414d6e0 msgr2=0x7ff954148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff95414d6e0 0x7ff954148630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.485+0000 7ff949400640 1 -- 172.21.15.194:0/3306784096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95414aa40 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff951e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9541eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff949400640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ea00 tx=0x7ff93c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c017070 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00ca60 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00ce10 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9541eb960 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.486+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9541ebf20 con 0x7ff9540a9a10 2024-03-07T10:21:32.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.488+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff954068170 con 0x7ff9540a9a10 2024-03-07T10:21:32.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.489+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff93c01a070 con 0x7ff9540a9a10 2024-03-07T10:21:32.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.490+0000 7ff94aa00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 0x7ff93006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.491+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7ff93c08a3e0 con 0x7ff9540a9a10 2024-03-07T10:21:32.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.491+0000 7ff951e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 0x7ff93006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.492+0000 7ff951e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 0x7ff93006d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9540a9640 tx=0x7ff944009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.495+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff93c058fc0 con 0x7ff9540a9a10 2024-03-07T10:21:32.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.690+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7ff954072b90 con 0x7ff9540a9a10 2024-03-07T10:21:32.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.691+0000 7ff94aa00640 1 -- 172.21.15.194:0/3306784096 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v24) v1 ==== 95+0+11 (secure 0 0 0) 0x7ff93c0588c0 con 0x7ff9540a9a10 2024-03-07T10:21:32.692 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 msgr2=0x7ff93006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 0x7ff93006d990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9540a9640 tx=0x7ff944009040 comp rx=0 tx=0).stop 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 msgr2=0x7ff95414bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00ea00 tx=0x7ff93c00eec0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 shutdown_connections 2024-03-07T10:21:32.695 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff93006b4d0 0x7ff93006d990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff95414d6e0 0x7ff954148630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9540a9a10 0x7ff95414bf70 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 --2- 172.21.15.194:0/3306784096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff95406e820 0x7ff9541eb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 >> 172.21.15.194:0/3306784096 conn(0x7ff95406b860 msgr2=0x7ff9540c18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.693+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 shutdown_connections 2024-03-07T10:21:32.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.694+0000 7ff958e00640 1 -- 172.21.15.194:0/3306784096 wait complete. 2024-03-07T10:21:32.712 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:32.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.903+0000 7f4181600640 1 Processor -- start 2024-03-07T10:21:32.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.903+0000 7f4181600640 1 -- start start 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.904+0000 7f4181600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f417c1528a0 0x7f417c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.904+0000 7f4181600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f417c06c1c0 0x7f417c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.904+0000 7f4181600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c155b20 con 0x7f417c0c5bc0 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.904+0000 7f4181600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c0c95e0 con 0x7f417c1528a0 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.904+0000 7f4181600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c1531c0 con 0x7f417c06c1c0 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f417c1528a0 0x7f417c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f417c1528a0 0x7f417c152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60880/0 (socket says 172.21.15.194:60880) 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 -- 172.21.15.194:0/2798912812 learned_addr learned my addr 172.21.15.194:0/2798912812 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f4180c00640 1 --2- 172.21.15.194:0/2798912812 >> v2:172.21.15.196:3300/0 conn(0x7f417c06c1c0 0x7f417c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 -- 172.21.15.194:0/2798912812 >> v2:172.21.15.196:3300/0 conn(0x7f417c06c1c0 msgr2=0x7f417c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 --2- 172.21.15.194:0/2798912812 >> v2:172.21.15.196:3300/0 conn(0x7f417c06c1c0 0x7f417c06c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 -- 172.21.15.194:0/2798912812 >> v1:172.21.15.196:6789/0 conn(0x7f417c0c5bc0 legacy=0x7f417c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.905+0000 7f417b400640 1 -- 172.21.15.194:0/2798912812 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c155dc0 con 0x7f417c1528a0 2024-03-07T10:21:32.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.906+0000 7f417b400640 1 --2- 172.21.15.194:0/2798912812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c1528a0 0x7f417c152c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417c0c8900 tx=0x7f416402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d8e0581f81b1cd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.907+0000 7f417aa00640 1 -- 172.21.15.194:0/2798912812 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164035020 con 0x7f417c1528a0 2024-03-07T10:21:32.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.907+0000 7f417aa00640 1 -- 172.21.15.194:0/2798912812 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164031870 con 0x7f417c1528a0 2024-03-07T10:21:32.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.907+0000 7f417aa00640 1 -- 172.21.15.194:0/2798912812 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164031c40 con 0x7f417c1528a0 2024-03-07T10:21:32.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 -- 172.21.15.194:0/2798912812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c1528a0 msgr2=0x7f417c152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 --2- 172.21.15.194:0/2798912812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c1528a0 0x7f417c152c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f417c0c8900 tx=0x7f416402b910 comp rx=0 tx=0).stop 2024-03-07T10:21:32.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 -- 172.21.15.194:0/2798912812 shutdown_connections 2024-03-07T10:21:32.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 --2- 172.21.15.194:0/2798912812 >> v2:172.21.15.196:3300/0 conn(0x7f417c06c1c0 0x7f417c06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 --2- 172.21.15.194:0/2798912812 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c1528a0 0x7f417c152c80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 -- 172.21.15.194:0/2798912812 >> 172.21.15.194:0/2798912812 conn(0x7f417c0675e0 msgr2=0x7f417c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:32.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 -- 172.21.15.194:0/2798912812 shutdown_connections 2024-03-07T10:21:32.910 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.908+0000 7f4181600640 1 -- 172.21.15.194:0/2798912812 wait complete. 2024-03-07T10:21:32.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.909+0000 7f4181600640 1 Processor -- start 2024-03-07T10:21:32.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 -- start start 2024-03-07T10:21:32.912 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c06c1c0 0x7f417c14f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c1528a0 0x7f417c141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c156640 con 0x7f417c0c5bc0 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c156360 con 0x7f417c06c1c0 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.910+0000 7f4181600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f417c155730 con 0x7f417c1528a0 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60884/0 (socket says 172.21.15.194:60884) 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 -- 172.21.15.194:0/2281108428 learned_addr learned my addr 172.21.15.194:0/2281108428 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 -- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c1528a0 msgr2=0x7f417c141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c1528a0 0x7f417c141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417be00640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c06c1c0 0x7f417c14f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 -- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c06c1c0 msgr2=0x7f417c14f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:32.913 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c06c1c0 0x7f417c14f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:32.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 -- 172.21.15.194:0/2281108428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c1ee980 con 0x7f417c0c5bc0 2024-03-07T10:21:32.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.911+0000 7f417b400640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f416402b950 tx=0x7f41640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.912+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164040070 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.912+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164030d00 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.912+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164035040 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.912+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c1eec60 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.912+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c1ef220 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.913+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c068170 con 0x7f417c0c5bc0 2024-03-07T10:21:32.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.914+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4164038020 con 0x7f417c0c5bc0 2024-03-07T10:21:32.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.915+0000 7f4173e00640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 0x7f415806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:32.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.915+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f41640ac370 con 0x7f417c0c5bc0 2024-03-07T10:21:32.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.915+0000 7f417be00640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 0x7f415806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:32.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.916+0000 7f417be00640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 0x7f415806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f416c007fd0 tx=0x7f416c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:32.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:32.924+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f416407aeb0 con 0x7f417c0c5bc0 2024-03-07T10:21:33.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.156+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f417c06d450 con 0x7f417c0c5bc0 2024-03-07T10:21:33.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.157+0000 7f4173e00640 1 -- 172.21.15.194:0/2281108428 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f416407a7b0 con 0x7f417c0c5bc0 2024-03-07T10:21:33.159 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:33.159 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:33.159 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:33.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.159+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 msgr2=0x7f415806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.159+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 0x7f415806d990 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f416c007fd0 tx=0x7f416c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 msgr2=0x7f417c140cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f416402b950 tx=0x7f41640046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 shutdown_connections 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b4d0 0x7f415806d990 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f417c1528a0 0x7f417c141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f417c0c5bc0 0x7f417c140cf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 --2- 172.21.15.194:0/2281108428 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f417c06c1c0 0x7f417c14f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 >> 172.21.15.194:0/2281108428 conn(0x7f417c0675e0 msgr2=0x7f417c0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 shutdown_connections 2024-03-07T10:21:33.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.160+0000 7f4181600640 1 -- 172.21.15.194:0/2281108428 wait complete. 2024-03-07T10:21:33.186 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:33.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.394+0000 7f5662a00640 1 Processor -- start 2024-03-07T10:21:33.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.394+0000 7f5662a00640 1 -- start start 2024-03-07T10:21:33.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.395+0000 7f5662a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f565c0c8230 0x7f565c1535c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.395+0000 7f5662a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c154560 con 0x7f565c0c7510 2024-03-07T10:21:33.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.395+0000 7f5662a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f565c153cc0 con 0x7f565c0c6130 2024-03-07T10:21:33.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.395+0000 7f5662a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f565c0c0180 con 0x7f565c0c8230 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f5660a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f565c0c7510 0x7f565c14cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38218/0 (socket says 172.21.15.194:38218) 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f5660a00640 1 -- 172.21.15.194:0/3363012745 learned_addr learned my addr 172.21.15.194:0/3363012745 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187747521 0 0) 0x7f565c154560 con 0x7f565c0c7510 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5640003520 con 0x7f565c0c7510 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565b400640 1 --2- 172.21.15.194:0/3363012745 >> v2:172.21.15.196:3300/0 conn(0x7f565c0c8230 0x7f565c1535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720797819 0 0) 0x7f5640003520 con 0x7f565c0c7510 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 >> v2:172.21.15.196:3300/0 conn(0x7f565c0c8230 msgr2=0x7f565c1535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 --2- 172.21.15.194:0/3363012745 >> v2:172.21.15.196:3300/0 conn(0x7f565c0c8230 0x7f565c1535c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.396+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 >> v1:172.21.15.196:6789/0 conn(0x7f565c0c6130 legacy=0x7f565c070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c153fa0 con 0x7f565c0c7510 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f56540019f0 con 0x7f565c0c7510 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565b400640 1 --2- 172.21.15.194:0/3363012745 >> v2:172.21.15.196:3300/0 conn(0x7f565c0c8230 0x7f565c1535c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:33.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 >> v1:172.21.15.194:6789/0 conn(0x7f565c0c7510 legacy=0x7f565c14cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5640003a00 0x7f5640003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5640004800 0x7f5640004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 0x7f564000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564000c270 con 0x7f56400053c0 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564000c420 con 0x7f5640004800 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564000c620 con 0x7f5640003a00 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 0x7f564000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 -- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5640003a00 msgr2=0x7f5640003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5640003a00 0x7f5640003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 -- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5640004800 msgr2=0x7f5640004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5640004800 0x7f5640004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.397+0000 7f5660a00640 1 -- 172.21.15.194:0/3363012745 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640003520 con 0x7f56400053c0 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.398+0000 7f5660a00640 1 -- 172.21.15.194:0/3363012745 reap_dead start 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.398+0000 7f5660a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 0x7f564000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f565400a770 tx=0x7f5640005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea396f8a98b1dfed server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400a390 con 0x7f56400053c0 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654034650 con 0x7f56400053c0 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f565aa00640 1 -- 172.21.15.194:0/3363012745 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654034a40 con 0x7f56400053c0 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 -- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 msgr2=0x7f564000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 0x7f564000b9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f565400a770 tx=0x7f5640005830 comp rx=0 tx=0).stop 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 -- 172.21.15.194:0/3363012745 shutdown_connections 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 --2- 172.21.15.194:0/3363012745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f56400053c0 0x7f564000b9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 -- 172.21.15.194:0/3363012745 >> 172.21.15.194:0/3363012745 conn(0x7f565c0c8fc0 msgr2=0x7f565c0c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:33.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 -- 172.21.15.194:0/3363012745 shutdown_connections 2024-03-07T10:21:33.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.399+0000 7f5662a00640 1 -- 172.21.15.194:0/3363012745 wait complete. 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.402+0000 7f5662a00640 1 Processor -- start 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.402+0000 7f5662a00640 1 -- start start 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 0x7f565c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f565c14aff0 0x7f565c06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.408 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c154ab0 con 0x7f565c14b870 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565c0c7080 con 0x7f56400053c0 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5662a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f565c154c30 con 0x7f565c14aff0 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60896/0 (socket says 172.21.15.194:60896) 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 -- 172.21.15.194:0/3049576200 learned_addr learned my addr 172.21.15.194:0/3049576200 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f5660a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f565c14aff0 0x7f565c06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 -- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f565c14aff0 msgr2=0x7f565c06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f565c14aff0 0x7f565c06c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565be00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 0x7f565c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 -- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 msgr2=0x7f565c14d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 0x7f565c14d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565b400640 1 -- 172.21.15.194:0/3049576200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c070410 con 0x7f565c14b870 2024-03-07T10:21:33.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.404+0000 7f565be00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 0x7f565c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f565b400640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f564800e5e0 tx=0x7f564800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5648017070 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5648013610 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564800f040 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565c06d490 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.405+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565c070c30 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.406+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f565c068880 con 0x7f565c14b870 2024-03-07T10:21:33.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.407+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f564801a070 con 0x7f565c14b870 2024-03-07T10:21:33.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.408+0000 7f5653e00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.408+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f5648089fe0 con 0x7f565c14b870 2024-03-07T10:21:33.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.408+0000 7f565be00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.411 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.409+0000 7f565be00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 0x7f563c06d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f565c154730 tx=0x7f564c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.413 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.412+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5648058b80 con 0x7f565c14b870 2024-03-07T10:21:33.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.609+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f565c0ade60 con 0x7f565c14b870 2024-03-07T10:21:33.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.612+0000 7f5653e00640 1 -- 172.21.15.194:0/3049576200 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+20391 (secure 0 0 0) 0x7f5648058480 con 0x7f565c14b870 2024-03-07T10:21:33.613 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:33.613 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:10.268145+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:33.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 msgr2=0x7f563c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 0x7f563c06d990 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f565c154730 tx=0x7f564c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:33.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 msgr2=0x7f565c06dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f564800e5e0 tx=0x7f564800eaa0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 shutdown_connections 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f563c06b4d0 0x7f563c06d990 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f565c14aff0 0x7f565c06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f565c14b870 0x7f565c06dce0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.614+0000 7f5662a00640 1 --2- 172.21.15.194:0/3049576200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f56400053c0 0x7f565c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.615+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 >> 172.21.15.194:0/3049576200 conn(0x7f565c0c8fc0 msgr2=0x7f565c0c93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.615+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 shutdown_connections 2024-03-07T10:21:33.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.615+0000 7f5662a00640 1 -- 172.21.15.194:0/3049576200 wait complete. 2024-03-07T10:21:33.634 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:33.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.833+0000 7f14e7400640 1 Processor -- start 2024-03-07T10:21:33.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.833+0000 7f14e7400640 1 -- start start 2024-03-07T10:21:33.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.834+0000 7f14e7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14e0150b70 0x7f14e00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.834+0000 7f14e7400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f14e00a9a10 0x7f14e006e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.834+0000 7f14e7400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e0153980 con 0x7f14e0156c20 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.834+0000 7f14e7400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e006e550 con 0x7f14e0150b70 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.834+0000 7f14e7400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e0153c60 con 0x7f14e00a9a10 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14e0150b70 0x7f14e00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f14e0150b70 0x7f14e00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60904/0 (socket says 172.21.15.194:60904) 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 -- 172.21.15.194:0/1249253719 learned_addr learned my addr 172.21.15.194:0/1249253719 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 -- 172.21.15.194:0/1249253719 >> v2:172.21.15.196:3300/0 conn(0x7f14e00a9a10 msgr2=0x7f14e006e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:33.838 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e5400640 1 --2- 172.21.15.194:0/1249253719 >> v2:172.21.15.196:3300/0 conn(0x7f14e00a9a10 0x7f14e006e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 --2- 172.21.15.194:0/1249253719 >> v2:172.21.15.196:3300/0 conn(0x7f14e00a9a10 0x7f14e006e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 -- 172.21.15.194:0/1249253719 >> v1:172.21.15.196:6789/0 conn(0x7f14e0156c20 legacy=0x7f14e006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:33.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.835+0000 7f14e4a00640 1 -- 172.21.15.194:0/1249253719 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0153f40 con 0x7f14e0150b70 2024-03-07T10:21:33.839 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.836+0000 7f14e4a00640 1 --2- 172.21.15.194:0/1249253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0150b70 0x7f14e00a94d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14e00aaf20 tx=0x7f14d402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61044f0d3fdb68c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.836+0000 7f14df400640 1 -- 172.21.15.194:0/1249253719 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d402c9f0 con 0x7f14e0150b70 2024-03-07T10:21:33.840 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14df400640 1 -- 172.21.15.194:0/1249253719 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d402cb90 con 0x7f14e0150b70 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14df400640 1 -- 172.21.15.194:0/1249253719 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40343f0 con 0x7f14e0150b70 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 -- 172.21.15.194:0/1249253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0150b70 msgr2=0x7f14e00a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 --2- 172.21.15.194:0/1249253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0150b70 0x7f14e00a94d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f14e00aaf20 tx=0x7f14d402be50 comp rx=0 tx=0).stop 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 -- 172.21.15.194:0/1249253719 shutdown_connections 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 --2- 172.21.15.194:0/1249253719 >> v2:172.21.15.196:3300/0 conn(0x7f14e00a9a10 0x7f14e006e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 --2- 172.21.15.194:0/1249253719 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0150b70 0x7f14e00a94d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 -- 172.21.15.194:0/1249253719 >> 172.21.15.194:0/1249253719 conn(0x7f14e006b840 msgr2=0x7f14e00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:33.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 -- 172.21.15.194:0/1249253719 shutdown_connections 2024-03-07T10:21:33.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.837+0000 7f14e7400640 1 -- 172.21.15.194:0/1249253719 wait complete. 2024-03-07T10:21:33.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.839+0000 7f14e7400640 1 Processor -- start 2024-03-07T10:21:33.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.839+0000 7f14e7400640 1 -- start start 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14e00a9a10 0x7f14e00c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e0150b70 0x7f14e0072530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e0153630 con 0x7f14e0156c20 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c7a30 con 0x7f14e0150b70 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e7400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00ac460 con 0x7f14e00a9a10 2024-03-07T10:21:33.844 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60920/0 (socket says 172.21.15.194:60920) 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e5400640 1 -- 172.21.15.194:0/723976575 learned_addr learned my addr 172.21.15.194:0/723976575 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e4a00640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14e00a9a10 0x7f14e00c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14dfe00640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e0150b70 0x7f14e0072530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e5400640 1 -- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14e00a9a10 msgr2=0x7f14e00c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.840+0000 7f14e5400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14e00a9a10 0x7f14e00c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e5400640 1 -- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e0150b70 msgr2=0x7f14e0072530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e5400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e0150b70 0x7f14e0072530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e5400640 1 -- 172.21.15.194:0/723976575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e0151eb0 con 0x7f14e0156c20 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e5400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c580 tx=0x7f14d800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8015070 con 0x7f14e0156c20 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8004220 con 0x7f14e0156c20 2024-03-07T10:21:33.845 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00c6ca0 con 0x7f14e0156c20 2024-03-07T10:21:33.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8003610 con 0x7f14e0156c20 2024-03-07T10:21:33.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.841+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e0070e80 con 0x7f14e0156c20 2024-03-07T10:21:33.846 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.842+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e0068170 con 0x7f14e0156c20 2024-03-07T10:21:33.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.843+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f14d80037b0 con 0x7f14e0156c20 2024-03-07T10:21:33.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.844+0000 7f14dcc00640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 0x7f14c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:33.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.844+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f14d808a330 con 0x7f14e0156c20 2024-03-07T10:21:33.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.845+0000 7f14e4a00640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 0x7f14c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:33.847 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.846+0000 7f14e4a00640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 0x7f14c006d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f14d4035000 tx=0x7f14d4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:33.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:33.853+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f14d8058df0 con 0x7f14e0156c20 2024-03-07T10:21:34.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.134+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14e006c090 con 0x7f14e0156c20 2024-03-07T10:21:34.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.134+0000 7f14dcc00640 1 -- 172.21.15.194:0/723976575 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f14d80586f0 con 0x7f14e0156c20 2024-03-07T10:21:34.136 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:34.136 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:34.137 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 msgr2=0x7f14c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 0x7f14c006d990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f14d4035000 tx=0x7f14d4030000 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 msgr2=0x7f14e01ee590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f14d800c580 tx=0x7f14d800ca40 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 shutdown_connections 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f14c006b4d0 0x7f14c006d990 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f14e0156c20 0x7f14e01ee590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f14e0150b70 0x7f14e0072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 --2- 172.21.15.194:0/723976575 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f14e00a9a10 0x7f14e00c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 >> 172.21.15.194:0/723976575 conn(0x7f14e006b840 msgr2=0x7f14e00c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 shutdown_connections 2024-03-07T10:21:34.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.137+0000 7f14e7400640 1 -- 172.21.15.194:0/723976575 wait complete. 2024-03-07T10:21:34.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-07T10:21:08.712900+0000', 'modified': '2024-03-07T10:21:12.808129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4254}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4254': {'gid': 4254, 'name': 'c', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.194:6835/1436303034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6834', 'nonce': 1436303034}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 1436303034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4254, 'qdb_cluster': [4254]} 2024-03-07T10:21:34.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-07T10:21:34.559 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-07T10:21:34.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.763+0000 7f0951000640 1 Processor -- start 2024-03-07T10:21:34.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.763+0000 7f0951000640 1 -- start start 2024-03-07T10:21:34.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0951000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f094c150b70 0x7f094c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0951000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c153980 con 0x7f094c156c20 2024-03-07T10:21:34.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0951000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f094c153c60 con 0x7f094c0a9a10 2024-03-07T10:21:34.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0951000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f094c153f40 con 0x7f094c150b70 2024-03-07T10:21:34.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0941400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f094c156c20 0x7f094c06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38220/0 (socket says 172.21.15.194:38220) 2024-03-07T10:21:34.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.765+0000 7f0941400640 1 -- 172.21.15.194:0/282489066 learned_addr learned my addr 172.21.15.194:0/282489066 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214792162 0 0) 0x7f094c153980 con 0x7f094c156c20 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949e00640 1 --2- 172.21.15.194:0/282489066 >> v2:172.21.15.196:3300/0 conn(0x7f094c150b70 0x7f094c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0930003520 con 0x7f094c156c20 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3549653545 0 0) 0x7f0930003520 con 0x7f094c156c20 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 >> v2:172.21.15.196:3300/0 conn(0x7f094c150b70 msgr2=0x7f094c0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 --2- 172.21.15.194:0/282489066 >> v2:172.21.15.196:3300/0 conn(0x7f094c150b70 0x7f094c0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 >> v1:172.21.15.196:6789/0 conn(0x7f094c0a9a10 legacy=0x7f094c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c154220 con 0x7f094c156c20 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f0934001670 con 0x7f094c156c20 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 >> v1:172.21.15.194:6789/0 conn(0x7f094c156c20 legacy=0x7f094c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 0x7f093000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c153f40 con 0x7f09300052e0 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093000c1b0 con 0x7f0930004800 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093000c3b0 con 0x7f09300039b0 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.766+0000 7f094a800640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 0x7f093000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f0949e00640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f0941400640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f094a800640 1 -- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09300039b0 msgr2=0x7f0930003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f094a800640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09300039b0 0x7f0930003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f094a800640 1 -- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0930004800 msgr2=0x7f0930004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f094a800640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0930004800 0x7f0930004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.767+0000 7f094a800640 1 -- 172.21.15.194:0/282489066 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0930003520 con 0x7f09300052e0 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.768+0000 7f094a800640 1 -- 172.21.15.194:0/282489066 reap_dead start 2024-03-07T10:21:34.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.768+0000 7f094a800640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 0x7f093000b9c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0944001e20 tx=0x7f0930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8855e34f5f5cda server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.768+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944001a70 con 0x7f09300052e0 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.768+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944003b70 con 0x7f09300052e0 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.768+0000 7f0949400640 1 -- 172.21.15.194:0/282489066 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440050d0 con 0x7f09300052e0 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 -- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 msgr2=0x7f093000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 0x7f093000b9c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0944001e20 tx=0x7f0930005830 comp rx=0 tx=0).stop 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 -- 172.21.15.194:0/282489066 shutdown_connections 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 --2- 172.21.15.194:0/282489066 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09300052e0 0x7f093000b9c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 -- 172.21.15.194:0/282489066 >> 172.21.15.194:0/282489066 conn(0x7f094c06b840 msgr2=0x7f094c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 -- 172.21.15.194:0/282489066 shutdown_connections 2024-03-07T10:21:34.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.769+0000 7f0951000640 1 -- 172.21.15.194:0/282489066 wait complete. 2024-03-07T10:21:34.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.772+0000 7f0951000640 1 Processor -- start 2024-03-07T10:21:34.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.772+0000 7f0951000640 1 -- start start 2024-03-07T10:21:34.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 0x7f094c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f094c1e7370 0x7f094c0c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c150f50 con 0x7f094c0c2b90 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c153630 con 0x7f09300052e0 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f0951000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1510d0 con 0x7f094c1e7370 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.773+0000 7f094a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60936/0 (socket says 172.21.15.194:60936) 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 -- 172.21.15.194:0/2352268806 learned_addr learned my addr 172.21.15.194:0/2352268806 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f0941400640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f094c1e7370 0x7f094c0c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f0949e00640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 0x7f094c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 -- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f094c1e7370 msgr2=0x7f094c0c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f094c1e7370 0x7f094c0c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.776 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 -- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 msgr2=0x7f094c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 0x7f094c152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 -- 172.21.15.194:0/2352268806 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c1ead00 con 0x7f094c0c2b90 2024-03-07T10:21:34.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f0949e00640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 0x7f094c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:34.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f094a800640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f094402c040 tx=0x7f09440014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.774+0000 7f0942a00640 1 -- 172.21.15.194:0/2352268806 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944037460 con 0x7f094c0c2b90 2024-03-07T10:21:34.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.775+0000 7f0942a00640 1 -- 172.21.15.194:0/2352268806 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944037600 con 0x7f094c0c2b90 2024-03-07T10:21:34.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.775+0000 7f0942a00640 1 -- 172.21.15.194:0/2352268806 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440379f0 con 0x7f094c0c2b90 2024-03-07T10:21:34.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.775+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f094c1eafe0 con 0x7f094c0c2b90 2024-03-07T10:21:34.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.775+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094c1eb5a0 con 0x7f094c0c2b90 2024-03-07T10:21:34.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.777+0000 7f0942a00640 1 -- 172.21.15.194:0/2352268806 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0944037b90 con 0x7f094c0c2b90 2024-03-07T10:21:34.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.778+0000 7f0942a00640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.778+0000 7f0942a00640 1 -- 172.21.15.194:0/2352268806 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f09440ac2d0 con 0x7f094c0c2b90 2024-03-07T10:21:34.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.778+0000 7f0949e00640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.778+0000 7f0953fc0740 1 Processor -- start 2024-03-07T10:21:34.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 -- start start 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 0x56240da65100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0949e00640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 0x7f092806d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f093c006fd0 tx=0x7f093c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da29e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d98e6c0 con 0x56240da64d20 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d9379b0 con 0x56240da67e90 2024-03-07T10:21:34.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.779+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240d98a760 con 0x56240da2b0c0 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60938/0 (socket says 172.21.15.194:60938) 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 -- 172.21.15.194:0/2842448565 learned_addr learned my addr 172.21.15.194:0/2842448565 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0941400640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 0x56240da65100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 -- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 msgr2=0x56240da65100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 0x56240da65100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f094a800640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da29e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 -- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 msgr2=0x56240da29e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da29e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 -- 172.21.15.194:0/2842448565 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240d92b6f0 con 0x56240da64d20 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0941400640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 0x56240da65100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.780+0000 7f0949e00640 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f093c010a30 tx=0x7f093c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11715e498e05314a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f093aa00640 1 -- 172.21.15.194:0/2842448565 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01c050 con 0x56240da64d20 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f093aa00640 1 -- 172.21.15.194:0/2842448565 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c026070 con 0x56240da64d20 2024-03-07T10:21:34.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f093aa00640 1 -- 172.21.15.194:0/2842448565 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00f040 con 0x56240da64d20 2024-03-07T10:21:34.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 -- 172.21.15.194:0/2842448565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 msgr2=0x56240da65e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f093c010a30 tx=0x7f093c013000 comp rx=0 tx=0).stop 2024-03-07T10:21:34.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 -- 172.21.15.194:0/2842448565 shutdown_connections 2024-03-07T10:21:34.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da29e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da2b0c0 0x56240da65100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 --2- 172.21.15.194:0/2842448565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da65e90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 -- 172.21.15.194:0/2842448565 >> 172.21.15.194:0/2842448565 conn(0x56240da26700 msgr2=0x56240da4b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 -- 172.21.15.194:0/2842448565 shutdown_connections 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.781+0000 7f0953fc0740 1 -- 172.21.15.194:0/2842448565 wait complete. 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.782+0000 7f0953fc0740 1 -- start start 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.782+0000 7f0953fc0740 1 Processor -- start 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da7a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da47440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240da67a00 con 0x56240da64d20 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240d94adf0 con 0x56240da67e90 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240da674c0 con 0x56240da6d420 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0953fc0740 10 client.0 _ll_register_callbacks cb 0x56240d9858a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60940/0 (socket says 172.21.15.194:60940) 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.783+0000 7f0949e00640 1 -- 172.21.15.194:0/4089147029 learned_addr learned my addr 172.21.15.194:0/4089147029 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 -- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 msgr2=0x56240da47440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da47440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 -- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 msgr2=0x56240da7a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da7a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 -- 172.21.15.194:0/4089147029 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240d6a32d0 con 0x56240da64d20 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0949e00640 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f093c0105c0 tx=0x7f093c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6a698b6ac7b348 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f092f400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-03-07T10:21:34.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00e040 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mon.0 v2:172.21.15.194:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f093c021c80 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.784+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f093c026070 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093c016420 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 10 client.4869 fetch_fsmap learned FSMap version 15 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56240d76d6b0 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mon.0 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c026070 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mon.0 v2:172.21.15.194:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f093c0165c0 con 0x56240da64d20 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 10 client.4869 fetch_fsmap finished waiting for FSMap version 15 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 10 client.4869 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 20 client.4869 populate_metadata read hostname 'smithi194' 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240da6aec0 0x56240da6b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 4 client.4869 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 --> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56240d99bc00 con 0x56240da6aec0 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.785+0000 7f0941400640 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240da6aec0 0x56240da6b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.786+0000 7f092f400640 10 client.4869 ms_handle_connect on v2:172.21.15.194:6834/1436303034 2024-03-07T10:21:34.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.786+0000 7f0941400640 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240da6aec0 0x56240da6b2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ab1c9b731d952b server_cookie=519af4a661fd45ef in_seq=0 out_seq=0 2024-03-07T10:21:34.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f092f400640 1 -- 172.21.15.194:0/4089147029 <== mds.0 v2:172.21.15.194:6834/1436303034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21660 (crc 0 0 0) 0x56240d99bc00 con 0x56240da6aec0 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f092f400640 10 client.4869 handle_command_reply: tid=0 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 client.4869 shutdown 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 msgr2=0x56240da4b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f093c0105c0 tx=0x7f093c0046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 shutdown_connections 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240da6aec0 0x56240da6b2a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da47440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da7a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 --2- 172.21.15.194:0/4089147029 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da4b000 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f092f400640 0 client.4869 ms_handle_reset on v2:172.21.15.194:6834/1436303034 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.787+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 >> 172.21.15.194:0/4089147029 conn(0x56240da2b0c0 msgr2=0x56240da66420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.788+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 shutdown_connections 2024-03-07T10:21:34.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.788+0000 7f0953fc0740 1 -- 172.21.15.194:0/4089147029 wait complete. 2024-03-07T10:21:34.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.788+0000 7f0953fc0740 20 client.4869 trim_cache size 0 max 16384 2024-03-07T10:21:34.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 Processor -- start 2024-03-07T10:21:34.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 -- start start 2024-03-07T10:21:34.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da76fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da5dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f6ef0 con 0x56240da64d20 2024-03-07T10:21:34.809 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f4ad0 con 0x56240da67e90 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.806+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f094c1f50a0 con 0x56240da6d420 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60948/0 (socket says 172.21.15.194:60948) 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 -- 172.21.15.194:0/656196499 learned_addr learned my addr 172.21.15.194:0/656196499 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 -- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 msgr2=0x56240da5dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da5dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 -- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 msgr2=0x56240da76fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da76fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 -- 172.21.15.194:0/656196499 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240da5c230 con 0x56240da64d20 2024-03-07T10:21:34.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.807+0000 7f0949e00640 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f093c00e6b0 tx=0x7f093c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a325af9571c5525 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f093a000640 1 -- 172.21.15.194:0/656196499 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c00e040 con 0x56240da64d20 2024-03-07T10:21:34.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f093a000640 1 -- 172.21.15.194:0/656196499 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c026040 con 0x56240da64d20 2024-03-07T10:21:34.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f093a000640 1 -- 172.21.15.194:0/656196499 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01c020 con 0x56240da64d20 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 -- 172.21.15.194:0/656196499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 msgr2=0x56240da6be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f093c00e6b0 tx=0x7f093c020000 comp rx=0 tx=0).stop 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 -- 172.21.15.194:0/656196499 shutdown_connections 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da6d420 0x56240da5dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da67e90 0x56240da76fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 --2- 172.21.15.194:0/656196499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da64d20 0x56240da6be10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 -- 172.21.15.194:0/656196499 >> 172.21.15.194:0/656196499 conn(0x56240da2b0c0 msgr2=0x56240da5e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 -- 172.21.15.194:0/656196499 shutdown_connections 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.808+0000 7f0953fc0740 1 -- 172.21.15.194:0/656196499 wait complete. 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.809+0000 7f0953fc0740 1 -- start start 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.809+0000 7f0953fc0740 1 Processor -- start 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da64d20 0x56240da65500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 0x56240da49080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240da76bc0 con 0x56240da6d420 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240da6cd10 con 0x56240da64d20 2024-03-07T10:21:34.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240da6a950 con 0x56240da67e90 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f0953fc0740 10 client.0 _ll_register_callbacks cb 0x7f093c010900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f094a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f094a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60960/0 (socket says 172.21.15.194:60960) 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.810+0000 7f094a800640 1 -- 172.21.15.194:0/3208543673 learned_addr learned my addr 172.21.15.194:0/3208543673 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0941400640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 0x56240da49080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0949e00640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da64d20 0x56240da65500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 -- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 msgr2=0x56240da49080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 0x56240da49080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.819 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 -- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da64d20 msgr2=0x56240da65500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da64d20 0x56240da65500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 -- 172.21.15.194:0/3208543673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240da4b340 con 0x56240da6d420 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0941400640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 0x56240da49080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f094a800640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f094407a400 tx=0x7f094407a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb90b37de3b0bdb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f092f400640 10 client.0 ms_handle_connect on v2:172.21.15.194:3300/0 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944047040 con 0x56240da6d420 2024-03-07T10:21:34.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mon.0 v2:172.21.15.194:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f0944092070 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f093c026040 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0944092290 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0953fc0740 10 client.4875 fetch_fsmap learned FSMap version 15 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.811+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x56240dad6f30 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mon.0 v2:172.21.15.194:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093c026040 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mon.0 v2:172.21.15.194:3300/0 5 ==== fsmap(e 15) v1 ==== 3918+0+0 (secure 0 0 0) 0x7f0944040070 con 0x56240da6d420 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 10 client.4875 fetch_fsmap finished waiting for FSMap version 15 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 10 client.4875 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 20 client.4875 populate_metadata read hostname 'smithi194' 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240dad3a00 0x56240dad96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:34.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 4 client.4875 mds_command: new command op to 4254 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 --> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56240d995f50 con 0x56240dad3a00 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.812+0000 7f0949e00640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240dad3a00 0x56240dad96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f092f400640 10 client.4875 ms_handle_connect on v2:172.21.15.194:6834/1436303034 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0949e00640 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240dad3a00 0x56240dad96c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26507182bd5741d2 server_cookie=1ad76a0efd8ab285 in_seq=0 out_seq=0 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f092f400640 1 -- 172.21.15.194:0/3208543673 <== mds.0 v2:172.21.15.194:6834/1436303034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x56240d995f50 con 0x56240dad3a00 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f092f400640 10 client.4875 handle_command_reply: tid=0 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 client.4875 shutdown 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 msgr2=0x56240dad3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f094407a400 tx=0x7f094407a300 comp rx=0 tx=0).stop 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 shutdown_connections 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:6834/1436303034,v1:172.21.15.194:6835/1436303034] conn(0x56240dad3a00 0x56240dad96c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56240da6d420 0x56240dad3400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x56240da67e90 0x56240da49080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 --2- 172.21.15.194:0/3208543673 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x56240da64d20 0x56240da65500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f092f400640 0 client.4875 ms_handle_reset on v2:172.21.15.194:6834/1436303034 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 >> 172.21.15.194:0/3208543673 conn(0x56240da2b0c0 msgr2=0x56240da76f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 shutdown_connections 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 1 -- 172.21.15.194:0/3208543673 wait complete. 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.813+0000 7f0953fc0740 20 client.4875 trim_cache size 0 max 16384 2024-03-07T10:21:34.823 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "cluster_fsid": "4f04f9a7-36ed-4153-a852-b0f479c9f76c", 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "whoami": 0, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "id": 4254, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "want_state": "up:active", 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "state": "up:active", 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "fs_name": "b", 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "rank_uptime": 25.519999646999999, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "mdsmap_epoch": 15, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_epoch": 24, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "osdmap_epoch_barrier": 24, 2024-03-07T10:21:34.824 INFO:teuthology.orchestra.run.smithi194.stdout: "uptime": 41.920507325999999 2024-03-07T10:21:34.825 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:21:34.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 msgr2=0x7f092806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 0x7f092806d9c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f093c006fd0 tx=0x7f093c008040 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 msgr2=0x7f094c0c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f094402c040 tx=0x7f09440014a0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 shutdown_connections 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f092806b500 0x7f092806d9c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f094c0c2b90 0x7f094c0c6090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f094c1e7370 0x7f094c0c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 --2- 172.21.15.194:0/2352268806 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09300052e0 0x7f094c152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 >> 172.21.15.194:0/2352268806 conn(0x7f094c06b840 msgr2=0x7f094c1570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 shutdown_connections 2024-03-07T10:21:34.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:34.814+0000 7f0951000640 1 -- 172.21.15.194:0/2352268806 wait complete. 2024-03-07T10:21:34.834 INFO:teuthology.run_tasks:Running task kclient... 2024-03-07T10:21:34.863 INFO:tasks.kclient:Mounting kernel clients... 2024-03-07T10:21:34.863 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-03-07T10:21:34.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:34.864 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-07T10:21:34.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:34.916 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-03-07T10:21:34.997 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-03-07T10:21:35.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:21:35.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:35.003 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-07T10:21:35.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:35.061 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-07T10:21:35.152 INFO:teuthology.orchestra.run.smithi196.stderr:Cannot find device "ceph-brx" 2024-03-07T10:21:35.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:21:35.156 INFO:tasks.kclient:client.0 config is {'syntax': 'v1', 'cephfs_name': 'a'} 2024-03-07T10:21:35.157 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T10:21:35.157 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:35.157 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T10:21:35.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.372+0000 7f1d6a400640 1 Processor -- start 2024-03-07T10:21:35.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.372+0000 7f1d6a400640 1 -- start start 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.373+0000 7f1d6a400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1d6406b350 0x7f1d64155690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.373+0000 7f1d6a400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d640c4790 0x7f1d64155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.373+0000 7f1d6a400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d64072c30 con 0x7f1d6406bca0 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d6a400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d64072f10 con 0x7f1d640c4790 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d6a400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d64159730 con 0x7f1d6406b350 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d640c4790 0x7f1d64155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d640c4790 0x7f1d64155bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60968/0 (socket says 172.21.15.194:60968) 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 -- 172.21.15.194:0/3201681786 learned_addr learned my addr 172.21.15.194:0/3201681786 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63400640 1 --2- 172.21.15.194:0/3201681786 >> v2:172.21.15.196:3300/0 conn(0x7f1d6406b350 0x7f1d64155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 -- 172.21.15.194:0/3201681786 >> v2:172.21.15.196:3300/0 conn(0x7f1d6406b350 msgr2=0x7f1d64155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 --2- 172.21.15.194:0/3201681786 >> v2:172.21.15.196:3300/0 conn(0x7f1d6406b350 0x7f1d64155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 -- 172.21.15.194:0/3201681786 >> v1:172.21.15.196:6789/0 conn(0x7f1d6406bca0 legacy=0x7f1d64152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:35.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.374+0000 7f1d63e00640 1 -- 172.21.15.194:0/3201681786 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d64159a10 con 0x7f1d640c4790 2024-03-07T10:21:35.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.376+0000 7f1d63e00640 1 --2- 172.21.15.194:0/3201681786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d64155bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1d640629a0 tx=0x7f1d5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7addf8c09a767111 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:35.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d62000640 1 -- 172.21.15.194:0/3201681786 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c02ca80 con 0x7f1d640c4790 2024-03-07T10:21:35.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d62000640 1 -- 172.21.15.194:0/3201681786 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5c02cc20 con 0x7f1d640c4790 2024-03-07T10:21:35.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d62000640 1 -- 172.21.15.194:0/3201681786 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5c0343f0 con 0x7f1d640c4790 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 -- 172.21.15.194:0/3201681786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 msgr2=0x7f1d64155bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 --2- 172.21.15.194:0/3201681786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d64155bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1d640629a0 tx=0x7f1d5c02bee0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 -- 172.21.15.194:0/3201681786 shutdown_connections 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 --2- 172.21.15.194:0/3201681786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d64155bd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 --2- 172.21.15.194:0/3201681786 >> v2:172.21.15.196:3300/0 conn(0x7f1d6406b350 0x7f1d64155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 -- 172.21.15.194:0/3201681786 >> 172.21.15.194:0/3201681786 conn(0x7f1d640c4bd0 msgr2=0x7f1d640c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 -- 172.21.15.194:0/3201681786 shutdown_connections 2024-03-07T10:21:35.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.377+0000 7f1d6a400640 1 -- 172.21.15.194:0/3201681786 wait complete. 2024-03-07T10:21:35.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.379+0000 7f1d6a400640 1 Processor -- start 2024-03-07T10:21:35.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.379+0000 7f1d6a400640 1 -- start start 2024-03-07T10:21:35.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d6406b350 0x7f1d64146e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d641469e0 0x7f1d64150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640a94d0 con 0x7f1d640c4790 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640c3b70 con 0x7f1d6406b350 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d6a400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d640a9650 con 0x7f1d641469e0 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60972/0 (socket says 172.21.15.194:60972) 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 -- 172.21.15.194:0/353993098 learned_addr learned my addr 172.21.15.194:0/353993098 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d63400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d6406b350 0x7f1d64146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d63e00640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d641469e0 0x7f1d64150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 -- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d641469e0 msgr2=0x7f1d64150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d641469e0 0x7f1d64150690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 -- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d6406b350 msgr2=0x7f1d64146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d6406b350 0x7f1d64146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.381+0000 7f1d62a00640 1 -- 172.21.15.194:0/353993098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d640c2580 con 0x7f1d640c4790 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d62a00640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c460 tx=0x7f1d5000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011790 con 0x7f1d640c4790 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d50017070 con 0x7f1d640c4790 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d641ef4b0 con 0x7f1d640c4790 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d50011bb0 con 0x7f1d640c4790 2024-03-07T10:21:35.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.382+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6414fde0 con 0x7f1d640c4790 2024-03-07T10:21:35.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.383+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d641eb5b0 con 0x7f1d640c4790 2024-03-07T10:21:35.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.384+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1d5001c460 con 0x7f1d640c4790 2024-03-07T10:21:35.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.385+0000 7f1d5b400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 0x7f1d4406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:35.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.385+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6521+0+0 (secure 0 0 0) 0x7f1d5008a3d0 con 0x7f1d640c4790 2024-03-07T10:21:35.387 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.386+0000 7f1d63400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 0x7f1d4406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:35.388 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.387+0000 7f1d63400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 0x7f1d4406d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400a970 tx=0x7f1d54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:35.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.390+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1d50058e90 con 0x7f1d640c4790 2024-03-07T10:21:35.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.629+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d640c5c40 con 0x7f1d640c4790 2024-03-07T10:21:35.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.630+0000 7f1d5b400640 1 -- 172.21.15.194:0/353993098 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+116 (secure 0 0 0) 0x7f1d50058790 con 0x7f1d640c4790 2024-03-07T10:21:35.631 INFO:teuthology.orchestra.run.smithi194.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-03-07T10:21:35.631 INFO:teuthology.orchestra.run.smithi194.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-03-07T10:21:35.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.632+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 msgr2=0x7f1d4406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.632+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 0x7f1d4406d990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1d5400a970 tx=0x7f1d54008040 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 msgr2=0x7f1d641464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1d5000c460 tx=0x7f1d5000c920 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 shutdown_connections 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1d4406b4d0 0x7f1d4406d990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1d641469e0 0x7f1d64150690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d640c4790 0x7f1d641464a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 --2- 172.21.15.194:0/353993098 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1d6406b350 0x7f1d64146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 >> 172.21.15.194:0/353993098 conn(0x7f1d640c4bd0 msgr2=0x7f1d640c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 shutdown_connections 2024-03-07T10:21:35.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:35.633+0000 7f1d6a400640 1 -- 172.21.15.194:0/353993098 wait complete. 2024-03-07T10:21:35.652 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-03-07T10:21:35.652 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T10:21:35.652 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-03-07T10:21:35.652 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-07T10:21:35.652 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:35.653 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-03-07T10:21:35.653 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T10:21:35.653 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T10:21:35.653 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-07T10:21:35.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:35.653 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-03-07T10:21:35.701 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42504sec preferred_lft 42504sec 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link 2024-03-07T10:21:35.702 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:35.704 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-07T10:21:35.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-07T10:21:35.704 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-07T10:21:36.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:36.153 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T10:21:36.235 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-03-07T10:21:36.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:36.239 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-03-07T10:21:36.289 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-03-07T10:21:36.289 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T10:21:36.289 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T10:21:36.289 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T10:21:36.289 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T10:21:36.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T10:21:36.290 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-07T10:21:36.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:36.942 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-07T10:21:36.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:36.997 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-03-07T10:21:37.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:37.045 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-07T10:21:37.045 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-07T10:21:37.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T10:21:37.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-07T10:21:37.045 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-07T10:21:37.189 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-07T10:21:37.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-07T10:21:37.190 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-07T10:21:37.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:37.466 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-03-07T10:21:37.466 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-03-07T10:21:37.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-03-07T10:21:37.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-03-07T10:21:37.466 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-03-07T10:21:37.620 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T10:21:37.621 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:37.662 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-07T10:21:37.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T10:21:37.662 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:37.752 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-07T10:21:37.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:37.752 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-07T10:21:37.871 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-07T10:21:37.872 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-07T10:21:37.872 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-07T10:21:38.490 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-07T10:21:38.490 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-07T10:21:38.490 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-07T10:21:38.490 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.194:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-07T10:21:38.491 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-07T10:21:38.522 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=a 2024-03-07T10:21:38.522 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a". 2024-03-07T10:21:38.522 INFO:teuthology.orchestra.run.smithi194.stdout:invalid new device string format 2024-03-07T10:21:38.522 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.194:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-07T10:21:38.522 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-07T10:21:38.523 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.194:6789,172.21.15.196:6789,172.21.15.196:6790" 2024-03-07T10:21:38.523 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.194:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2024-03-07T10:21:38.523 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=a,key=0,fsid=4f04f9a7-36ed-4153-a852-b0f479c9f76c" will pass to kernel 2024-03-07T10:21:38.525 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-07T10:21:38.525 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-03-07T10:21:38.525 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-07T10:21:38.525 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-03-07T10:21:38.525 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-07T10:21:38.529 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T10:21:38.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:38.529 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:38.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:38.609 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:38.669 INFO:teuthology.orchestra.run.smithi194.stdout:client4529 2024-03-07T10:21:38.669 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:21:38.669 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:21:38.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:38.720 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:38.828 INFO:teuthology.orchestra.run.smithi194.stdout:client4529 2024-03-07T10:21:38.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:38.829 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:38.900 INFO:teuthology.orchestra.run.smithi194.stdout:client4529 2024-03-07T10:21:38.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:38.901 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f04f9a7-36ed-4153-a852-b0f479c9f76c.client4529/status') 2024-03-07T10:21:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4529 (3)172.21.15.194:0/419283186 2024-03-07T10:21:39.005 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-03-07T10:21:39.005 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-03-07T10:21:39.005 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-03-07T10:21:39.005 INFO:teuthology.orchestra.run.smithi194.stderr:70 bytes copied, 7.804e-05 s, 897 kB/s 2024-03-07T10:21:39.008 INFO:tasks.kclient:client.1 config is {'syntax': 'v1', 'cephfs_name': 'b'} 2024-03-07T10:21:39.008 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-07T10:21:39.009 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:39.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-07T10:21:39.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.246+0000 7f4850400640 1 Processor -- start 2024-03-07T10:21:39.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.246+0000 7f4850400640 1 -- start start 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f4850400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f484806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f4850400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f484806de40 0x7f484815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f4850400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4848153980 con 0x7f4848150b70 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f4850400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4848153c60 con 0x7f484806de40 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f4850400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4848153f40 con 0x7f4848156c20 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f484da00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4848150b70 0x7f48480a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50930/0 (socket says 172.21.15.194:50930) 2024-03-07T10:21:39.250 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.248+0000 7f484da00640 1 -- 172.21.15.194:0/2258212281 learned_addr learned my addr 172.21.15.194:0/2258212281 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:39.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f484e400640 1 --2- 172.21.15.194:0/2258212281 >> v2:172.21.15.196:3300/0 conn(0x7f484806de40 0x7f484815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f484d000640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f484806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807923146 0 0) 0x7f4848153980 con 0x7f4848150b70 2024-03-07T10:21:39.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003520 con 0x7f4848150b70 2024-03-07T10:21:39.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460300490 0 0) 0x7f482c003520 con 0x7f4848150b70 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 msgr2=0x7f484806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f484806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 >> v2:172.21.15.196:3300/0 conn(0x7f484806de40 msgr2=0x7f484815dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 --2- 172.21.15.194:0/2258212281 >> v2:172.21.15.196:3300/0 conn(0x7f484806de40 0x7f484815dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848154220 con 0x7f4848150b70 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f4838001670 con 0x7f4848150b70 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.249+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 >> v1:172.21.15.194:6789/0 conn(0x7f4848150b70 legacy=0x7f48480a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f482c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f482c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f482c004d40 0x7f482c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848153c60 con 0x7f482c0039b0 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848153f40 con 0x7f482c004d40 2024-03-07T10:21:39.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00b9f0 con 0x7f4848156c20 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f482c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484d000640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f482c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 -- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 msgr2=0x7f482c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4848156c20 0x7f482c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 -- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f482c004d40 msgr2=0x7f482c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f482c004d40 0x7f482c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.250+0000 7f484da00640 1 -- 172.21.15.194:0/2258212281 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c003520 con 0x7f482c0039b0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.251+0000 7f484da00640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f482c003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4838001050 tx=0x7f482c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c6aa6288a00f33 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.251+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838007ca0 con 0x7f482c0039b0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.251+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838030070 con 0x7f482c0039b0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4847e00640 1 -- 172.21.15.194:0/2258212281 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838005d10 con 0x7f482c0039b0 2024-03-07T10:21:39.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 -- 172.21.15.194:0/2258212281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 msgr2=0x7f482c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 --2- 172.21.15.194:0/2258212281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f482c003dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4838001050 tx=0x7f482c005830 comp rx=0 tx=0).stop 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f484e400640 1 -- 172.21.15.194:0/2258212281 reap_dead start 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 -- 172.21.15.194:0/2258212281 shutdown_connections 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 -- 172.21.15.194:0/2258212281 >> 172.21.15.194:0/2258212281 conn(0x7f484806b840 msgr2=0x7f48480c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 -- 172.21.15.194:0/2258212281 shutdown_connections 2024-03-07T10:21:39.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.252+0000 7f4850400640 1 -- 172.21.15.194:0/2258212281 wait complete. 2024-03-07T10:21:39.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.254+0000 7f4850400640 1 Processor -- start 2024-03-07T10:21:39.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.254+0000 7f4850400640 1 -- start start 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48481567a0 0x7f4848151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48481ee7d0 0x7f484814a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480a9be0 con 0x7f482c0039b0 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4848153630 con 0x7f48481567a0 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f4850400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48480a9d60 con 0x7f48481ee7d0 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f484da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f484da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58054/0 (socket says 172.21.15.194:58054) 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.255+0000 7f484da00640 1 -- 172.21.15.194:0/4086596844 learned_addr learned my addr 172.21.15.194:0/4086596844 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:39.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484e400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48481ee7d0 0x7f484814a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 -- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48481ee7d0 msgr2=0x7f484814a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48481ee7d0 0x7f484814a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 -- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48481567a0 msgr2=0x7f4848151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48481567a0 0x7f4848151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 -- 172.21.15.194:0/4086596844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48481ef480 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f484da00640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4838007fd0 tx=0x7f4838000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838004bf0 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4838004d90 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48481e1710 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.256+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380072b0 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.257+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48481ef110 con 0x7f482c0039b0 2024-03-07T10:21:39.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.258+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4848068170 con 0x7f482c0039b0 2024-03-07T10:21:39.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.259+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4838007450 con 0x7f482c0039b0 2024-03-07T10:21:39.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.259+0000 7f4845600640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 0x7f482806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:39.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.260+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f48380abd40 con 0x7f482c0039b0 2024-03-07T10:21:39.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.260+0000 7f484d000640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 0x7f482806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:39.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.261+0000 7f484d000640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 0x7f482806d9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48480731d0 tx=0x7f4834008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:39.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.264+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f483807a810 con 0x7f482c0039b0 2024-03-07T10:21:39.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.500+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f484806cd20 con 0x7f482c0039b0 2024-03-07T10:21:39.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.501+0000 7f4845600640 1 -- 172.21.15.194:0/4086596844 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+116 (secure 0 0 0) 0x7f483807a110 con 0x7f482c0039b0 2024-03-07T10:21:39.503 INFO:teuthology.orchestra.run.smithi194.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-03-07T10:21:39.503 INFO:teuthology.orchestra.run.smithi194.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 msgr2=0x7f482806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 0x7f482806d9c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f48480731d0 tx=0x7f4834008040 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 msgr2=0x7f484814b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f4838007fd0 tx=0x7f4838000fe0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 shutdown_connections 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f482806b500 0x7f482806d9c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48481ee7d0 0x7f484814a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f48481567a0 0x7f4848151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 --2- 172.21.15.194:0/4086596844 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f482c0039b0 0x7f484814b940 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:39.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.503+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 >> 172.21.15.194:0/4086596844 conn(0x7f484806b840 msgr2=0x7f48480c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:39.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.504+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 shutdown_connections 2024-03-07T10:21:39.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:39.504+0000 7f4850400640 1 -- 172.21.15.194:0/4086596844 wait complete. 2024-03-07T10:21:39.523 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi196.front.sepia.ceph.com 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-07T10:21:39.524 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-07T10:21:39.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:39.524 DEBUG:teuthology.orchestra.run.smithi196:> ip addr 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: inet 127.0.0.1/8 scope host lo 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 ::1/128 scope host 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:be brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f0 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:d9:38:bf brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout: altname enp7s0f1 2024-03-07T10:21:39.586 INFO:teuthology.orchestra.run.smithi196.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:46 brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: link/ether 0c:c4:7a:88:7f:47 brd ff:ff:ff:ff:ff:ff 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: inet 172.21.15.196/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft 42548sec preferred_lft 42548sec 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: inet6 fe80::ec4:7aff:fe88:7f47/64 scope link 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run.smithi196.stdout: valid_lft forever preferred_lft forever 2024-03-07T10:21:39.587 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-07T10:21:39.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:39.587 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add name ceph-brx type bridge 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr flush dev ceph-brx 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set ceph-brx up 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-07T10:21:39.588 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-07T10:21:40.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.002 DEBUG:teuthology.orchestra.run.smithi196:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-07T10:21:40.077 INFO:teuthology.orchestra.run.smithi196.stdout:1 2024-03-07T10:21:40.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.081 DEBUG:teuthology.orchestra.run.smithi196:> route 2024-03-07T10:21:40.129 INFO:teuthology.orchestra.run.smithi196.stdout:Kernel IP routing table 2024-03-07T10:21:40.129 INFO:teuthology.orchestra.run.smithi196.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-07T10:21:40.130 INFO:teuthology.orchestra.run.smithi196.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-07T10:21:40.130 INFO:teuthology.orchestra.run.smithi196.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-07T10:21:40.130 INFO:teuthology.orchestra.run.smithi196.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-07T10:21:40.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.131 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-07T10:21:40.131 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-07T10:21:40.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-07T10:21:40.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-07T10:21:40.131 DEBUG:teuthology.orchestra.run.smithi196:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-07T10:21:40.132 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-07T10:21:40.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.852 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-07T10:21:40.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.905 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list-id 2024-03-07T10:21:40.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:40.952 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-07T10:21:40.952 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-07T10:21:40.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-07T10:21:40.952 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-07T10:21:40.952 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-07T10:21:41.135 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-07T10:21:41.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:41.135 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-07T10:21:41.136 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-07T10:21:41.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:41.422 DEBUG:teuthology.orchestra.run.smithi196:> (cd / && exec bash -c ' 2024-03-07T10:21:41.422 DEBUG:teuthology.orchestra.run.smithi196:> set -e 2024-03-07T10:21:41.422 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set brx.0 up 2024-03-07T10:21:41.422 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link set dev brx.0 master ceph-brx 2024-03-07T10:21:41.422 DEBUG:teuthology.orchestra.run.smithi196:> ') 2024-03-07T10:21:41.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T10:21:41.587 DEBUG:teuthology.orchestra.run.smithi196:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:41.633 INFO:teuthology.orchestra.run.smithi196.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-07T10:21:41.634 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-07T10:21:41.634 DEBUG:teuthology.orchestra.run.smithi196:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:41.721 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-03-07T10:21:41.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:41.722 DEBUG:teuthology.orchestra.run.smithi196:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-07T10:21:41.887 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-07T10:21:41.888 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-07T10:21:41.888 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-07T10:21:42.533 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-07T10:21:42.533 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-07T10:21:42.533 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-07T10:21:42.533 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.194:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-07T10:21:42.533 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=b 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b". 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:invalid new device string format 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.194:3300,172.21.15.196:3300,172.21.15.196:3301" 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: switching to using v1 address with old syntax 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: resolved to: "172.21.15.194:6789,172.21.15.196:6789,172.21.15.196:6790" 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.194:6789,172.21.15.196:6789,172.21.15.196:6790:/ 2024-03-07T10:21:42.570 INFO:teuthology.orchestra.run.smithi196.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=b,key=1,fsid=4f04f9a7-36ed-4153-a852-b0f479c9f76c" will pass to kernel 2024-03-07T10:21:42.575 INFO:teuthology.orchestra.run.smithi196.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-07T10:21:42.575 INFO:teuthology.orchestra.run.smithi196.stdout: You just mounted a file system that supports labels which does not 2024-03-07T10:21:42.575 INFO:teuthology.orchestra.run.smithi196.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-07T10:21:42.576 INFO:teuthology.orchestra.run.smithi196.stdout: applications will generate AVC messages and not be allowed access to 2024-03-07T10:21:42.576 INFO:teuthology.orchestra.run.smithi196.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-07T10:21:42.581 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-07T10:21:42.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:42.581 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:42.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:42.668 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:42.739 INFO:teuthology.orchestra.run.smithi196.stdout:client4535 2024-03-07T10:21:42.739 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:21:42.739 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:21:42.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:42.791 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:42.856 INFO:teuthology.orchestra.run.smithi196.stdout:client4535 2024-03-07T10:21:42.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:42.856 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-07T10:21:42.914 INFO:teuthology.orchestra.run.smithi196.stdout:client4535 2024-03-07T10:21:42.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:21:42.914 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/4f04f9a7-36ed-4153-a852-b0f479c9f76c.client4535/status') 2024-03-07T10:21:43.002 INFO:teuthology.orchestra.run.smithi196.stdout:instance: client.4535 (3)192.168.0.1:0/1501802044 2024-03-07T10:21:43.002 INFO:teuthology.orchestra.run.smithi196.stdout:blocklisted: false 2024-03-07T10:21:43.002 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records in 2024-03-07T10:21:43.002 INFO:teuthology.orchestra.run.smithi196.stderr:0+1 records out 2024-03-07T10:21:43.002 INFO:teuthology.orchestra.run.smithi196.stderr:69 bytes copied, 7.1074e-05 s, 971 kB/s 2024-03-07T10:21:43.006 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-03-07T10:21:43.018 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:43.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.254+0000 7f0764c00640 1 Processor -- start 2024-03-07T10:21:43.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.254+0000 7f0764c00640 1 -- start start 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f0764c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f076006b3f0 0x7f076006b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f0764c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600c41f0 con 0x7f0760152d70 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f0764c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600c2320 con 0x7f076015de90 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f0764c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600c2600 con 0x7f076006b3f0 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f075f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0760152d70 0x7f076006e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50946/0 (socket says 172.21.15.194:50946) 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f075f400640 1 -- 172.21.15.194:0/123880712 learned_addr learned my addr 172.21.15.194:0/123880712 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.256+0000 7f075ea00640 1 --2- 172.21.15.194:0/123880712 >> v2:172.21.15.196:3300/0 conn(0x7f076006b3f0 0x7f076006b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828925660 0 0) 0x7f07600c41f0 con 0x7f0760152d70 2024-03-07T10:21:43.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0744003520 con 0x7f0760152d70 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429783840 0 0) 0x7f0744003520 con 0x7f0760152d70 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 >> v2:172.21.15.196:3300/0 conn(0x7f076006b3f0 msgr2=0x7f076006b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 --2- 172.21.15.194:0/123880712 >> v2:172.21.15.196:3300/0 conn(0x7f076006b3f0 0x7f076006b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 >> v1:172.21.15.196:6789/0 conn(0x7f076015de90 legacy=0x7f0760160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07601562d0 con 0x7f0760152d70 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f0750001670 con 0x7f0760152d70 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 >> v1:172.21.15.194:6789/0 conn(0x7f0760152d70 legacy=0x7f076006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0744003a00 0x7f0744003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0744004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0744005210 0x7f074400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07600c2600 con 0x7f0744004800 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074400c160 con 0x7f0744005210 2024-03-07T10:21:43.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074400c360 con 0x7f0744003a00 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.257+0000 7f075ea00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0744004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075f400640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0744003a00 0x7f0744003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075fe00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0744005210 0x7f074400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075ea00640 1 -- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0744003a00 msgr2=0x7f0744003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075ea00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0744003a00 0x7f0744003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075ea00640 1 -- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0744005210 msgr2=0x7f074400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075ea00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0744005210 0x7f074400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075ea00640 1 -- 172.21.15.194:0/123880712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0744003520 con 0x7f0744004800 2024-03-07T10:21:43.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.258+0000 7f075fe00640 1 -- 172.21.15.194:0/123880712 reap_dead start 2024-03-07T10:21:43.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.259+0000 7f075ea00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0744004c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f074c009f90 tx=0x7f0744005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87d7756c85b7ff server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.259+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c039070 con 0x7f0744004800 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.259+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c02cbd0 con 0x7f0744004800 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.259+0000 7f075e000640 1 -- 172.21.15.194:0/123880712 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c009c10 con 0x7f0744004800 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 -- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 msgr2=0x7f0744004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0744004c80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f074c009f90 tx=0x7f0744005830 comp rx=0 tx=0).stop 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 -- 172.21.15.194:0/123880712 shutdown_connections 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 --2- 172.21.15.194:0/123880712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0744004c80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 -- 172.21.15.194:0/123880712 >> 172.21.15.194:0/123880712 conn(0x7f07600c4980 msgr2=0x7f07600c4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 -- 172.21.15.194:0/123880712 shutdown_connections 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.260+0000 7f0764c00640 1 -- 172.21.15.194:0/123880712 wait complete. 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.262+0000 7f0764c00640 1 Processor -- start 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.262+0000 7f0764c00640 1 -- start start 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 0x7f076015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07601eeb40 0x7f07601eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07601565b0 con 0x7f0744004800 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760156080 con 0x7f0760157e40 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f0764c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076006fc50 con 0x7f07601eeb40 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58080/0 (socket says 172.21.15.194:58080) 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 -- 172.21.15.194:0/1178764088 learned_addr learned my addr 172.21.15.194:0/1178764088 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075ea00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 0x7f076015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075fe00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07601eeb40 0x7f07601eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 -- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07601eeb40 msgr2=0x7f07601eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07601eeb40 0x7f07601eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 -- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 msgr2=0x7f076015bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 0x7f076015bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.263+0000 7f075f400640 1 -- 172.21.15.194:0/1178764088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760159240 con 0x7f0744004800 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f075ea00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 0x7f076015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f075f400640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f075000e740 tx=0x7f075000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000ee50 con 0x7f0744004800 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750018070 con 0x7f0744004800 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000cb10 con 0x7f0744004800 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076014eb00 con 0x7f0744004800 2024-03-07T10:21:43.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.264+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076014f0c0 con 0x7f0744004800 2024-03-07T10:21:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.265+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0760068880 con 0x7f0744004800 2024-03-07T10:21:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.266+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f075000ccb0 con 0x7f0744004800 2024-03-07T10:21:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.267+0000 7f0757400640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 0x7f074006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.267+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f075008a150 con 0x7f0744004800 2024-03-07T10:21:43.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.268+0000 7f075ea00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 0x7f074006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.269+0000 7f075ea00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 0x7f074006d9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f074c036000 tx=0x7f074c02e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.272+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0750058c20 con 0x7f0744004800 2024-03-07T10:21:43.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.471+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f076006bef0 con 0x7f0744004800 2024-03-07T10:21:43.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.473+0000 7f0757400640 1 -- 172.21.15.194:0/1178764088 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7f0750058520 con 0x7f0744004800 2024-03-07T10:21:43.475 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:43.475 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:43.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 msgr2=0x7f074006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 0x7f074006d9c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f074c036000 tx=0x7f074c02e000 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 msgr2=0x7f0760159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f075000e740 tx=0x7f075000ec00 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 shutdown_connections 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f074006b500 0x7f074006d9c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f07601eeb40 0x7f07601eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0760157e40 0x7f076015bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 --2- 172.21.15.194:0/1178764088 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0744004800 0x7f0760159660 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 >> 172.21.15.194:0/1178764088 conn(0x7f07600c4980 msgr2=0x7f0760151690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 shutdown_connections 2024-03-07T10:21:43.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.476+0000 7f0764c00640 1 -- 172.21.15.194:0/1178764088 wait complete. 2024-03-07T10:21:43.496 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:43.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.700+0000 7f22a0400640 1 Processor -- start 2024-03-07T10:21:43.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.700+0000 7f22a0400640 1 -- start start 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f22a0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22980726d0 0x7f229806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f22a0400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22980c2a60 0x7f229806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f22a0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980719b0 con 0x7f2298071be0 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f22a0400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f229806c9f0 con 0x7f22980c2a60 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f22a0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298071520 con 0x7f22980726d0 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f229da00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f2298071be0 0x7f2298071fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50960/0 (socket says 172.21.15.194:50960) 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f229da00640 1 -- 172.21.15.194:0/4279498272 learned_addr learned my addr 172.21.15.194:0/4279498272 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:43.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.703+0000 7f229e400640 1 --2- 172.21.15.194:0/4279498272 >> v2:172.21.15.194:3300/0 conn(0x7f22980c2a60 0x7f229806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f229d000640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22980726d0 0x7f229806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f2297e00640 1 -- 172.21.15.194:0/4279498272 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835271735 0 0) 0x7f22980719b0 con 0x7f2298071be0 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f2297e00640 1 -- 172.21.15.194:0/4279498272 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2280003520 con 0x7f2298071be0 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f229e400640 1 -- 172.21.15.194:0/4279498272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22980726d0 msgr2=0x7f229806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f229e400640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22980726d0 0x7f229806b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f229e400640 1 -- 172.21.15.194:0/4279498272 >> v1:172.21.15.194:6789/0 conn(0x7f2298071be0 legacy=0x7f2298071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.704+0000 7f229e400640 1 -- 172.21.15.194:0/4279498272 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229806bb00 con 0x7f22980c2a60 2024-03-07T10:21:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.705+0000 7f229e400640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980c2a60 0x7f229806b5c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2290009d90 tx=0x7f229002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bcf0b005ca02e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.705+0000 7f2297e00640 1 -- 172.21.15.194:0/4279498272 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290039070 con 0x7f22980c2a60 2024-03-07T10:21:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.705+0000 7f2297e00640 1 -- 172.21.15.194:0/4279498272 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229002cbd0 con 0x7f22980c2a60 2024-03-07T10:21:43.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.705+0000 7f2297e00640 1 -- 172.21.15.194:0/4279498272 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2290034440 con 0x7f22980c2a60 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 -- 172.21.15.194:0/4279498272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980c2a60 msgr2=0x7f229806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980c2a60 0x7f229806b5c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2290009d90 tx=0x7f229002be20 comp rx=0 tx=0).stop 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 -- 172.21.15.194:0/4279498272 shutdown_connections 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980c2a60 0x7f229806b5c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 --2- 172.21.15.194:0/4279498272 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f22980726d0 0x7f229806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 -- 172.21.15.194:0/4279498272 >> 172.21.15.194:0/4279498272 conn(0x7f22980c7630 msgr2=0x7f22980c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 -- 172.21.15.194:0/4279498272 shutdown_connections 2024-03-07T10:21:43.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.706+0000 7f22a0400640 1 -- 172.21.15.194:0/4279498272 wait complete. 2024-03-07T10:21:43.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.708+0000 7f22a0400640 1 Processor -- start 2024-03-07T10:21:43.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.708+0000 7f22a0400640 1 -- start start 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2298071be0 0x7f22980c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 0x7f229814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981531c0 con 0x7f22980726d0 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2298152ee0 con 0x7f22980c2a60 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f22a0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22980c3a00 con 0x7f2298071be0 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58098/0 (socket says 172.21.15.194:58098) 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 -- 172.21.15.194:0/2869015397 learned_addr learned my addr 172.21.15.194:0/2869015397 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229da00640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2298071be0 0x7f22980c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229e400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 0x7f229814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 -- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2298071be0 msgr2=0x7f22980c0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2298071be0 0x7f22980c0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 -- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 msgr2=0x7f229814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.709+0000 7f229d000640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 0x7f229814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f229d000640 1 -- 172.21.15.194:0/2869015397 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22981224d0 con 0x7f22980726d0 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f229e400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 0x7f229814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:43.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f229d000640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f228400d800 tx=0x7f228400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400b6c0 con 0x7f22980726d0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284019070 con 0x7f22980726d0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22980ac950 con 0x7f22980726d0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400ba80 con 0x7f22980726d0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.710+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22981eb970 con 0x7f22980726d0 2024-03-07T10:21:43.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.711+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2298068880 con 0x7f22980726d0 2024-03-07T10:21:43.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.712+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f228400bc20 con 0x7f22980726d0 2024-03-07T10:21:43.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.713+0000 7f2295600640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:43.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.713+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f228408ab20 con 0x7f22980726d0 2024-03-07T10:21:43.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.714+0000 7f229da00640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:43.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.715+0000 7f229da00640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 0x7f227806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f228c005880 tx=0x7f228c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:43.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.718+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f228401c360 con 0x7f22980726d0 2024-03-07T10:21:43.914 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.913+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22980c2840 con 0x7f22980726d0 2024-03-07T10:21:43.915 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.913+0000 7f2295600640 1 -- 172.21.15.194:0/2869015397 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2284059560 con 0x7f22980726d0 2024-03-07T10:21:43.915 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 msgr2=0x7f227806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 0x7f227806d990 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f228c005880 tx=0x7f228c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 msgr2=0x7f229814c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f228400d800 tx=0x7f228400dcc0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 shutdown_connections 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f227806b4d0 0x7f227806d990 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f22980c2a60 0x7f229814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22980726d0 0x7f229814c370 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 --2- 172.21.15.194:0/2869015397 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2298071be0 0x7f22980c0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:43.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.916+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 >> 172.21.15.194:0/2869015397 conn(0x7f22980c7630 msgr2=0x7f229806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:43.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.917+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 shutdown_connections 2024-03-07T10:21:43.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:43.917+0000 7f22a0400640 1 -- 172.21.15.194:0/2869015397 wait complete. 2024-03-07T10:21:43.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:44.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.138+0000 7f72de600640 1 Processor -- start 2024-03-07T10:21:44.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.138+0000 7f72de600640 1 -- start start 2024-03-07T10:21:44.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.139+0000 7f72de600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 0x7f72d80c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.139+0000 7f72de600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d8158ff0 con 0x7f72d81559d0 2024-03-07T10:21:44.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.139+0000 7f72de600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d81592d0 con 0x7f72d81530b0 2024-03-07T10:21:44.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.139+0000 7f72de600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d806dde0 con 0x7f72d80c9360 2024-03-07T10:21:44.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.140+0000 7f72d7e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f72d81559d0 0x7f72d8155dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50966/0 (socket says 172.21.15.194:50966) 2024-03-07T10:21:44.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.140+0000 7f72d7e00640 1 -- 172.21.15.194:0/2940029754 learned_addr learned my addr 172.21.15.194:0/2940029754 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:44.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.140+0000 7f72d6a00640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 0x7f72d80c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.140+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047727865 0 0) 0x7f72d8158ff0 con 0x7f72d81559d0 2024-03-07T10:21:44.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.140+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72bc003520 con 0x7f72d81559d0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381395689 0 0) 0x7f72d81592d0 con 0x7f72d81530b0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72d8158ff0 con 0x7f72d81530b0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4083317344 0 0) 0x7f72bc003520 con 0x7f72d81559d0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 msgr2=0x7f72d80c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 0x7f72d80c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 >> v1:172.21.15.196:6789/0 conn(0x7f72d81530b0 legacy=0x7f72d80c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d81595b0 con 0x7f72d81559d0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f72d00019f0 con 0x7f72d81559d0 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 >> v1:172.21.15.194:6789/0 conn(0x7f72d81559d0 legacy=0x7f72d8155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc003b70 0x7f72bc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 0x7f72bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72bc004d40 0x7f72bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d806dde0 con 0x7f72bc004d40 2024-03-07T10:21:44.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc00bb50 con 0x7f72bc003b70 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72bc00bd20 con 0x7f72d80c9360 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.141+0000 7f72d7e00640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72bc004d40 0x7f72bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7400640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc003b70 0x7f72bc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7e00640 1 -- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 msgr2=0x7f72bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7e00640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d80c9360 0x7f72bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7e00640 1 -- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc003b70 msgr2=0x7f72bc003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7e00640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc003b70 0x7f72bc003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.142+0000 7f72d7e00640 1 -- 172.21.15.194:0/2940029754 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc003520 con 0x7f72bc004d40 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.143+0000 7f72d7e00640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72bc004d40 0x7f72bc0051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72d000a760 tx=0x7f72bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87cc4542c8bcef3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.143+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d000a350 con 0x7f72bc004d40 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.143+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d0034650 con 0x7f72bc004d40 2024-03-07T10:21:44.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.143+0000 7f72d6000640 1 -- 172.21.15.194:0/2940029754 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d0034a40 con 0x7f72bc004d40 2024-03-07T10:21:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 -- 172.21.15.194:0/2940029754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72bc004d40 msgr2=0x7f72bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 --2- 172.21.15.194:0/2940029754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72bc004d40 0x7f72bc0051c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f72d000a760 tx=0x7f72bc005830 comp rx=0 tx=0).stop 2024-03-07T10:21:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72d7e00640 1 -- 172.21.15.194:0/2940029754 reap_dead start 2024-03-07T10:21:44.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 -- 172.21.15.194:0/2940029754 shutdown_connections 2024-03-07T10:21:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 -- 172.21.15.194:0/2940029754 >> 172.21.15.194:0/2940029754 conn(0x7f72d80cb020 msgr2=0x7f72d80cb430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 -- 172.21.15.194:0/2940029754 shutdown_connections 2024-03-07T10:21:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.144+0000 7f72de600640 1 -- 172.21.15.194:0/2940029754 wait complete. 2024-03-07T10:21:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.147+0000 7f72de600640 1 Processor -- start 2024-03-07T10:21:44.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.147+0000 7f72de600640 1 -- start start 2024-03-07T10:21:44.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.148+0000 7f72de600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc004d40 0x7f72d8148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.148+0000 7f72de600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.148+0000 7f72de600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d81580f0 0x7f72d81477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72de600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c83c0 con 0x7f72d8157260 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72de600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d8159b70 con 0x7f72bc004d40 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72de600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c8540 con 0x7f72d81580f0 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58108/0 (socket says 172.21.15.194:58108) 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 -- 172.21.15.194:0/574104664 learned_addr learned my addr 172.21.15.194:0/574104664 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d7400640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc004d40 0x7f72d8148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d7e00640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d81580f0 0x7f72d81477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 -- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d81580f0 msgr2=0x7f72d81477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d81580f0 0x7f72d81477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 -- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc004d40 msgr2=0x7f72d8148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc004d40 0x7f72d8148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.149+0000 7f72d6a00640 1 -- 172.21.15.194:0/574104664 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d8157850 con 0x7f72d8157260 2024-03-07T10:21:44.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72d6a00640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e7f0 tx=0x7f72c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4017070 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400c940 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400eea0 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d814e500 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.150+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d81ef830 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.151+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d8157a20 con 0x7f72d8157260 2024-03-07T10:21:44.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.152+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f72c401a070 con 0x7f72d8157260 2024-03-07T10:21:44.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.153+0000 7f72cf400640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.154+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f72c408a770 con 0x7f72d8157260 2024-03-07T10:21:44.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.154+0000 7f72d7400640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.155+0000 7f72d7400640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 0x7f72b806d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007ae0 tx=0x7f72c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.159 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.158+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f72c4059240 con 0x7f72d8157260 2024-03-07T10:21:44.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.352+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72d806df60 con 0x7f72d8157260 2024-03-07T10:21:44.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.353+0000 7f72cf400640 1 -- 172.21.15.194:0/574104664 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f72c4058b40 con 0x7f72d8157260 2024-03-07T10:21:44.355 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:44.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.355+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 msgr2=0x7f72b806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 0x7f72b806d9c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f72c8007ae0 tx=0x7f72c8009040 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 msgr2=0x7f72d81eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f72c400e7f0 tx=0x7f72c400ecb0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 shutdown_connections 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f72b806b500 0x7f72b806d9c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72d81580f0 0x7f72d81477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72d8157260 0x7f72d81eecf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 --2- 172.21.15.194:0/574104664 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f72bc004d40 0x7f72d8148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 >> 172.21.15.194:0/574104664 conn(0x7f72d80cb020 msgr2=0x7f72d8155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 shutdown_connections 2024-03-07T10:21:44.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.356+0000 7f72de600640 1 -- 172.21.15.194:0/574104664 wait complete. 2024-03-07T10:21:44.384 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:44.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.593+0000 7f3205000640 1 Processor -- start 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.593+0000 7f3205000640 1 -- start start 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f3205000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 0x7f3200156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f3205000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f32000c1400 0x7f32000c1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f3205000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32000c3160 con 0x7f3200153280 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f3205000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32000c33d0 con 0x7f32000c1400 2024-03-07T10:21:44.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f3205000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c36b0 con 0x7f32000a5f50 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f31ff400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f3200153280 0x7f32000a8620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:34910/0 (socket says 172.21.15.194:34910) 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f31f6a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 0x7f3200156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.594+0000 7f31ff400640 1 -- 172.21.15.194:0/3626751969 learned_addr learned my addr 172.21.15.194:0/3626751969 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.595+0000 7f31ffe00640 1 --2- 172.21.15.194:0/3626751969 >> v2:172.21.15.196:3300/0 conn(0x7f32000c1400 0x7f32000c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.595+0000 7f31f6a00640 1 -- 172.21.15.194:0/3626751969 >> v2:172.21.15.196:3300/0 conn(0x7f32000c1400 msgr2=0x7f32000c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.595+0000 7f31f6a00640 1 --2- 172.21.15.194:0/3626751969 >> v2:172.21.15.196:3300/0 conn(0x7f32000c1400 0x7f32000c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.595+0000 7f31f6a00640 1 -- 172.21.15.194:0/3626751969 >> v1:172.21.15.196:6789/0 conn(0x7f3200153280 legacy=0x7f32000a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.595+0000 7f31f6a00640 1 -- 172.21.15.194:0/3626751969 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000c3990 con 0x7f32000a5f50 2024-03-07T10:21:44.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.597+0000 7f31f6a00640 1 --2- 172.21.15.194:0/3626751969 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 0x7f3200156520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31e80097a0 tx=0x7f31e802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d958b1e436aec8fc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.598+0000 7f31fea00640 1 -- 172.21.15.194:0/3626751969 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8031780 con 0x7f32000a5f50 2024-03-07T10:21:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.598+0000 7f31fea00640 1 -- 172.21.15.194:0/3626751969 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e8037070 con 0x7f32000a5f50 2024-03-07T10:21:44.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.598+0000 7f31fea00640 1 -- 172.21.15.194:0/3626751969 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8031b40 con 0x7f32000a5f50 2024-03-07T10:21:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 -- 172.21.15.194:0/3626751969 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 msgr2=0x7f3200156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 --2- 172.21.15.194:0/3626751969 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 0x7f3200156520 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f31e80097a0 tx=0x7f31e802b820 comp rx=0 tx=0).stop 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 -- 172.21.15.194:0/3626751969 shutdown_connections 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 --2- 172.21.15.194:0/3626751969 >> v2:172.21.15.196:3300/0 conn(0x7f32000c1400 0x7f32000c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 --2- 172.21.15.194:0/3626751969 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f32000a5f50 0x7f3200156520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 -- 172.21.15.194:0/3626751969 >> 172.21.15.194:0/3626751969 conn(0x7f320006cd60 msgr2=0x7f320006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 -- 172.21.15.194:0/3626751969 shutdown_connections 2024-03-07T10:21:44.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.599+0000 7f3205000640 1 -- 172.21.15.194:0/3626751969 wait complete. 2024-03-07T10:21:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.601+0000 7f3205000640 1 Processor -- start 2024-03-07T10:21:44.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.602+0000 7f3205000640 1 -- start start 2024-03-07T10:21:44.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 0x7f32000a87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3200153280 0x7f32001eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3200153660 con 0x7f32000c1400 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000c3f50 con 0x7f32000a5f50 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f3205000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32000a8d30 con 0x7f3200153280 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f31f6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f31f6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58124/0 (socket says 172.21.15.194:58124) 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.603+0000 7f31f6a00640 1 -- 172.21.15.194:0/3661402668 learned_addr learned my addr 172.21.15.194:0/3661402668 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31ffe00640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3200153280 0x7f32001eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31ff400640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 0x7f32000a87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 -- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3200153280 msgr2=0x7f32001eacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3200153280 0x7f32001eacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 -- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 msgr2=0x7f32000a87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 0x7f32000a87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 -- 172.21.15.194:0/3661402668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32000c04d0 con 0x7f32000c1400 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31ff400640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 0x7f32000a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f6a00640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f31e80098c0 tx=0x7f31e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8032610 con 0x7f32000c1400 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.604+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80327b0 con 0x7f32000c1400 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.605+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32000c07b0 con 0x7f32000c1400 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.605+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8032ba0 con 0x7f32000c1400 2024-03-07T10:21:44.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.605+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32000c00f0 con 0x7f32000c1400 2024-03-07T10:21:44.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.606+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3200075600 con 0x7f32000c1400 2024-03-07T10:21:44.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.607+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f31e804e440 con 0x7f32000c1400 2024-03-07T10:21:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.608+0000 7f31f7e00640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 0x7f31dc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.608+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f31e80ac210 con 0x7f32000c1400 2024-03-07T10:21:44.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.608+0000 7f31ff400640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 0x7f31dc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:44.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.610+0000 7f31ff400640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 0x7f31dc06d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31f0000f60 tx=0x7f31f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:44.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.612+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f31e8040070 con 0x7f32000c1400 2024-03-07T10:21:44.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.809+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f32001ee260 con 0x7f32000c1400 2024-03-07T10:21:44.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.809+0000 7f31f7e00640 1 -- 172.21.15.194:0/3661402668 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f31e802f050 con 0x7f32000c1400 2024-03-07T10:21:44.811 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:44.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 msgr2=0x7f31dc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 0x7f31dc06d9c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f31f0000f60 tx=0x7f31f0009040 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 msgr2=0x7f32001eecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f31e80098c0 tx=0x7f31e80046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 shutdown_connections 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31dc06b500 0x7f31dc06d9c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3200153280 0x7f32001eacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f32000c1400 0x7f32001eecb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 --2- 172.21.15.194:0/3661402668 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f32000a5f50 0x7f32000a87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 >> 172.21.15.194:0/3661402668 conn(0x7f320006cd60 msgr2=0x7f320006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 shutdown_connections 2024-03-07T10:21:44.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:44.813+0000 7f3205000640 1 -- 172.21.15.194:0/3661402668 wait complete. 2024-03-07T10:21:44.833 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:45.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.034+0000 7f417f000640 1 Processor -- start 2024-03-07T10:21:45.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.034+0000 7f417f000640 1 -- start start 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4178153280 0x7f4178156520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 0x7f41780a8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 0x7f41780c1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780c3160 con 0x7f4178153280 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780c33d0 con 0x7f41780a8b60 2024-03-07T10:21:45.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c36b0 con 0x7f41780a5f50 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4178153280 0x7f4178156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4178153280 0x7f4178156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58132/0 (socket says 172.21.15.194:58132) 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417dc00640 1 -- 172.21.15.194:0/3826720478 learned_addr learned my addr 172.21.15.194:0/3826720478 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417e600640 1 --2- 172.21.15.194:0/3826720478 >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 0x7f41780c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.036+0000 7f417d200640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 0x7f41780a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417dc00640 1 -- 172.21.15.194:0/3826720478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 msgr2=0x7f41780a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417dc00640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 0x7f41780a8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417dc00640 1 -- 172.21.15.194:0/3826720478 >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 msgr2=0x7f41780c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417dc00640 1 --2- 172.21.15.194:0/3826720478 >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 0x7f41780c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417dc00640 1 -- 172.21.15.194:0/3826720478 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780c3990 con 0x7f4178153280 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417d200640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 0x7f41780a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:45.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.037+0000 7f417e600640 1 --2- 172.21.15.194:0/3826720478 >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 0x7f41780c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:45.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.038+0000 7f417dc00640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4178153280 0x7f4178156520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41780738b0 tx=0x7f416c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d213b756d087ec20 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.039+0000 7f4177e00640 1 -- 172.21.15.194:0/3826720478 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c035020 con 0x7f4178153280 2024-03-07T10:21:45.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.039+0000 7f4177e00640 1 -- 172.21.15.194:0/3826720478 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c031870 con 0x7f4178153280 2024-03-07T10:21:45.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.039+0000 7f4177e00640 1 -- 172.21.15.194:0/3826720478 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c031c40 con 0x7f4178153280 2024-03-07T10:21:45.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.039+0000 7f417f000640 1 -- 172.21.15.194:0/3826720478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4178153280 msgr2=0x7f4178156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.041 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.039+0000 7f417f000640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4178153280 0x7f4178156520 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41780738b0 tx=0x7f416c02b910 comp rx=0 tx=0).stop 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 -- 172.21.15.194:0/3826720478 shutdown_connections 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 --2- 172.21.15.194:0/3826720478 >> v2:172.21.15.196:3300/0 conn(0x7f41780a8b60 0x7f41780c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f41780a5f50 0x7f41780a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 --2- 172.21.15.194:0/3826720478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4178153280 0x7f4178156520 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 -- 172.21.15.194:0/3826720478 >> 172.21.15.194:0/3826720478 conn(0x7f417806cd60 msgr2=0x7f417806b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 -- 172.21.15.194:0/3826720478 shutdown_connections 2024-03-07T10:21:45.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.040+0000 7f417f000640 1 -- 172.21.15.194:0/3826720478 wait complete. 2024-03-07T10:21:45.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.041+0000 7f417f000640 1 Processor -- start 2024-03-07T10:21:45.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 -- start start 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41780a5f50 0x7f4178072c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4178153280 0x7f41780a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4178153660 con 0x7f41780a8b60 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c3f50 con 0x7f41780a5f50 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.042+0000 7f417f000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780c1940 con 0x7f4178153280 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58142/0 (socket says 172.21.15.194:58142) 2024-03-07T10:21:45.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 -- 172.21.15.194:0/3051847257 learned_addr learned my addr 172.21.15.194:0/3051847257 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417e600640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4178153280 0x7f41780a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417dc00640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41780a5f50 0x7f4178072c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 -- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4178153280 msgr2=0x7f41780a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4178153280 0x7f41780a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 -- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41780a5f50 msgr2=0x7f4178072c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41780a5f50 0x7f4178072c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.043+0000 7f417d200640 1 -- 172.21.15.194:0/3051847257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41780a80e0 con 0x7f41780a8b60 2024-03-07T10:21:45.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f417d200640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f416400e840 tx=0x7f416400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416400f040 con 0x7f41780a8b60 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4164004030 con 0x7f41780a8b60 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780a83c0 con 0x7f41780a8b60 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4164004400 con 0x7f41780a8b60 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.044+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4178071610 con 0x7f41780a8b60 2024-03-07T10:21:45.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.045+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4178075600 con 0x7f41780a8b60 2024-03-07T10:21:45.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.046+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f416400c6d0 con 0x7f41780a8b60 2024-03-07T10:21:45.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.047+0000 7f4175600640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 0x7f415806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.047+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f416408a270 con 0x7f41780a8b60 2024-03-07T10:21:45.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.048+0000 7f417dc00640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 0x7f415806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.049+0000 7f417dc00640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 0x7f415806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f416c036000 tx=0x7f416c03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.052+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4164017020 con 0x7f41780a8b60 2024-03-07T10:21:45.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.251+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41780a5b20 con 0x7f41780a8b60 2024-03-07T10:21:45.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.251+0000 7f4175600640 1 -- 172.21.15.194:0/3051847257 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f4164058d40 con 0x7f41780a8b60 2024-03-07T10:21:45.253 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:45.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 msgr2=0x7f415806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 0x7f415806d9c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f416c036000 tx=0x7f416c03c040 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 msgr2=0x7f41780710d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f416400e840 tx=0x7f416400ed00 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 shutdown_connections 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f415806b500 0x7f415806d9c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4178153280 0x7f41780a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41780a8b60 0x7f41780710d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 --2- 172.21.15.194:0/3051847257 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f41780a5f50 0x7f4178072c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 >> 172.21.15.194:0/3051847257 conn(0x7f417806cd60 msgr2=0x7f41780a9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 shutdown_connections 2024-03-07T10:21:45.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.254+0000 7f417f000640 1 -- 172.21.15.194:0/3051847257 wait complete. 2024-03-07T10:21:45.275 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:45.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.477+0000 7f6a0e200640 1 Processor -- start 2024-03-07T10:21:45.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.477+0000 7f6a0e200640 1 -- start start 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.479+0000 7f6a0e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a0814f7c0 0x7f6a08155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.479+0000 7f6a0e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 0x7f6a081594b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.479+0000 7f6a0e200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a081599f0 con 0x7f6a080c8d90 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.479+0000 7f6a0e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a08155b30 con 0x7f6a0814f7c0 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.479+0000 7f6a0e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08155e10 con 0x7f6a08159020 2024-03-07T10:21:45.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a0814f7c0 0x7f6a08155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6a0814f7c0 0x7f6a08155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58146/0 (socket says 172.21.15.194:58146) 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 -- 172.21.15.194:0/1987518530 learned_addr learned my addr 172.21.15.194:0/1987518530 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0d800640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 0x7f6a081594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 -- 172.21.15.194:0/1987518530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 msgr2=0x7f6a081594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 0x7f6a081594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 -- 172.21.15.194:0/1987518530 >> v1:172.21.15.196:6789/0 conn(0x7f6a080c8d90 legacy=0x7f6a080c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0ce00640 1 -- 172.21.15.194:0/1987518530 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a081560f0 con 0x7f6a0814f7c0 2024-03-07T10:21:45.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.480+0000 7f6a0d800640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 0x7f6a081594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:45.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.481+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0814f7c0 0x7f6a08155550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009870 tx=0x7f69fc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63b4dece6074390 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a07400640 1 -- 172.21.15.194:0/1987518530 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc0317c0 con 0x7f6a0814f7c0 2024-03-07T10:21:45.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a07400640 1 -- 172.21.15.194:0/1987518530 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69fc037070 con 0x7f6a0814f7c0 2024-03-07T10:21:45.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a07400640 1 -- 172.21.15.194:0/1987518530 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031b80 con 0x7f6a0814f7c0 2024-03-07T10:21:45.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 -- 172.21.15.194:0/1987518530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0814f7c0 msgr2=0x7f6a08155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0814f7c0 0x7f6a08155550 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f69fc009870 tx=0x7f69fc02b860 comp rx=0 tx=0).stop 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 -- 172.21.15.194:0/1987518530 shutdown_connections 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a08159020 0x7f6a081594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 --2- 172.21.15.194:0/1987518530 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0814f7c0 0x7f6a08155550 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 -- 172.21.15.194:0/1987518530 >> 172.21.15.194:0/1987518530 conn(0x7f6a0806b4a0 msgr2=0x7f6a0806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 -- 172.21.15.194:0/1987518530 shutdown_connections 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.482+0000 7f6a0e200640 1 -- 172.21.15.194:0/1987518530 wait complete. 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.484+0000 7f6a0e200640 1 Processor -- start 2024-03-07T10:21:45.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.484+0000 7f6a0e200640 1 -- start start 2024-03-07T10:21:45.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 0x7f6a0814ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0814f7c0 0x7f6a0814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a08072890 con 0x7f6a08159020 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c9740 con 0x7f6a080c8d90 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0e200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c5f20 con 0x7f6a0814f7c0 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58150/0 (socket says 172.21.15.194:58150) 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.485+0000 7f6a0d800640 1 -- 172.21.15.194:0/3545010835 learned_addr learned my addr 172.21.15.194:0/3545010835 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 0x7f6a0814ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a07e00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0814f7c0 0x7f6a0814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 -- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0814f7c0 msgr2=0x7f6a0814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0814f7c0 0x7f6a0814bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 -- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 msgr2=0x7f6a0814ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 0x7f6a0814ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 -- 172.21.15.194:0/3545010835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a081508e0 con 0x7f6a08159020 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 0x7f6a0814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:45.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0d800640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000cd80 tx=0x7f6a0000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000f680 con 0x7f6a08159020 2024-03-07T10:21:45.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000f840 con 0x7f6a08159020 2024-03-07T10:21:45.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a081504b0 con 0x7f6a08159020 2024-03-07T10:21:45.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000fc30 con 0x7f6a08159020 2024-03-07T10:21:45.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.486+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a081501d0 con 0x7f6a08159020 2024-03-07T10:21:45.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.488+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a08075600 con 0x7f6a08159020 2024-03-07T10:21:45.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.488+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6a000213f0 con 0x7f6a08159020 2024-03-07T10:21:45.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.489+0000 7f6a04c00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 0x7f69e806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.489+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6a0008b3d0 con 0x7f6a08159020 2024-03-07T10:21:45.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.490+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 0x7f69e806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.491+0000 7f6a0ce00640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 0x7f69e806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69fc036000 tx=0x7f69fc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.494+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6a00014030 con 0x7f6a08159020 2024-03-07T10:21:45.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.710+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f6a08072590 con 0x7f6a08159020 2024-03-07T10:21:45.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.710+0000 7f6a04c00640 1 -- 172.21.15.194:0/3545010835 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f6a00059ea0 con 0x7f6a08159020 2024-03-07T10:21:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:45.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 msgr2=0x7f69e806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 0x7f69e806d990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69fc036000 tx=0x7f69fc008030 comp rx=0 tx=0).stop 2024-03-07T10:21:45.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 msgr2=0x7f6a08147c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6a0000cd80 tx=0x7f6a0000a650 comp rx=0 tx=0).stop 2024-03-07T10:21:45.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 shutdown_connections 2024-03-07T10:21:45.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f69e806b4d0 0x7f69e806d990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a08159020 0x7f6a08147c70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6a0814f7c0 0x7f6a0814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 --2- 172.21.15.194:0/3545010835 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6a080c8d90 0x7f6a0814ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.714+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 >> 172.21.15.194:0/3545010835 conn(0x7f6a0806b4a0 msgr2=0x7f6a0806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.715+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 shutdown_connections 2024-03-07T10:21:45.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.715+0000 7f6a0e200640 1 -- 172.21.15.194:0/3545010835 wait complete. 2024-03-07T10:21:45.736 INFO:tasks.mds_thrash:mds thrasher using random seed: 1709806905 2024-03-07T10:21:45.736 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:45.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.934+0000 7fcece800640 1 Processor -- start 2024-03-07T10:21:45.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.934+0000 7fcece800640 1 -- start start 2024-03-07T10:21:45.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcece800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fcec8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcece800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec8155920 con 0x7fcec80c3f70 2024-03-07T10:21:45.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcece800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcec80c8710 con 0x7fcec80c6610 2024-03-07T10:21:45.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcece800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81567f0 con 0x7fcec8071140 2024-03-07T10:21:45.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcec7e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fcec80c3f70 0x7fcec80c58c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50982/0 (socket says 172.21.15.194:50982) 2024-03-07T10:21:45.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcec7e00640 1 -- 172.21.15.194:0/3916753083 learned_addr learned my addr 172.21.15.194:0/3916753083 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:45.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.936+0000 7fcec7400640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fcec8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233763647 0 0) 0x7fcec8155920 con 0x7fcec80c3f70 2024-03-07T10:21:45.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fceac003520 con 0x7fcec80c3f70 2024-03-07T10:21:45.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3249032056 0 0) 0x7fceac003520 con 0x7fcec80c3f70 2024-03-07T10:21:45.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 msgr2=0x7fcec8158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fcec8158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 >> v1:172.21.15.196:6789/0 conn(0x7fcec80c6610 legacy=0x7fcec81560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec80c89f0 con 0x7fcec80c3f70 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fcec00019f0 con 0x7fcec80c3f70 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 >> v1:172.21.15.194:6789/0 conn(0x7fcec80c3f70 legacy=0x7fcec80c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac0039e0 0x7fceac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fceac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac004d40 0x7fceac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec81567f0 con 0x7fceac004d40 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac00ba70 con 0x7fceac0039e0 2024-03-07T10:21:45.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.937+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac00bc20 con 0x7fcec8071140 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac004d40 0x7fceac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7400640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac0039e0 0x7fceac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcebfe00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fceac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 -- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 msgr2=0x7fceac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fceac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 -- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac0039e0 msgr2=0x7fceac003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac0039e0 0x7fceac003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7e00640 1 -- 172.21.15.194:0/3916753083 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac003520 con 0x7fceac004d40 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcebfe00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec8071140 0x7fceac004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:45.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.938+0000 7fcec7400640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac0039e0 0x7fceac003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:45.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac004d40 0x7fceac0051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcec000a790 tx=0x7fceac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee4f50c9797f1e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec000a3b0 con 0x7fceac004d40 2024-03-07T10:21:45.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0034630 con 0x7fceac004d40 2024-03-07T10:21:45.944 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcec6a00640 1 -- 172.21.15.194:0/3916753083 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0034a20 con 0x7fceac004d40 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcece800640 1 -- 172.21.15.194:0/3916753083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac004d40 msgr2=0x7fceac0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcece800640 1 --2- 172.21.15.194:0/3916753083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac004d40 0x7fceac0051c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcec000a790 tx=0x7fceac005830 comp rx=0 tx=0).stop 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.940+0000 7fcec7e00640 1 -- 172.21.15.194:0/3916753083 reap_dead start 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.941+0000 7fcece800640 1 -- 172.21.15.194:0/3916753083 shutdown_connections 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.941+0000 7fcece800640 1 -- 172.21.15.194:0/3916753083 >> 172.21.15.194:0/3916753083 conn(0x7fcec80c8f50 msgr2=0x7fcec80c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.941+0000 7fcece800640 1 -- 172.21.15.194:0/3916753083 shutdown_connections 2024-03-07T10:21:45.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.941+0000 7fcece800640 1 -- 172.21.15.194:0/3916753083 wait complete. 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.943+0000 7fcece800640 1 Processor -- start 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.943+0000 7fcece800640 1 -- start start 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 0x7fcec8156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec81ebfa0 0x7fcec81ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c43c0 con 0x7fcec81eed80 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec80c8cd0 con 0x7fceac004d40 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcece800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec8071520 con 0x7fcec81ebfa0 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcec7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcec7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58164/0 (socket says 172.21.15.194:58164) 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.944+0000 7fcec7e00640 1 -- 172.21.15.194:0/3959801938 learned_addr learned my addr 172.21.15.194:0/3959801938 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:45.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7400640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 0x7fcec8156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcebfe00640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec81ebfa0 0x7fcec81ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 -- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec81ebfa0 msgr2=0x7fcec81ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec81ebfa0 0x7fcec81ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 -- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 msgr2=0x7fcec8156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 0x7fcec8156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 -- 172.21.15.194:0/3959801938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec81df3b0 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7400640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 0x7fcec8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.945+0000 7fcec7e00640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcec002cb80 tx=0x7fcec80c88e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.946+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec0001f00 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.946+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec0044070 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.946+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec00019c0 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.946+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcec81eb4c0 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.946+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcec8157330 con 0x7fcec81eed80 2024-03-07T10:21:45.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.947+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcec81eb2d0 con 0x7fcec81eed80 2024-03-07T10:21:45.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.948+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcec0034630 con 0x7fcec81eed80 2024-03-07T10:21:45.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.949+0000 7fcebf400640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 0x7fcea406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:45.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.950+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcec00ac7c0 con 0x7fcec81eed80 2024-03-07T10:21:45.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.950+0000 7fcec7400640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 0x7fcea406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:45.953 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.951+0000 7fcec7400640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 0x7fcea406d9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009a50 tx=0x7fceb8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:45.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:45.954+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcec007b3b0 con 0x7fcec81eed80 2024-03-07T10:21:46.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.153+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcec8068170 con 0x7fcec81eed80 2024-03-07T10:21:46.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.155+0000 7fcebf400640 1 -- 172.21.15.194:0/3959801938 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7fcec0047e40 con 0x7fcec81eed80 2024-03-07T10:21:46.157 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:46.158 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 msgr2=0x7fcea406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 0x7fcea406d9c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fceb8009a50 tx=0x7fceb8008040 comp rx=0 tx=0).stop 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 msgr2=0x7fcec806c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fcec002cb80 tx=0x7fcec80c88e0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 shutdown_connections 2024-03-07T10:21:46.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcea406b500 0x7fcea406d9c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcec81eed80 0x7fcec806c290 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcec81ebfa0 0x7fcec81ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 --2- 172.21.15.194:0/3959801938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fceac004d40 0x7fcec8156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.158+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 >> 172.21.15.194:0/3959801938 conn(0x7fcec80c8f50 msgr2=0x7fcec80c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.159+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 shutdown_connections 2024-03-07T10:21:46.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.159+0000 7fcece800640 1 -- 172.21.15.194:0/3959801938 wait complete. 2024-03-07T10:21:46.177 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:46.178 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:46.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.367+0000 7f7d30c00640 1 Processor -- start 2024-03-07T10:21:46.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.367+0000 7f7d30c00640 1 -- start start 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d30c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7d2c14f7c0 0x7f7d2c155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d30c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d30c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2c155b30 con 0x7f7d2c0c5d50 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d30c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c155e10 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d30c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c1560f0 con 0x7f7d2c14f7c0 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d22a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d22a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58172/0 (socket says 172.21.15.194:58172) 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d22a00640 1 -- 172.21.15.194:0/2768076549 learned_addr learned my addr 172.21.15.194:0/2768076549 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.369+0000 7f7d2be00640 1 --1- 172.21.15.194:0/2768076549 >> v1:172.21.15.194:6789/0 conn(0x7f7d2c0c5d50 0x7f7d2c159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:50990/0 (socket says 172.21.15.194:50990) 2024-03-07T10:21:46.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d2b400640 1 --2- 172.21.15.194:0/2768076549 >> v2:172.21.15.196:3300/0 conn(0x7f7d2c14f7c0 0x7f7d2c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d22a00640 1 -- 172.21.15.194:0/2768076549 >> v2:172.21.15.196:3300/0 conn(0x7f7d2c14f7c0 msgr2=0x7f7d2c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:46.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d22a00640 1 --2- 172.21.15.194:0/2768076549 >> v2:172.21.15.196:3300/0 conn(0x7f7d2c14f7c0 0x7f7d2c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d22a00640 1 -- 172.21.15.194:0/2768076549 >> v1:172.21.15.194:6789/0 conn(0x7f7d2c0c5d50 legacy=0x7f7d2c159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d22a00640 1 -- 172.21.15.194:0/2768076549 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c1563d0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.370+0000 7f7d2aa00640 1 -- 172.21.15.194:0/2768076549 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439065763 0 0) 0x7f7d2c155b30 con 0x7f7d2c0c5d50 2024-03-07T10:21:46.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.371+0000 7f7d22a00640 1 --2- 172.21.15.194:0/2768076549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0722c0 tx=0x7f7d1402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86deeef010b83743 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.371+0000 7f7d2aa00640 1 -- 172.21.15.194:0/2768076549 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14035020 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.371+0000 7f7d2aa00640 1 -- 172.21.15.194:0/2768076549 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14031870 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.371+0000 7f7d2aa00640 1 -- 172.21.15.194:0/2768076549 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14031c40 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 -- 172.21.15.194:0/2768076549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 msgr2=0x7f7d2c0c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 --2- 172.21.15.194:0/2768076549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0722c0 tx=0x7f7d1402b910 comp rx=0 tx=0).stop 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 -- 172.21.15.194:0/2768076549 shutdown_connections 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 --2- 172.21.15.194:0/2768076549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c0c5810 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 --2- 172.21.15.194:0/2768076549 >> v2:172.21.15.196:3300/0 conn(0x7f7d2c14f7c0 0x7f7d2c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 -- 172.21.15.194:0/2768076549 >> 172.21.15.194:0/2768076549 conn(0x7f7d2c06b4a0 msgr2=0x7f7d2c06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:46.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 -- 172.21.15.194:0/2768076549 shutdown_connections 2024-03-07T10:21:46.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.372+0000 7f7d30c00640 1 -- 172.21.15.194:0/2768076549 wait complete. 2024-03-07T10:21:46.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.374+0000 7f7d30c00640 1 Processor -- start 2024-03-07T10:21:46.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.374+0000 7f7d30c00640 1 -- start start 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d2c0c5d50 0x7f7d2c154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 0x7f7d2c14ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c159730 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c072890 con 0x7f7d2c14f7c0 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d30c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c1598b0 con 0x7f7d2c0c5d50 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58184/0 (socket says 172.21.15.194:58184) 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 -- 172.21.15.194:0/1241192999 learned_addr learned my addr 172.21.15.194:0/1241192999 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d2b400640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d2c0c5d50 0x7f7d2c154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d2be00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 0x7f7d2c14ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 -- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d2c0c5d50 msgr2=0x7f7d2c154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d2c0c5d50 0x7f7d2c154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 -- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 msgr2=0x7f7d2c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 0x7f7d2c14ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d22a00640 1 -- 172.21.15.194:0/1241192999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c1ef3c0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.375+0000 7f7d2be00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 0x7f7d2c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d22a00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d1402b950 tx=0x7f7d140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14040070 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d14030d00 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d14035040 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2c1e0ba0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.376+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c1e1160 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.377+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c075600 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.378+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7d14038020 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.379+0000 7f7d23e00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 0x7f7d0806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.379+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f7d140ac360 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.380+0000 7f7d2b400640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 0x7f7d0806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.381+0000 7f7d2b400640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 0x7f7d0806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009ad0 tx=0x7f7d1c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.383+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7d1407ada0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.578+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d2c0c52c0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.579+0000 7f7d23e00640 1 -- 172.21.15.194:0/1241192999 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d1407a6a0 con 0x7f7d2c0c8d90 2024-03-07T10:21:46.581 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 msgr2=0x7f7d0806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 0x7f7d0806d990 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c009ad0 tx=0x7f7d1c008040 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 msgr2=0x7f7d2c14e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7d1402b950 tx=0x7f7d140046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 shutdown_connections 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7d0806b4d0 0x7f7d0806d990 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7d2c14f7c0 0x7f7d2c14ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d2c0c8d90 0x7f7d2c14e520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 --2- 172.21.15.194:0/1241192999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7d2c0c5d50 0x7f7d2c154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 >> 172.21.15.194:0/1241192999 conn(0x7f7d2c06b4a0 msgr2=0x7f7d2c158620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 shutdown_connections 2024-03-07T10:21:46.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.581+0000 7f7d30c00640 1 -- 172.21.15.194:0/1241192999 wait complete. 2024-03-07T10:21:46.602 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.799+0000 7f6d93c00640 1 Processor -- start 2024-03-07T10:21:46.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.800+0000 7f6d93c00640 1 -- start start 2024-03-07T10:21:46.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d93c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d8c0be720 0x7f6d8c0c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d93c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d93c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d8c159840 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d93c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d8c0cbcd0 con 0x7f6d8c0be720 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d93c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c159b20 con 0x7f6d8c0c8f90 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d8be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d8c0be720 0x7f6d8c0c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d8be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d8c0be720 0x7f6d8c0c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58186/0 (socket says 172.21.15.194:58186) 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.801+0000 7f6d8be00640 1 -- 172.21.15.194:0/1018754842 learned_addr learned my addr 172.21.15.194:0/1018754842 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.802+0000 7f6d91c00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.802+0000 7f6d8be00640 1 -- 172.21.15.194:0/1018754842 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 msgr2=0x7f6d8c155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.802+0000 7f6d8be00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.802+0000 7f6d8be00640 1 -- 172.21.15.194:0/1018754842 >> v1:172.21.15.196:6789/0 conn(0x7f6d8c0c5a10 legacy=0x7f6d8c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:46.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.802+0000 7f6d8be00640 1 -- 172.21.15.194:0/1018754842 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0cb680 con 0x7f6d8c0be720 2024-03-07T10:21:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.803+0000 7f6d8be00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0be720 0x7f6d8c0c5df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009870 tx=0x7f6d7402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afc4f2b8974a01 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.803+0000 7f6d8b400640 1 -- 172.21.15.194:0/1018754842 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740317c0 con 0x7f6d8c0be720 2024-03-07T10:21:46.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.803+0000 7f6d8b400640 1 -- 172.21.15.194:0/1018754842 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74037070 con 0x7f6d8c0be720 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.803+0000 7f6d8b400640 1 -- 172.21.15.194:0/1018754842 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74031b80 con 0x7f6d8c0be720 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 -- 172.21.15.194:0/1018754842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0be720 msgr2=0x7f6d8c0c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0be720 0x7f6d8c0c5df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009870 tx=0x7f6d7402b860 comp rx=0 tx=0).stop 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 -- 172.21.15.194:0/1018754842 shutdown_connections 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1018754842 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0be720 0x7f6d8c0c5df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 -- 172.21.15.194:0/1018754842 >> 172.21.15.194:0/1018754842 conn(0x7f6d8c0671b0 msgr2=0x7f6d8c0675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 -- 172.21.15.194:0/1018754842 shutdown_connections 2024-03-07T10:21:46.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.804+0000 7f6d93c00640 1 -- 172.21.15.194:0/1018754842 wait complete. 2024-03-07T10:21:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.806+0000 7f6d93c00640 1 Processor -- start 2024-03-07T10:21:46.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.806+0000 7f6d93c00640 1 -- start start 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d8c0be720 0x7f6d8c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c1dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c06d880 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c156410 con 0x7f6d8c0be720 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d93c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c0b0930 con 0x7f6d8c0c8f90 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.807+0000 7f6d8be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58188/0 (socket says 172.21.15.194:58188) 2024-03-07T10:21:46.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 -- 172.21.15.194:0/1823500443 learned_addr learned my addr 172.21.15.194:0/1823500443 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d91200640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d8c0be720 0x7f6d8c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d91c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c1dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 -- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 msgr2=0x7f6d8c1dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c1dff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 -- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d8c0be720 msgr2=0x7f6d8c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d8c0be720 0x7f6d8c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 -- 172.21.15.194:0/1823500443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0c0380 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.808+0000 7f6d8be00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d74000c00 tx=0x7f6d740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.809+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74032860 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.809+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74032a20 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.809+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74032e10 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.809+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d8c0c0620 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.809+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c1deec0 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.810+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8c0c0b40 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.811+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6d7404c060 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.812+0000 7f6d88c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 0x7f6d6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.812+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6d740ac270 con 0x7f6d8c0c5a10 2024-03-07T10:21:46.813 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.812+0000 7f6d91200640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 0x7f6d6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:46.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.813+0000 7f6d91200640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 0x7f6d6806d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009f20 tx=0x7f6d840094d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:46.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:46.816+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6d8c0c0b40 con 0x7f6d8c0c5a10 2024-03-07T10:21:47.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.009+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d8c0c8930 con 0x7f6d8c0c5a10 2024-03-07T10:21:47.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.010+0000 7f6d88c00640 1 -- 172.21.15.194:0/1823500443 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f6d8c0c8930 con 0x7f6d8c0c5a10 2024-03-07T10:21:47.012 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 msgr2=0x7f6d6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 0x7f6d6806d9c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6d84009f20 tx=0x7f6d840094d0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 msgr2=0x7f6d8c1df9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6d74000c00 tx=0x7f6d740046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 shutdown_connections 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6d6806b500 0x7f6d6806d9c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6d8c0c8f90 0x7f6d8c1dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d8c0c5a10 0x7f6d8c1df9f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 --2- 172.21.15.194:0/1823500443 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6d8c0be720 0x7f6d8c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 >> 172.21.15.194:0/1823500443 conn(0x7f6d8c0671b0 msgr2=0x7f6d8c0ae760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 shutdown_connections 2024-03-07T10:21:47.015 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.013+0000 7f6d93c00640 1 -- 172.21.15.194:0/1823500443 wait complete. 2024-03-07T10:21:47.034 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:47.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.228+0000 7f1659600640 1 Processor -- start 2024-03-07T10:21:47.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.228+0000 7f1659600640 1 -- start start 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.229+0000 7f1659600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16540cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.229+0000 7f1659600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1654155990 0x7f1654155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.229+0000 7f1659600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1654153180 con 0x7f1654152da0 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.229+0000 7f1659600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16540c9620 con 0x7f1654155990 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.229+0000 7f1659600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654158f70 con 0x7f16540cb380 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1652a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1654152da0 0x7f16540c8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:51004/0 (socket says 172.21.15.194:51004) 2024-03-07T10:21:47.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1652a00640 1 -- 172.21.15.194:0/3011250168 learned_addr learned my addr 172.21.15.194:0/3011250168 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1652000640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16540cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1653400640 1 --2- 172.21.15.194:0/3011250168 >> v2:172.21.15.196:3300/0 conn(0x7f1654155990 0x7f1654155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176316488 0 0) 0x7f1654153180 con 0x7f1654152da0 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1638003520 con 0x7f1654152da0 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 51819195 0 0) 0x7f1638003520 con 0x7f1654152da0 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 msgr2=0x7f16540cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16540cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 >> v2:172.21.15.196:3300/0 conn(0x7f1654155990 msgr2=0x7f1654155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 --2- 172.21.15.194:0/3011250168 >> v2:172.21.15.196:3300/0 conn(0x7f1654155990 0x7f1654155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1654159250 con 0x7f1654152da0 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f1644001670 con 0x7f1654152da0 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.230+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 >> v1:172.21.15.194:6789/0 conn(0x7f1654152da0 legacy=0x7f16540c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16380039b0 0x7f1638003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1638004800 0x7f1638004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16540c9620 con 0x7f16380039b0 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654158f70 con 0x7f1638004800 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163800b9c0 con 0x7f16540cb380 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16380039b0 0x7f1638003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1653400640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 -- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 msgr2=0x7f16380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:47.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16540cb380 0x7f16380051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 -- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1638004800 msgr2=0x7f1638004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652000640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1638004800 0x7f1638004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1638004800 0x7f1638004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.231+0000 7f1652a00640 1 -- 172.21.15.194:0/3011250168 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638003520 con 0x7f16380039b0 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.232+0000 7f1652a00640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16380039b0 0x7f1638003dd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1644007fd0 tx=0x7f1638005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801ec054c55124e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644007d50 con 0x7f16380039b0 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644030070 con 0x7f16380039b0 2024-03-07T10:21:47.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1651600640 1 -- 172.21.15.194:0/3011250168 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164402cd40 con 0x7f16380039b0 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1659600640 1 -- 172.21.15.194:0/3011250168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16380039b0 msgr2=0x7f1638003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1659600640 1 --2- 172.21.15.194:0/3011250168 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16380039b0 0x7f1638003dd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1644007fd0 tx=0x7f1638005830 comp rx=0 tx=0).stop 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.233+0000 7f1653400640 1 -- 172.21.15.194:0/3011250168 reap_dead start 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.234+0000 7f1659600640 1 -- 172.21.15.194:0/3011250168 shutdown_connections 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.234+0000 7f1659600640 1 -- 172.21.15.194:0/3011250168 >> 172.21.15.194:0/3011250168 conn(0x7f1654066f70 msgr2=0x7f1654067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:47.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.234+0000 7f1659600640 1 -- 172.21.15.194:0/3011250168 shutdown_connections 2024-03-07T10:21:47.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.234+0000 7f1659600640 1 -- 172.21.15.194:0/3011250168 wait complete. 2024-03-07T10:21:47.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.236+0000 7f1659600640 1 Processor -- start 2024-03-07T10:21:47.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.236+0000 7f1659600640 1 -- start start 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16380039b0 0x7f16540c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16540ab000 0x7f16541ee350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16540be8c0 con 0x7f16541499c0 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1654159810 con 0x7f16540ab000 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1659600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1654156360 con 0x7f16380039b0 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1652000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1652000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58206/0 (socket says 172.21.15.194:58206) 2024-03-07T10:21:47.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1652000640 1 -- 172.21.15.194:0/1863706572 learned_addr learned my addr 172.21.15.194:0/1863706572 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1652a00640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16380039b0 0x7f16540c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.238+0000 7f1653400640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16540ab000 0x7f16541ee350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 -- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16380039b0 msgr2=0x7f16540c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16380039b0 0x7f16540c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 -- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16540ab000 msgr2=0x7f16541ee350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16540ab000 0x7f16541ee350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 -- 172.21.15.194:0/1863706572 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16540c9aa0 con 0x7f16541499c0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1652000640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1640010860 tx=0x7f1640010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000f040 con 0x7f16541499c0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000eb00 con 0x7f16541499c0 2024-03-07T10:21:47.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.239+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16540ab480 con 0x7f16541499c0 2024-03-07T10:21:47.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.240+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164001c400 con 0x7f16541499c0 2024-03-07T10:21:47.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.240+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16540c44f0 con 0x7f16541499c0 2024-03-07T10:21:47.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.241+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1654068910 con 0x7f16541499c0 2024-03-07T10:21:47.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.243+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f164001c5a0 con 0x7f16541499c0 2024-03-07T10:21:47.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.244+0000 7f164aa00640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 0x7f163406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.244+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f164008ac20 con 0x7f16541499c0 2024-03-07T10:21:47.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.244+0000 7f1652a00640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 0x7f163406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.246+0000 7f1652a00640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 0x7f163406d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f1644007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.253 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.251+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1654068910 con 0x7f16541499c0 2024-03-07T10:21:47.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.447+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f16540c4f60 con 0x7f16541499c0 2024-03-07T10:21:47.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.448+0000 7f164aa00640 1 -- 172.21.15.194:0/1863706572 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f16540ab480 con 0x7f16541499c0 2024-03-07T10:21:47.450 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 msgr2=0x7f163406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 0x7f163406d990 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1644034000 tx=0x7f1644007000 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 msgr2=0x7f16540aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1640010860 tx=0x7f1640010d20 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 shutdown_connections 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f163406b4d0 0x7f163406d990 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f16540ab000 0x7f16541ee350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16541499c0 0x7f16540aaac0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 --2- 172.21.15.194:0/1863706572 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f16380039b0 0x7f16540c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 >> 172.21.15.194:0/1863706572 conn(0x7f1654066f70 msgr2=0x7f16540c8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 shutdown_connections 2024-03-07T10:21:47.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.451+0000 7f1659600640 1 -- 172.21.15.194:0/1863706572 wait complete. 2024-03-07T10:21:47.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:47.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.678+0000 7f594ac00640 1 Processor -- start 2024-03-07T10:21:47.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.678+0000 7f594ac00640 1 -- start start 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.679+0000 7f594ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f59440c5070 0x7f5944152b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.679+0000 7f594ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59440c39a0 con 0x7f59440c8bc0 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.679+0000 7f594ac00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5944159940 con 0x7f5944153050 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.679+0000 7f594ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59440c2ab0 con 0x7f59440c5070 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.679+0000 7f5949800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f59440c8bc0 0x7f59440c8fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:51006/0 (socket says 172.21.15.194:51006) 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5949800640 1 -- 172.21.15.194:0/433051484 learned_addr learned my addr 172.21.15.194:0/433051484 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:47.681 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5948e00640 1 --2- 172.21.15.194:0/433051484 >> v2:172.21.15.194:3300/0 conn(0x7f59440c5070 0x7f5944152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5948e00640 1 -- 172.21.15.194:0/433051484 >> v1:172.21.15.196:6789/0 conn(0x7f5944153050 legacy=0x7f59441556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:47.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5948e00640 1 -- 172.21.15.194:0/433051484 >> v1:172.21.15.194:6789/0 conn(0x7f59440c8bc0 legacy=0x7f59440c8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5948e00640 1 -- 172.21.15.194:0/433051484 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440c2fd0 con 0x7f59440c5070 2024-03-07T10:21:47.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.680+0000 7f5943e00640 1 -- 172.21.15.194:0/433051484 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 726280917 0 0) 0x7f59440c39a0 con 0x7f59440c8bc0 2024-03-07T10:21:47.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.681+0000 7f5948e00640 1 --2- 172.21.15.194:0/433051484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c5070 0x7f5944152b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f59300097a0 tx=0x7f593002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2790b0f87bb9da server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.681+0000 7f5943e00640 1 -- 172.21.15.194:0/433051484 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59300315a0 con 0x7f59440c5070 2024-03-07T10:21:47.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.681+0000 7f5943e00640 1 -- 172.21.15.194:0/433051484 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930037070 con 0x7f59440c5070 2024-03-07T10:21:47.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.681+0000 7f5943e00640 1 -- 172.21.15.194:0/433051484 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930031960 con 0x7f59440c5070 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 -- 172.21.15.194:0/433051484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c5070 msgr2=0x7f5944152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 --2- 172.21.15.194:0/433051484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c5070 0x7f5944152b10 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f59300097a0 tx=0x7f593002b840 comp rx=0 tx=0).stop 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 -- 172.21.15.194:0/433051484 shutdown_connections 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 --2- 172.21.15.194:0/433051484 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c5070 0x7f5944152b10 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 -- 172.21.15.194:0/433051484 >> 172.21.15.194:0/433051484 conn(0x7f594406d290 msgr2=0x7f594406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 -- 172.21.15.194:0/433051484 shutdown_connections 2024-03-07T10:21:47.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.682+0000 7f594ac00640 1 -- 172.21.15.194:0/433051484 wait complete. 2024-03-07T10:21:47.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.684+0000 7f594ac00640 1 Processor -- start 2024-03-07T10:21:47.685 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.684+0000 7f594ac00640 1 -- start start 2024-03-07T10:21:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 0x7f59441e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.686 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5944153050 0x7f59441df220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5944159670 con 0x7f59440c8bc0 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59441594f0 con 0x7f59440c5070 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f594ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5944155df0 con 0x7f5944153050 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f5948e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f5948e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58232/0 (socket says 172.21.15.194:58232) 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f5948e00640 1 -- 172.21.15.194:0/1681906479 learned_addr learned my addr 172.21.15.194:0/1681906479 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:47.687 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.685+0000 7f5949800640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 0x7f59441e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.688 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f594a200640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5944153050 0x7f59441df220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 -- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5944153050 msgr2=0x7f59441df220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5944153050 0x7f59441df220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 -- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 msgr2=0x7f59441e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 0x7f59441e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 -- 172.21.15.194:0/1681906479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59440707e0 con 0x7f59440c8bc0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5949800640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 0x7f59441e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5948e00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5930034040 tx=0x7f59300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930032840 con 0x7f59440c8bc0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930032a00 con 0x7f59440c8bc0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930032df0 con 0x7f59440c8bc0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5944070ac0 con 0x7f59440c8bc0 2024-03-07T10:21:47.689 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.686+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59440700d0 con 0x7f59440c8bc0 2024-03-07T10:21:47.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.688+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59441e0fb0 con 0x7f59440c8bc0 2024-03-07T10:21:47.690 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.688+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f593004d3f0 con 0x7f59440c8bc0 2024-03-07T10:21:47.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.689+0000 7f5941600640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 0x7f592406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:47.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.689+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f593002f030 con 0x7f59440c8bc0 2024-03-07T10:21:47.691 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.690+0000 7f5949800640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 0x7f592406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:47.692 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.691+0000 7f5949800640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 0x7f592406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5938000f60 tx=0x7f5938007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:47.694 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.693+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5930040070 con 0x7f59440c8bc0 2024-03-07T10:21:47.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.890+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5944075600 con 0x7f59440c8bc0 2024-03-07T10:21:47.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.890+0000 7f5941600640 1 -- 172.21.15.194:0/1681906479 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f593007a710 con 0x7f59440c8bc0 2024-03-07T10:21:47.892 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 msgr2=0x7f592406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 0x7f592406d990 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5938000f60 tx=0x7f5938007c10 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 msgr2=0x7f594406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f5930034040 tx=0x7f59300046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 shutdown_connections 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f592406b4d0 0x7f592406d990 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5944153050 0x7f59441df220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59440c8bc0 0x7f594406fb90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 --2- 172.21.15.194:0/1681906479 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f59440c5070 0x7f59441e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:47.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 >> 172.21.15.194:0/1681906479 conn(0x7f594406d290 msgr2=0x7f59441e19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:47.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.893+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 shutdown_connections 2024-03-07T10:21:47.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:47.894+0000 7f594ac00640 1 -- 172.21.15.194:0/1681906479 wait complete. 2024-03-07T10:21:47.913 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:47.920 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:21:47.965 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:21:48.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.167+0000 7fe11a800640 1 Processor -- start 2024-03-07T10:21:48.169 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.167+0000 7fe11a800640 1 -- start start 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.168+0000 7fe11a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe11414d6e0 0x7fe11406e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.168+0000 7fe11a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe114153760 con 0x7fe1140ab7c0 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.168+0000 7fe11a800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11406dd40 con 0x7fe1140ab340 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.168+0000 7fe11a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11406daf0 con 0x7fe11414d6e0 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe11414d6e0 0x7fe11406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe11414d6e0 0x7fe11406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58240/0 (socket says 172.21.15.194:58240) 2024-03-07T10:21:48.170 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 -- 172.21.15.194:0/2123619260 learned_addr learned my addr 172.21.15.194:0/2123619260 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:48.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 -- 172.21.15.194:0/2123619260 >> v1:172.21.15.196:6789/0 conn(0x7fe1140ab340 legacy=0x7fe1140a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 -- 172.21.15.194:0/2123619260 >> v1:172.21.15.194:6789/0 conn(0x7fe1140ab7c0 legacy=0x7fe11415ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe113400640 1 -- 172.21.15.194:0/2123619260 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11406e020 con 0x7fe11414d6e0 2024-03-07T10:21:48.171 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.169+0000 7fe112000640 1 -- 172.21.15.194:0/2123619260 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509319396 0 0) 0x7fe114153760 con 0x7fe1140ab7c0 2024-03-07T10:21:48.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.170+0000 7fe113400640 1 --2- 172.21.15.194:0/2123619260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11414d6e0 0x7fe11406e820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe11406dc70 tx=0x7fe10402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e370f8e4918a25 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe112000640 1 -- 172.21.15.194:0/2123619260 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104034070 con 0x7fe11414d6e0 2024-03-07T10:21:48.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe112000640 1 -- 172.21.15.194:0/2123619260 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104030840 con 0x7fe11414d6e0 2024-03-07T10:21:48.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe112000640 1 -- 172.21.15.194:0/2123619260 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104030c10 con 0x7fe11414d6e0 2024-03-07T10:21:48.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe11a800640 1 -- 172.21.15.194:0/2123619260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11414d6e0 msgr2=0x7fe11406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe11a800640 1 --2- 172.21.15.194:0/2123619260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11414d6e0 0x7fe11406e820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe11406dc70 tx=0x7fe10402b980 comp rx=0 tx=0).stop 2024-03-07T10:21:48.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe11a800640 1 -- 172.21.15.194:0/2123619260 shutdown_connections 2024-03-07T10:21:48.173 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe11a800640 1 --2- 172.21.15.194:0/2123619260 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe11414d6e0 0x7fe11406e820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.171+0000 7fe11a800640 1 -- 172.21.15.194:0/2123619260 >> 172.21.15.194:0/2123619260 conn(0x7fe11406b860 msgr2=0x7fe1140c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:48.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.172+0000 7fe11a800640 1 -- 172.21.15.194:0/2123619260 shutdown_connections 2024-03-07T10:21:48.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.172+0000 7fe11a800640 1 -- 172.21.15.194:0/2123619260 wait complete. 2024-03-07T10:21:48.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.173+0000 7fe11a800640 1 Processor -- start 2024-03-07T10:21:48.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.173+0000 7fe11a800640 1 -- start start 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1140ab340 0x7fe114153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe11414d6e0 0x7fe114146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140aae10 con 0x7fe1140ab7c0 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140c79c0 con 0x7fe1140ab340 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe11a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1140a9be0 con 0x7fe11414d6e0 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe112a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe112a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58244/0 (socket says 172.21.15.194:58244) 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.174+0000 7fe112a00640 1 -- 172.21.15.194:0/2161944360 learned_addr learned my addr 172.21.15.194:0/2161944360 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe113400640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1140ab340 0x7fe114153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 -- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe11414d6e0 msgr2=0x7fe114146530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe11414d6e0 0x7fe114146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 -- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1140ab340 msgr2=0x7fe114153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1140ab340 0x7fe114153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 -- 172.21.15.194:0/2161944360 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1141eb5f0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe112a00640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe10000c450 tx=0x7fe10000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1000052d0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe100005470 con 0x7fe1140ab7c0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1141eb8d0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.175+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe100012870 con 0x7fe1140ab7c0 2024-03-07T10:21:48.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.176+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1141ebe90 con 0x7fe1140ab7c0 2024-03-07T10:21:48.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.177+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe114068170 con 0x7fe1140ab7c0 2024-03-07T10:21:48.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.177+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe100012a10 con 0x7fe1140ab7c0 2024-03-07T10:21:48.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.179+0000 7fe10b400640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 0x7fe0f406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.179+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fe10008a1f0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.180+0000 7fe113400640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 0x7fe0f406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.181+0000 7fe113400640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 0x7fe0f406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe104036000 tx=0x7fe10403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.183+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe100058cc0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.395+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fe114150f20 con 0x7fe1140ab7c0 2024-03-07T10:21:48.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.396+0000 7fe10b400640 1 -- 172.21.15.194:0/2161944360 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fe1000585c0 con 0x7fe1140ab7c0 2024-03-07T10:21:48.397 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 msgr2=0x7fe0f406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 0x7fe0f406d990 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe104036000 tx=0x7fe10403b040 comp rx=0 tx=0).stop 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 msgr2=0x7fe1141478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe10000c450 tx=0x7fe10000c910 comp rx=0 tx=0).stop 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 shutdown_connections 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe0f406b4d0 0x7fe0f406d990 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe11414d6e0 0x7fe114146530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe1140ab7c0 0x7fe1141478e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 --2- 172.21.15.194:0/2161944360 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe1140ab340 0x7fe114153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 >> 172.21.15.194:0/2161944360 conn(0x7fe11406b860 msgr2=0x7fe11414ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:48.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 shutdown_connections 2024-03-07T10:21:48.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.398+0000 7fe11a800640 1 -- 172.21.15.194:0/2161944360 wait complete. 2024-03-07T10:21:48.417 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-03-07T10:21:48.417 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:48.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.613+0000 7fa629000640 1 Processor -- start 2024-03-07T10:21:48.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.613+0000 7fa629000640 1 -- start start 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.614+0000 7fa629000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa6240c5bc0 0x7fa6240c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.614+0000 7fa629000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624155b20 con 0x7fa6241528a0 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa629000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624155dc0 con 0x7fa624152c80 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa629000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa624156080 con 0x7fa6240c5bc0 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa622a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa6241528a0 0x7fa62406c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:51018/0 (socket says 172.21.15.194:51018) 2024-03-07T10:21:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa622a00640 1 -- 172.21.15.194:0/1015579990 learned_addr learned my addr 172.21.15.194:0/1015579990 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa623400640 1 --2- 172.21.15.194:0/1015579990 >> v2:172.21.15.196:3300/0 conn(0x7fa6240c5bc0 0x7fa6240c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584575634 0 0) 0x7fa624155b20 con 0x7fa6241528a0 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.615+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa608003520 con 0x7fa6241528a0 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.616+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1335837236 0 0) 0x7fa608003520 con 0x7fa6241528a0 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.616+0000 7fa623400640 1 -- 172.21.15.194:0/1015579990 >> v1:172.21.15.196:6789/0 conn(0x7fa624152c80 legacy=0x7fa62406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.616+0000 7fa623400640 1 -- 172.21.15.194:0/1015579990 >> v1:172.21.15.194:6789/0 conn(0x7fa6241528a0 legacy=0x7fa62406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.616+0000 7fa623400640 1 -- 172.21.15.194:0/1015579990 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624156360 con 0x7fa6240c5bc0 2024-03-07T10:21:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.617+0000 7fa623400640 1 --2- 172.21.15.194:0/1015579990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6240c5bc0 0x7fa6240c8ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa6140097a0 tx=0x7fa61402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6213e13105fcd803 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.618+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614037070 con 0x7fa6240c5bc0 2024-03-07T10:21:48.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614030510 con 0x7fa6240c5bc0 2024-03-07T10:21:48.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa622000640 1 -- 172.21.15.194:0/1015579990 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610001670 con 0x7fa6240c5bc0 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa629000640 1 -- 172.21.15.194:0/1015579990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6240c5bc0 msgr2=0x7fa6240c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa629000640 1 --2- 172.21.15.194:0/1015579990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6240c5bc0 0x7fa6240c8ed0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa6140097a0 tx=0x7fa61402b790 comp rx=0 tx=0).stop 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa629000640 1 -- 172.21.15.194:0/1015579990 shutdown_connections 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa629000640 1 --2- 172.21.15.194:0/1015579990 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa6240c5bc0 0x7fa6240c8ed0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.619+0000 7fa629000640 1 -- 172.21.15.194:0/1015579990 >> 172.21.15.194:0/1015579990 conn(0x7fa6240675e0 msgr2=0x7fa6240cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.620+0000 7fa629000640 1 -- 172.21.15.194:0/1015579990 shutdown_connections 2024-03-07T10:21:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.620+0000 7fa629000640 1 -- 172.21.15.194:0/1015579990 wait complete. 2024-03-07T10:21:48.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.622+0000 7fa629000640 1 Processor -- start 2024-03-07T10:21:48.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.622+0000 7fa629000640 1 -- start start 2024-03-07T10:21:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6240c5bc0 0x7fa6240c1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 0x7fa62414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624155730 con 0x7fa6241528a0 2024-03-07T10:21:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6241530d0 con 0x7fa624152c80 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.623+0000 7fa629000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6241558b0 con 0x7fa6240c5bc0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58250/0 (socket says 172.21.15.194:58250) 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 -- 172.21.15.194:0/2153336403 learned_addr learned my addr 172.21.15.194:0/2153336403 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa623e00640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 0x7fa62414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa623400640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6240c5bc0 0x7fa6240c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 -- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6240c5bc0 msgr2=0x7fa6240c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6240c5bc0 0x7fa6240c1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 -- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 msgr2=0x7fa62414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 0x7fa62414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 -- 172.21.15.194:0/2153336403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624159670 con 0x7fa6241528a0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa623e00640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 0x7fa62414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.624+0000 7fa622a00640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c730 tx=0x7fa61000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.625+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610017070 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.625+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa610005af0 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.625+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62414edb0 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.625+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa610007070 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.625+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6240c50c0 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.626+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62406d450 con 0x7fa6241528a0 2024-03-07T10:21:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.627+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa61001a070 con 0x7fa6241528a0 2024-03-07T10:21:48.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.628+0000 7fa61b400640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 0x7fa60406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:48.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.628+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa610089b10 con 0x7fa6241528a0 2024-03-07T10:21:48.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.629+0000 7fa623400640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 0x7fa60406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:48.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.630+0000 7fa623400640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 0x7fa60406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa614034000 tx=0x7fa61402f000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:48.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.632+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa6100585e0 con 0x7fa6241528a0 2024-03-07T10:21:48.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.868+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa62414c9f0 con 0x7fa6241528a0 2024-03-07T10:21:48.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.869+0000 7fa61b400640 1 -- 172.21.15.194:0/2153336403 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7fa610057ee0 con 0x7fa6241528a0 2024-03-07T10:21:48.870 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:48.870 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:48.871 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 msgr2=0x7fa60406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 0x7fa60406d990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa614034000 tx=0x7fa61402f000 comp rx=0 tx=0).stop 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 msgr2=0x7fa6240c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c730 tx=0x7fa61000cbf0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 shutdown_connections 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa60406b4d0 0x7fa60406d990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa624152c80 0x7fa62414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6241528a0 0x7fa6240c4280 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 --2- 172.21.15.194:0/2153336403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa6240c5bc0 0x7fa6240c1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:48.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.872+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 >> 172.21.15.194:0/2153336403 conn(0x7fa6240675e0 msgr2=0x7fa6240acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:48.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.873+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 shutdown_connections 2024-03-07T10:21:48.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:48.873+0000 7fa629000640 1 -- 172.21.15.194:0/2153336403 wait complete. 2024-03-07T10:21:48.891 INFO:tasks.mds_thrash:Ready to start thrashing 2024-03-07T10:21:48.891 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-03-07T10:21:48.891 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:49.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.076+0000 7fc9c8e00640 1 Processor -- start 2024-03-07T10:21:49.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.076+0000 7fc9c8e00640 1 -- start start 2024-03-07T10:21:49.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 0x7fc9c4161040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c8e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c4159c20 con 0x7fc9c40c79e0 2024-03-07T10:21:49.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c8e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c4159010 con 0x7fc9c40c90f0 2024-03-07T10:21:49.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c8e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c8230 con 0x7fc9c40c7dc0 2024-03-07T10:21:49.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c3400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc9c40c79e0 0x7fc9c41559c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42094/0 (socket says 172.21.15.194:42094) 2024-03-07T10:21:49.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c3400640 1 -- 172.21.15.194:0/2060230914 learned_addr learned my addr 172.21.15.194:0/2060230914 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.078+0000 7fc9c3e00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 0x7fc9c4161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3103027171 0 0) 0x7fc9c4159c20 con 0x7fc9c40c79e0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9a8003520 con 0x7fc9c40c79e0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405966689 0 0) 0x7fc9a8003520 con 0x7fc9c40c79e0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 msgr2=0x7fc9c4161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 0x7fc9c4161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 >> v1:172.21.15.196:6789/0 conn(0x7fc9c40c90f0 legacy=0x7fc9c41560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c41592f0 con 0x7fc9c40c79e0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fc9b4001670 con 0x7fc9c40c79e0 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 >> v1:172.21.15.194:6789/0 conn(0x7fc9c40c79e0 legacy=0x7fc9c41559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a80039e0 0x7fc9a8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 0x7fc9a8005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40c8230 con 0x7fc9a8004800 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a800bb80 con 0x7fc9a80039e0 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a800bd80 con 0x7fc9c40c7dc0 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.079+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9c3400640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a80039e0 0x7fc9a8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9bbe00640 1 -- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 msgr2=0x7fc9a8005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c7dc0 0x7fc9a8005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9bbe00640 1 -- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a80039e0 msgr2=0x7fc9a8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a80039e0 0x7fc9a8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.080+0000 7fc9bbe00640 1 -- 172.21.15.194:0/2060230914 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a8003520 con 0x7fc9a8004800 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.081+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac001750 tx=0x7fc9a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d64c2a38ec7e4f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.081+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac001370 con 0x7fc9a8004800 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.081+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac0052d0 con 0x7fc9a8004800 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.081+0000 7fc9c2a00640 1 -- 172.21.15.194:0/2060230914 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac003830 con 0x7fc9a8004800 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 -- 172.21.15.194:0/2060230914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9a8004800 msgr2=0x7fc9a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/2060230914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9a8004800 0x7fc9a8004c80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac001750 tx=0x7fc9a8005830 comp rx=0 tx=0).stop 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c3e00640 1 -- 172.21.15.194:0/2060230914 reap_dead start 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 -- 172.21.15.194:0/2060230914 shutdown_connections 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 -- 172.21.15.194:0/2060230914 >> 172.21.15.194:0/2060230914 conn(0x7fc9c40677b0 msgr2=0x7fc9c40cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 -- 172.21.15.194:0/2060230914 shutdown_connections 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.082+0000 7fc9c8e00640 1 -- 172.21.15.194:0/2060230914 wait complete. 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.083+0000 7fc9c8e00640 1 Processor -- start 2024-03-07T10:21:49.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 -- start start 2024-03-07T10:21:49.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a8004800 0x7fc9c40c48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c2d20 0x7fc9c40c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40be8a0 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c41598b0 con 0x7fc9a8004800 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.084+0000 7fc9c8e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c4158ca0 con 0x7fc9c40c2d20 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42278/0 (socket says 172.21.15.194:42278) 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 -- 172.21.15.194:0/28098909 learned_addr learned my addr 172.21.15.194:0/28098909 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9c3400640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a8004800 0x7fc9c40c48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9c3e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c2d20 0x7fc9c40c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 -- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c2d20 msgr2=0x7fc9c40c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c2d20 0x7fc9c40c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 -- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a8004800 msgr2=0x7fc9c40c48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a8004800 0x7fc9c40c48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 -- 172.21.15.194:0/28098909 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40acc10 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.085+0000 7fc9bbe00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac008fd0 tx=0x7fc9ac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.086+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac041070 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.086+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac005480 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.086+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac001370 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.086+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c40c2240 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.086+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c40c4de0 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.090 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.087+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c4068170 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.088+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc9ac044070 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.089+0000 7fc9bb400640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 0x7fc9a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.089+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fc9ac0abfe0 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.090+0000 7fc9c3400640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 0x7fc9a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.091+0000 7fc9c3400640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 0x7fc9a006d9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40016f0 tx=0x7fc9b4001d10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.093+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc9ac07aad0 con 0x7fc9c40ac1c0 2024-03-07T10:21:49.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.272+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9c406d5c0 con 0x7fc9a006b500 2024-03-07T10:21:49.309 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.307+0000 7fc9bb400640 1 -- 172.21.15.194:0/28098909 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490337 (secure 0 0 0) 0x7fc9c406d5c0 con 0x7fc9a006b500 2024-03-07T10:21:49.318 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:49.321 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:49.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 msgr2=0x7fc9a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 0x7fc9a006d9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc9b40016f0 tx=0x7fc9b4001d10 comp rx=0 tx=0).stop 2024-03-07T10:21:49.323 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 msgr2=0x7fc9c40ac5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac008fd0 tx=0x7fc9ac001120 comp rx=0 tx=0).stop 2024-03-07T10:21:49.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 shutdown_connections 2024-03-07T10:21:49.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc9a006b500 0x7fc9a006d9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc9c40c2d20 0x7fc9c40c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9c40ac1c0 0x7fc9c40ac5e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 --2- 172.21.15.194:0/28098909 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc9a8004800 0x7fc9c40c48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 >> 172.21.15.194:0/28098909 conn(0x7fc9c40677b0 msgr2=0x7fc9c40c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:49.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.317+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 shutdown_connections 2024-03-07T10:21:49.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.318+0000 7fc9c8e00640 1 -- 172.21.15.194:0/28098909 wait complete. 2024-03-07T10:21:49.337 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-03-07T10:21:48.431203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":255,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3547136,"data_stored":2099956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.872979"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572163+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:39.572163+0000","last_peered":"2024-03-07T10:21:39.572163+0000","last_clean":"2024-03-07T10:21:39.572163+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:39.572163+0000","last_undegraded":"2024-03-07T10:21:39.572163+0000","last_fullsized":"2024-03-07T10:21:39.572163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614708+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:39.614708+0000","last_peered":"2024-03-07T10:21:39.614708+0000","last_clean":"2024-03-07T10:21:39.614708+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:39.614708+0000","last_undegraded":"2024-03-07T10:21:39.614708+0000","last_fullsized":"2024-03-07T10:21:39.614708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573086+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:39.573086+0000","last_peered":"2024-03-07T10:21:39.573086+0000","last_clean":"2024-03-07T10:21:39.573086+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:39.573086+0000","last_undegraded":"2024-03-07T10:21:39.573086+0000","last_fullsized":"2024-03-07T10:21:39.573086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571310+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:39.571310+0000","last_peered":"2024-03-07T10:21:39.571310+0000","last_clean":"2024-03-07T10:21:39.571310+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:39.571310+0000","last_undegraded":"2024-03-07T10:21:39.571310+0000","last_fullsized":"2024-03-07T10:21:39.571310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574108+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:39.574108+0000","last_peered":"2024-03-07T10:21:39.574108+0000","last_clean":"2024-03-07T10:21:39.574108+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:39.574108+0000","last_undegraded":"2024-03-07T10:21:39.574108+0000","last_fullsized":"2024-03-07T10:21:39.574108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573209+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:39.573209+0000","last_peered":"2024-03-07T10:21:39.573209+0000","last_clean":"2024-03-07T10:21:39.573209+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:39.573209+0000","last_undegraded":"2024-03-07T10:21:39.573209+0000","last_fullsized":"2024-03-07T10:21:39.573209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614635+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:39.614635+0000","last_peered":"2024-03-07T10:21:39.614635+0000","last_clean":"2024-03-07T10:21:39.614635+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:39.614635+0000","last_undegraded":"2024-03-07T10:21:39.614635+0000","last_fullsized":"2024-03-07T10:21:39.614635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572283+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:39.572283+0000","last_peered":"2024-03-07T10:21:39.572283+0000","last_clean":"2024-03-07T10:21:39.572283+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:39.572283+0000","last_undegraded":"2024-03-07T10:21:39.572283+0000","last_fullsized":"2024-03-07T10:21:39.572283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611309+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:39.611309+0000","last_peered":"2024-03-07T10:21:39.611309+0000","last_clean":"2024-03-07T10:21:39.611309+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:39.611309+0000","last_undegraded":"2024-03-07T10:21:39.611309+0000","last_fullsized":"2024-03-07T10:21:39.611309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611948+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:39.611948+0000","last_peered":"2024-03-07T10:21:39.611948+0000","last_clean":"2024-03-07T10:21:39.611948+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:39.611948+0000","last_undegraded":"2024-03-07T10:21:39.611948+0000","last_fullsized":"2024-03-07T10:21:39.611948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574692+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:39.574692+0000","last_peered":"2024-03-07T10:21:39.574692+0000","last_clean":"2024-03-07T10:21:39.574692+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:39.574692+0000","last_undegraded":"2024-03-07T10:21:39.574692+0000","last_fullsized":"2024-03-07T10:21:39.574692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574004+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:39.574004+0000","last_peered":"2024-03-07T10:21:39.574004+0000","last_clean":"2024-03-07T10:21:39.574004+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:39.574004+0000","last_undegraded":"2024-03-07T10:21:39.574004+0000","last_fullsized":"2024-03-07T10:21:39.574004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611614+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:39.611614+0000","last_peered":"2024-03-07T10:21:39.611614+0000","last_clean":"2024-03-07T10:21:39.611614+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:39.611614+0000","last_undegraded":"2024-03-07T10:21:39.611614+0000","last_fullsized":"2024-03-07T10:21:39.611614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574277+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:39.574277+0000","last_peered":"2024-03-07T10:21:39.574277+0000","last_clean":"2024-03-07T10:21:39.574277+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:39.574277+0000","last_undegraded":"2024-03-07T10:21:39.574277+0000","last_fullsized":"2024-03-07T10:21:39.574277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573022+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:39.573022+0000","last_peered":"2024-03-07T10:21:39.573022+0000","last_clean":"2024-03-07T10:21:39.573022+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:39.573022+0000","last_undegraded":"2024-03-07T10:21:39.573022+0000","last_fullsized":"2024-03-07T10:21:39.573022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574485+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:39.574485+0000","last_peered":"2024-03-07T10:21:39.574485+0000","last_clean":"2024-03-07T10:21:39.574485+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:39.574485+0000","last_undegraded":"2024-03-07T10:21:39.574485+0000","last_fullsized":"2024-03-07T10:21:39.574485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575914+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:39.575914+0000","last_peered":"2024-03-07T10:21:39.575914+0000","last_clean":"2024-03-07T10:21:39.575914+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:39.575914+0000","last_undegraded":"2024-03-07T10:21:39.575914+0000","last_fullsized":"2024-03-07T10:21:39.575914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611660+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:39.611660+0000","last_peered":"2024-03-07T10:21:39.611660+0000","last_clean":"2024-03-07T10:21:39.611660+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:39.611660+0000","last_undegraded":"2024-03-07T10:21:39.611660+0000","last_fullsized":"2024-03-07T10:21:39.611660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576434+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:39.576434+0000","last_peered":"2024-03-07T10:21:39.576434+0000","last_clean":"2024-03-07T10:21:39.576434+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:39.576434+0000","last_undegraded":"2024-03-07T10:21:39.576434+0000","last_fullsized":"2024-03-07T10:21:39.576434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580492+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:39.580492+0000","last_peered":"2024-03-07T10:21:39.580492+0000","last_clean":"2024-03-07T10:21:39.580492+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:39.580492+0000","last_undegraded":"2024-03-07T10:21:39.580492+0000","last_fullsized":"2024-03-07T10:21:39.580492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572376+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:39.572376+0000","last_peered":"2024-03-07T10:21:39.572376+0000","last_clean":"2024-03-07T10:21:39.572376+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:39.572376+0000","last_undegraded":"2024-03-07T10:21:39.572376+0000","last_fullsized":"2024-03-07T10:21:39.572376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575014+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:39.575014+0000","last_peered":"2024-03-07T10:21:39.575014+0000","last_clean":"2024-03-07T10:21:39.575014+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:39.575014+0000","last_undegraded":"2024-03-07T10:21:39.575014+0000","last_fullsized":"2024-03-07T10:21:39.575014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576311+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:39.576311+0000","last_peered":"2024-03-07T10:21:39.576311+0000","last_clean":"2024-03-07T10:21:39.576311+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:39.576311+0000","last_undegraded":"2024-03-07T10:21:39.576311+0000","last_fullsized":"2024-03-07T10:21:39.576311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574002+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:39.574002+0000","last_peered":"2024-03-07T10:21:39.574002+0000","last_clean":"2024-03-07T10:21:39.574002+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:39.574002+0000","last_undegraded":"2024-03-07T10:21:39.574002+0000","last_fullsized":"2024-03-07T10:21:39.574002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571534+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:39.571534+0000","last_peered":"2024-03-07T10:21:39.571534+0000","last_clean":"2024-03-07T10:21:39.571534+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:39.571534+0000","last_undegraded":"2024-03-07T10:21:39.571534+0000","last_fullsized":"2024-03-07T10:21:39.571534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575556+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:39.575556+0000","last_peered":"2024-03-07T10:21:39.575556+0000","last_clean":"2024-03-07T10:21:39.575556+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:39.575556+0000","last_undegraded":"2024-03-07T10:21:39.575556+0000","last_fullsized":"2024-03-07T10:21:39.575556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576157+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:39.576157+0000","last_peered":"2024-03-07T10:21:39.576157+0000","last_clean":"2024-03-07T10:21:39.576157+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:39.576157+0000","last_undegraded":"2024-03-07T10:21:39.576157+0000","last_fullsized":"2024-03-07T10:21:39.576157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574801+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:39.574801+0000","last_peered":"2024-03-07T10:21:39.574801+0000","last_clean":"2024-03-07T10:21:39.574801+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:39.574801+0000","last_undegraded":"2024-03-07T10:21:39.574801+0000","last_fullsized":"2024-03-07T10:21:39.574801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573009+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:39.573009+0000","last_peered":"2024-03-07T10:21:39.573009+0000","last_clean":"2024-03-07T10:21:39.573009+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:39.573009+0000","last_undegraded":"2024-03-07T10:21:39.573009+0000","last_fullsized":"2024-03-07T10:21:39.573009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610860+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:39.610860+0000","last_peered":"2024-03-07T10:21:39.610860+0000","last_clean":"2024-03-07T10:21:39.610860+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:39.610860+0000","last_undegraded":"2024-03-07T10:21:39.610860+0000","last_fullsized":"2024-03-07T10:21:39.610860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574147+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:39.574147+0000","last_peered":"2024-03-07T10:21:39.574147+0000","last_clean":"2024-03-07T10:21:39.574147+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:39.574147+0000","last_undegraded":"2024-03-07T10:21:39.574147+0000","last_fullsized":"2024-03-07T10:21:39.574147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571032+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:39.571032+0000","last_peered":"2024-03-07T10:21:39.571032+0000","last_clean":"2024-03-07T10:21:39.571032+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:39.571032+0000","last_undegraded":"2024-03-07T10:21:39.571032+0000","last_fullsized":"2024-03-07T10:21:39.571032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614870+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:39.614870+0000","last_peered":"2024-03-07T10:21:39.614870+0000","last_clean":"2024-03-07T10:21:39.614870+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:39.614870+0000","last_undegraded":"2024-03-07T10:21:39.614870+0000","last_fullsized":"2024-03-07T10:21:39.614870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576641+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:39.576641+0000","last_peered":"2024-03-07T10:21:39.576641+0000","last_clean":"2024-03-07T10:21:39.576641+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:39.576641+0000","last_undegraded":"2024-03-07T10:21:39.576641+0000","last_fullsized":"2024-03-07T10:21:39.576641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572763+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:39.572763+0000","last_peered":"2024-03-07T10:21:39.572763+0000","last_clean":"2024-03-07T10:21:39.572763+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:39.572763+0000","last_undegraded":"2024-03-07T10:21:39.572763+0000","last_fullsized":"2024-03-07T10:21:39.572763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572027+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:39.572027+0000","last_peered":"2024-03-07T10:21:39.572027+0000","last_clean":"2024-03-07T10:21:39.572027+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:39.572027+0000","last_undegraded":"2024-03-07T10:21:39.572027+0000","last_fullsized":"2024-03-07T10:21:39.572027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572183+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:39.572183+0000","last_peered":"2024-03-07T10:21:39.572183+0000","last_clean":"2024-03-07T10:21:39.572183+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:39.572183+0000","last_undegraded":"2024-03-07T10:21:39.572183+0000","last_fullsized":"2024-03-07T10:21:39.572183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577524+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:39.577524+0000","last_peered":"2024-03-07T10:21:39.577524+0000","last_clean":"2024-03-07T10:21:39.577524+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:39.577524+0000","last_undegraded":"2024-03-07T10:21:39.577524+0000","last_fullsized":"2024-03-07T10:21:39.577524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571050+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:39.571050+0000","last_peered":"2024-03-07T10:21:39.571050+0000","last_clean":"2024-03-07T10:21:39.571050+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:39.571050+0000","last_undegraded":"2024-03-07T10:21:39.571050+0000","last_fullsized":"2024-03-07T10:21:39.571050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575639+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:39.575639+0000","last_peered":"2024-03-07T10:21:39.575639+0000","last_clean":"2024-03-07T10:21:39.575639+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:39.575639+0000","last_undegraded":"2024-03-07T10:21:39.575639+0000","last_fullsized":"2024-03-07T10:21:39.575639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575005+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:39.575005+0000","last_peered":"2024-03-07T10:21:39.575005+0000","last_clean":"2024-03-07T10:21:39.575005+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:39.575005+0000","last_undegraded":"2024-03-07T10:21:39.575005+0000","last_fullsized":"2024-03-07T10:21:39.575005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612611+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:39.612611+0000","last_peered":"2024-03-07T10:21:39.612611+0000","last_clean":"2024-03-07T10:21:39.612611+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:39.612611+0000","last_undegraded":"2024-03-07T10:21:39.612611+0000","last_fullsized":"2024-03-07T10:21:39.612611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613055+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:39.613055+0000","last_peered":"2024-03-07T10:21:39.613055+0000","last_clean":"2024-03-07T10:21:39.613055+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:39.613055+0000","last_undegraded":"2024-03-07T10:21:39.613055+0000","last_fullsized":"2024-03-07T10:21:39.613055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574365+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:39.574365+0000","last_peered":"2024-03-07T10:21:39.574365+0000","last_clean":"2024-03-07T10:21:39.574365+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:39.574365+0000","last_undegraded":"2024-03-07T10:21:39.574365+0000","last_fullsized":"2024-03-07T10:21:39.574365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575148+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:39.575148+0000","last_peered":"2024-03-07T10:21:39.575148+0000","last_clean":"2024-03-07T10:21:39.575148+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:39.575148+0000","last_undegraded":"2024-03-07T10:21:39.575148+0000","last_fullsized":"2024-03-07T10:21:39.575148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574627+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:39.574627+0000","last_peered":"2024-03-07T10:21:39.574627+0000","last_clean":"2024-03-07T10:21:39.574627+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:39.574627+0000","last_undegraded":"2024-03-07T10:21:39.574627+0000","last_fullsized":"2024-03-07T10:21:39.574627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614219+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:39.614219+0000","last_peered":"2024-03-07T10:21:39.614219+0000","last_clean":"2024-03-07T10:21:39.614219+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:39.614219+0000","last_undegraded":"2024-03-07T10:21:39.614219+0000","last_fullsized":"2024-03-07T10:21:39.614219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574381+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:39.574381+0000","last_peered":"2024-03-07T10:21:39.574381+0000","last_clean":"2024-03-07T10:21:39.574381+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:39.574381+0000","last_undegraded":"2024-03-07T10:21:39.574381+0000","last_fullsized":"2024-03-07T10:21:39.574381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574850+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:39.574850+0000","last_peered":"2024-03-07T10:21:39.574850+0000","last_clean":"2024-03-07T10:21:39.574850+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:39.574850+0000","last_undegraded":"2024-03-07T10:21:39.574850+0000","last_fullsized":"2024-03-07T10:21:39.574850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580521+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:39.580521+0000","last_peered":"2024-03-07T10:21:39.580521+0000","last_clean":"2024-03-07T10:21:39.580521+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:39.580521+0000","last_undegraded":"2024-03-07T10:21:39.580521+0000","last_fullsized":"2024-03-07T10:21:39.580521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574296+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:39.574296+0000","last_peered":"2024-03-07T10:21:39.574296+0000","last_clean":"2024-03-07T10:21:39.574296+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:39.574296+0000","last_undegraded":"2024-03-07T10:21:39.574296+0000","last_fullsized":"2024-03-07T10:21:39.574296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578629+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:39.578629+0000","last_peered":"2024-03-07T10:21:39.578629+0000","last_clean":"2024-03-07T10:21:39.578629+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:39.578629+0000","last_undegraded":"2024-03-07T10:21:39.578629+0000","last_fullsized":"2024-03-07T10:21:39.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576232+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:39.576232+0000","last_peered":"2024-03-07T10:21:39.576232+0000","last_clean":"2024-03-07T10:21:39.576232+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:39.576232+0000","last_undegraded":"2024-03-07T10:21:39.576232+0000","last_fullsized":"2024-03-07T10:21:39.576232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574913+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:39.574913+0000","last_peered":"2024-03-07T10:21:39.574913+0000","last_clean":"2024-03-07T10:21:39.574913+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:39.574913+0000","last_undegraded":"2024-03-07T10:21:39.574913+0000","last_fullsized":"2024-03-07T10:21:39.574913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612177+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:39.612177+0000","last_peered":"2024-03-07T10:21:39.612177+0000","last_clean":"2024-03-07T10:21:39.612177+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:39.612177+0000","last_undegraded":"2024-03-07T10:21:39.612177+0000","last_fullsized":"2024-03-07T10:21:39.612177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610878+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:39.610878+0000","last_peered":"2024-03-07T10:21:39.610878+0000","last_clean":"2024-03-07T10:21:39.610878+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:39.610878+0000","last_undegraded":"2024-03-07T10:21:39.610878+0000","last_fullsized":"2024-03-07T10:21:39.610878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614988+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:39.614988+0000","last_peered":"2024-03-07T10:21:39.614988+0000","last_clean":"2024-03-07T10:21:39.614988+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:39.614988+0000","last_undegraded":"2024-03-07T10:21:39.614988+0000","last_fullsized":"2024-03-07T10:21:39.614988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611174+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:39.611174+0000","last_peered":"2024-03-07T10:21:39.611174+0000","last_clean":"2024-03-07T10:21:39.611174+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:39.611174+0000","last_undegraded":"2024-03-07T10:21:39.611174+0000","last_fullsized":"2024-03-07T10:21:39.611174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572309+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:39.572309+0000","last_peered":"2024-03-07T10:21:39.572309+0000","last_clean":"2024-03-07T10:21:39.572309+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:39.572309+0000","last_undegraded":"2024-03-07T10:21:39.572309+0000","last_fullsized":"2024-03-07T10:21:39.572309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575001+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:39.575001+0000","last_peered":"2024-03-07T10:21:39.575001+0000","last_clean":"2024-03-07T10:21:39.575001+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:39.575001+0000","last_undegraded":"2024-03-07T10:21:39.575001+0000","last_fullsized":"2024-03-07T10:21:39.575001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610997+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:39.610997+0000","last_peered":"2024-03-07T10:21:39.610997+0000","last_clean":"2024-03-07T10:21:39.610997+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:39.610997+0000","last_undegraded":"2024-03-07T10:21:39.610997+0000","last_fullsized":"2024-03-07T10:21:39.610997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575280+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:39.575280+0000","last_peered":"2024-03-07T10:21:39.575280+0000","last_clean":"2024-03-07T10:21:39.575280+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:39.575280+0000","last_undegraded":"2024-03-07T10:21:39.575280+0000","last_fullsized":"2024-03-07T10:21:39.575280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579635+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:39.579635+0000","last_peered":"2024-03-07T10:21:39.579635+0000","last_clean":"2024-03-07T10:21:39.579635+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:39.579635+0000","last_undegraded":"2024-03-07T10:21:39.579635+0000","last_fullsized":"2024-03-07T10:21:39.579635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611900+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:39.611900+0000","last_peered":"2024-03-07T10:21:39.611900+0000","last_clean":"2024-03-07T10:21:39.611900+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:39.611900+0000","last_undegraded":"2024-03-07T10:21:39.611900+0000","last_fullsized":"2024-03-07T10:21:39.611900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580649+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:39.580649+0000","last_peered":"2024-03-07T10:21:39.580649+0000","last_clean":"2024-03-07T10:21:39.580649+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:39.580649+0000","last_undegraded":"2024-03-07T10:21:39.580649+0000","last_fullsized":"2024-03-07T10:21:39.580649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575754+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:39.575754+0000","last_peered":"2024-03-07T10:21:39.575754+0000","last_clean":"2024-03-07T10:21:39.575754+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:39.575754+0000","last_undegraded":"2024-03-07T10:21:39.575754+0000","last_fullsized":"2024-03-07T10:21:39.575754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578752+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:39.578752+0000","last_peered":"2024-03-07T10:21:39.578752+0000","last_clean":"2024-03-07T10:21:39.578752+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:39.578752+0000","last_undegraded":"2024-03-07T10:21:39.578752+0000","last_fullsized":"2024-03-07T10:21:39.578752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574862+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:39.574862+0000","last_peered":"2024-03-07T10:21:39.574862+0000","last_clean":"2024-03-07T10:21:39.574862+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:39.574862+0000","last_undegraded":"2024-03-07T10:21:39.574862+0000","last_fullsized":"2024-03-07T10:21:39.574862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576091+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:39.576091+0000","last_peered":"2024-03-07T10:21:39.576091+0000","last_clean":"2024-03-07T10:21:39.576091+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:39.576091+0000","last_undegraded":"2024-03-07T10:21:39.576091+0000","last_fullsized":"2024-03-07T10:21:39.576091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612354+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:39.612354+0000","last_peered":"2024-03-07T10:21:39.612354+0000","last_clean":"2024-03-07T10:21:39.612354+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:39.612354+0000","last_undegraded":"2024-03-07T10:21:39.612354+0000","last_fullsized":"2024-03-07T10:21:39.612354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611040+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:39.611040+0000","last_peered":"2024-03-07T10:21:39.611040+0000","last_clean":"2024-03-07T10:21:39.611040+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:39.611040+0000","last_undegraded":"2024-03-07T10:21:39.611040+0000","last_fullsized":"2024-03-07T10:21:39.611040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612376+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:39.612376+0000","last_peered":"2024-03-07T10:21:39.612376+0000","last_clean":"2024-03-07T10:21:39.612376+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:39.612376+0000","last_undegraded":"2024-03-07T10:21:39.612376+0000","last_fullsized":"2024-03-07T10:21:39.612376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580941+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:39.580941+0000","last_peered":"2024-03-07T10:21:39.580941+0000","last_clean":"2024-03-07T10:21:39.580941+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:39.580941+0000","last_undegraded":"2024-03-07T10:21:39.580941+0000","last_fullsized":"2024-03-07T10:21:39.580941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575978+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:39.575978+0000","last_peered":"2024-03-07T10:21:39.575978+0000","last_clean":"2024-03-07T10:21:39.575978+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:39.575978+0000","last_undegraded":"2024-03-07T10:21:39.575978+0000","last_fullsized":"2024-03-07T10:21:39.575978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578874+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:39.578874+0000","last_peered":"2024-03-07T10:21:39.578874+0000","last_clean":"2024-03-07T10:21:39.578874+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:39.578874+0000","last_undegraded":"2024-03-07T10:21:39.578874+0000","last_fullsized":"2024-03-07T10:21:39.578874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611855+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:39.611855+0000","last_peered":"2024-03-07T10:21:39.611855+0000","last_clean":"2024-03-07T10:21:39.611855+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:39.611855+0000","last_undegraded":"2024-03-07T10:21:39.611855+0000","last_fullsized":"2024-03-07T10:21:39.611855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574763+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:39.574763+0000","last_peered":"2024-03-07T10:21:39.574763+0000","last_clean":"2024-03-07T10:21:39.574763+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:39.574763+0000","last_undegraded":"2024-03-07T10:21:39.574763+0000","last_fullsized":"2024-03-07T10:21:39.574763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572513+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:39.572513+0000","last_peered":"2024-03-07T10:21:39.572513+0000","last_clean":"2024-03-07T10:21:39.572513+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:39.572513+0000","last_undegraded":"2024-03-07T10:21:39.572513+0000","last_fullsized":"2024-03-07T10:21:39.572513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571971+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:39.571971+0000","last_peered":"2024-03-07T10:21:39.571971+0000","last_clean":"2024-03-07T10:21:39.571971+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:39.571971+0000","last_undegraded":"2024-03-07T10:21:39.571971+0000","last_fullsized":"2024-03-07T10:21:39.571971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611215+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:39.611215+0000","last_peered":"2024-03-07T10:21:39.611215+0000","last_clean":"2024-03-07T10:21:39.611215+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:39.611215+0000","last_undegraded":"2024-03-07T10:21:39.611215+0000","last_fullsized":"2024-03-07T10:21:39.611215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578998+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:39.578998+0000","last_peered":"2024-03-07T10:21:39.578998+0000","last_clean":"2024-03-07T10:21:39.578998+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:39.578998+0000","last_undegraded":"2024-03-07T10:21:39.578998+0000","last_fullsized":"2024-03-07T10:21:39.578998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614858+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:39.614858+0000","last_peered":"2024-03-07T10:21:39.614858+0000","last_clean":"2024-03-07T10:21:39.614858+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:39.614858+0000","last_undegraded":"2024-03-07T10:21:39.614858+0000","last_fullsized":"2024-03-07T10:21:39.614858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573910+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:39.573910+0000","last_peered":"2024-03-07T10:21:39.573910+0000","last_clean":"2024-03-07T10:21:39.573910+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:39.573910+0000","last_undegraded":"2024-03-07T10:21:39.573910+0000","last_fullsized":"2024-03-07T10:21:39.573910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574355+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:39.574355+0000","last_peered":"2024-03-07T10:21:39.574355+0000","last_clean":"2024-03-07T10:21:39.574355+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:39.574355+0000","last_undegraded":"2024-03-07T10:21:39.574355+0000","last_fullsized":"2024-03-07T10:21:39.574355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575466+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:39.575466+0000","last_peered":"2024-03-07T10:21:39.575466+0000","last_clean":"2024-03-07T10:21:39.575466+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:39.575466+0000","last_undegraded":"2024-03-07T10:21:39.575466+0000","last_fullsized":"2024-03-07T10:21:39.575466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571974+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:39.571974+0000","last_peered":"2024-03-07T10:21:39.571974+0000","last_clean":"2024-03-07T10:21:39.571974+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:39.571974+0000","last_undegraded":"2024-03-07T10:21:39.571974+0000","last_fullsized":"2024-03-07T10:21:39.571974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573504+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:39.573504+0000","last_peered":"2024-03-07T10:21:39.573504+0000","last_clean":"2024-03-07T10:21:39.573504+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:39.573504+0000","last_undegraded":"2024-03-07T10:21:39.573504+0000","last_fullsized":"2024-03-07T10:21:39.573504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611570+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:39.611570+0000","last_peered":"2024-03-07T10:21:39.611570+0000","last_clean":"2024-03-07T10:21:39.611570+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:39.611570+0000","last_undegraded":"2024-03-07T10:21:39.611570+0000","last_fullsized":"2024-03-07T10:21:39.611570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574271+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:39.574271+0000","last_peered":"2024-03-07T10:21:39.574271+0000","last_clean":"2024-03-07T10:21:39.574271+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:39.574271+0000","last_undegraded":"2024-03-07T10:21:39.574271+0000","last_fullsized":"2024-03-07T10:21:39.574271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:42.565814+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:42.565814+0000","last_peered":"2024-03-07T10:21:42.565814+0000","last_clean":"2024-03-07T10:21:42.565814+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:42.565814+0000","last_undegraded":"2024-03-07T10:21:42.565814+0000","last_fullsized":"2024-03-07T10:21:42.565814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571758+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:39.571758+0000","last_peered":"2024-03-07T10:21:39.571758+0000","last_clean":"2024-03-07T10:21:39.571758+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:39.571758+0000","last_undegraded":"2024-03-07T10:21:39.571758+0000","last_fullsized":"2024-03-07T10:21:39.571758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612468+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:39.612468+0000","last_peered":"2024-03-07T10:21:39.612468+0000","last_clean":"2024-03-07T10:21:39.612468+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:39.612468+0000","last_undegraded":"2024-03-07T10:21:39.612468+0000","last_fullsized":"2024-03-07T10:21:39.612468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613779+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:39.613779+0000","last_peered":"2024-03-07T10:21:39.613779+0000","last_clean":"2024-03-07T10:21:39.613779+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:39.613779+0000","last_undegraded":"2024-03-07T10:21:39.613779+0000","last_fullsized":"2024-03-07T10:21:39.613779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575196+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:39.575196+0000","last_peered":"2024-03-07T10:21:39.575196+0000","last_clean":"2024-03-07T10:21:39.575196+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:39.575196+0000","last_undegraded":"2024-03-07T10:21:39.575196+0000","last_fullsized":"2024-03-07T10:21:39.575196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572109+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:39.572109+0000","last_peered":"2024-03-07T10:21:39.572109+0000","last_clean":"2024-03-07T10:21:39.572109+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:39.572109+0000","last_undegraded":"2024-03-07T10:21:39.572109+0000","last_fullsized":"2024-03-07T10:21:39.572109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611833+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:39.611833+0000","last_peered":"2024-03-07T10:21:39.611833+0000","last_clean":"2024-03-07T10:21:39.611833+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:39.611833+0000","last_undegraded":"2024-03-07T10:21:39.611833+0000","last_fullsized":"2024-03-07T10:21:39.611833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575566+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:39.575566+0000","last_peered":"2024-03-07T10:21:39.575566+0000","last_clean":"2024-03-07T10:21:39.575566+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:39.575566+0000","last_undegraded":"2024-03-07T10:21:39.575566+0000","last_fullsized":"2024-03-07T10:21:39.575566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574384+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:39.574384+0000","last_peered":"2024-03-07T10:21:39.574384+0000","last_clean":"2024-03-07T10:21:39.574384+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:39.574384+0000","last_undegraded":"2024-03-07T10:21:39.574384+0000","last_fullsized":"2024-03-07T10:21:39.574384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574902+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:39.574902+0000","last_peered":"2024-03-07T10:21:39.574902+0000","last_clean":"2024-03-07T10:21:39.574902+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:39.574902+0000","last_undegraded":"2024-03-07T10:21:39.574902+0000","last_fullsized":"2024-03-07T10:21:39.574902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576663+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:39.576663+0000","last_peered":"2024-03-07T10:21:39.576663+0000","last_clean":"2024-03-07T10:21:39.576663+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:39.576663+0000","last_undegraded":"2024-03-07T10:21:39.576663+0000","last_fullsized":"2024-03-07T10:21:39.576663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575968+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:39.575968+0000","last_peered":"2024-03-07T10:21:39.575968+0000","last_clean":"2024-03-07T10:21:39.575968+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:39.575968+0000","last_undegraded":"2024-03-07T10:21:39.575968+0000","last_fullsized":"2024-03-07T10:21:39.575968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574186+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:39.574186+0000","last_peered":"2024-03-07T10:21:39.574186+0000","last_clean":"2024-03-07T10:21:39.574186+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:39.574186+0000","last_undegraded":"2024-03-07T10:21:39.574186+0000","last_fullsized":"2024-03-07T10:21:39.574186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575272+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:39.575272+0000","last_peered":"2024-03-07T10:21:39.575272+0000","last_clean":"2024-03-07T10:21:39.575272+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:39.575272+0000","last_undegraded":"2024-03-07T10:21:39.575272+0000","last_fullsized":"2024-03-07T10:21:39.575272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614759+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:39.614759+0000","last_peered":"2024-03-07T10:21:39.614759+0000","last_clean":"2024-03-07T10:21:39.614759+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:39.614759+0000","last_undegraded":"2024-03-07T10:21:39.614759+0000","last_fullsized":"2024-03-07T10:21:39.614759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574662+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:39.574662+0000","last_peered":"2024-03-07T10:21:39.574662+0000","last_clean":"2024-03-07T10:21:39.574662+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:39.574662+0000","last_undegraded":"2024-03-07T10:21:39.574662+0000","last_fullsized":"2024-03-07T10:21:39.574662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571197+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:39.571197+0000","last_peered":"2024-03-07T10:21:39.571197+0000","last_clean":"2024-03-07T10:21:39.571197+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:39.571197+0000","last_undegraded":"2024-03-07T10:21:39.571197+0000","last_fullsized":"2024-03-07T10:21:39.571197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610726+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:39.610726+0000","last_peered":"2024-03-07T10:21:39.610726+0000","last_clean":"2024-03-07T10:21:39.610726+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:39.610726+0000","last_undegraded":"2024-03-07T10:21:39.610726+0000","last_fullsized":"2024-03-07T10:21:39.610726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616041+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:21:39.616041+0000","last_peered":"2024-03-07T10:21:39.616041+0000","last_clean":"2024-03-07T10:21:39.616041+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:21:39.616041+0000","last_undegraded":"2024-03-07T10:21:39.616041+0000","last_fullsized":"2024-03-07T10:21:39.616041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576546+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:39.576546+0000","last_peered":"2024-03-07T10:21:39.576546+0000","last_clean":"2024-03-07T10:21:39.576546+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:39.576546+0000","last_undegraded":"2024-03-07T10:21:39.576546+0000","last_fullsized":"2024-03-07T10:21:39.576546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571166+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:39.571166+0000","last_peered":"2024-03-07T10:21:39.571166+0000","last_clean":"2024-03-07T10:21:39.571166+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:39.571166+0000","last_undegraded":"2024-03-07T10:21:39.571166+0000","last_fullsized":"2024-03-07T10:21:39.571166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576299+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:39.576299+0000","last_peered":"2024-03-07T10:21:39.576299+0000","last_clean":"2024-03-07T10:21:39.576299+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:39.576299+0000","last_undegraded":"2024-03-07T10:21:39.576299+0000","last_fullsized":"2024-03-07T10:21:39.576299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614648+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:39.614648+0000","last_peered":"2024-03-07T10:21:39.614648+0000","last_clean":"2024-03-07T10:21:39.614648+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:39.614648+0000","last_undegraded":"2024-03-07T10:21:39.614648+0000","last_fullsized":"2024-03-07T10:21:39.614648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575260+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:39.575260+0000","last_peered":"2024-03-07T10:21:39.575260+0000","last_clean":"2024-03-07T10:21:39.575260+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:39.575260+0000","last_undegraded":"2024-03-07T10:21:39.575260+0000","last_fullsized":"2024-03-07T10:21:39.575260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576970+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:39.576970+0000","last_peered":"2024-03-07T10:21:39.576970+0000","last_clean":"2024-03-07T10:21:39.576970+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:39.576970+0000","last_undegraded":"2024-03-07T10:21:39.576970+0000","last_fullsized":"2024-03-07T10:21:39.576970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614505+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:39.614505+0000","last_peered":"2024-03-07T10:21:39.614505+0000","last_clean":"2024-03-07T10:21:39.614505+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:39.614505+0000","last_undegraded":"2024-03-07T10:21:39.614505+0000","last_fullsized":"2024-03-07T10:21:39.614505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576394+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:39.576394+0000","last_peered":"2024-03-07T10:21:39.576394+0000","last_clean":"2024-03-07T10:21:39.576394+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:39.576394+0000","last_undegraded":"2024-03-07T10:21:39.576394+0000","last_fullsized":"2024-03-07T10:21:39.576394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571501+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:39.571501+0000","last_peered":"2024-03-07T10:21:39.571501+0000","last_clean":"2024-03-07T10:21:39.571501+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:39.571501+0000","last_undegraded":"2024-03-07T10:21:39.571501+0000","last_fullsized":"2024-03-07T10:21:39.571501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571465+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:39.571465+0000","last_peered":"2024-03-07T10:21:39.571465+0000","last_clean":"2024-03-07T10:21:39.571465+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:39.571465+0000","last_undegraded":"2024-03-07T10:21:39.571465+0000","last_fullsized":"2024-03-07T10:21:39.571465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574997+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:39.574997+0000","last_peered":"2024-03-07T10:21:39.574997+0000","last_clean":"2024-03-07T10:21:39.574997+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:39.574997+0000","last_undegraded":"2024-03-07T10:21:39.574997+0000","last_fullsized":"2024-03-07T10:21:39.574997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576018+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:39.576018+0000","last_peered":"2024-03-07T10:21:39.576018+0000","last_clean":"2024-03-07T10:21:39.576018+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:39.576018+0000","last_undegraded":"2024-03-07T10:21:39.576018+0000","last_fullsized":"2024-03-07T10:21:39.576018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613381+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:39.613381+0000","last_peered":"2024-03-07T10:21:39.613381+0000","last_clean":"2024-03-07T10:21:39.613381+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:39.613381+0000","last_undegraded":"2024-03-07T10:21:39.613381+0000","last_fullsized":"2024-03-07T10:21:39.613381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580254+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:39.580254+0000","last_peered":"2024-03-07T10:21:39.580254+0000","last_clean":"2024-03-07T10:21:39.580254+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:39.580254+0000","last_undegraded":"2024-03-07T10:21:39.580254+0000","last_fullsized":"2024-03-07T10:21:39.580254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576755+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:39.576755+0000","last_peered":"2024-03-07T10:21:39.576755+0000","last_clean":"2024-03-07T10:21:39.576755+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:39.576755+0000","last_undegraded":"2024-03-07T10:21:39.576755+0000","last_fullsized":"2024-03-07T10:21:39.576755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572585+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:39.572585+0000","last_peered":"2024-03-07T10:21:39.572585+0000","last_clean":"2024-03-07T10:21:39.572585+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:39.572585+0000","last_undegraded":"2024-03-07T10:21:39.572585+0000","last_fullsized":"2024-03-07T10:21:39.572585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573281+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:39.573281+0000","last_peered":"2024-03-07T10:21:39.573281+0000","last_clean":"2024-03-07T10:21:39.573281+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:39.573281+0000","last_undegraded":"2024-03-07T10:21:39.573281+0000","last_fullsized":"2024-03-07T10:21:39.573281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572783+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:39.572783+0000","last_peered":"2024-03-07T10:21:39.572783+0000","last_clean":"2024-03-07T10:21:39.572783+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:39.572783+0000","last_undegraded":"2024-03-07T10:21:39.572783+0000","last_fullsized":"2024-03-07T10:21:39.572783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572715+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:39.572715+0000","last_peered":"2024-03-07T10:21:39.572715+0000","last_clean":"2024-03-07T10:21:39.572715+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:39.572715+0000","last_undegraded":"2024-03-07T10:21:39.572715+0000","last_fullsized":"2024-03-07T10:21:39.572715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574256+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:39.574256+0000","last_peered":"2024-03-07T10:21:39.574256+0000","last_clean":"2024-03-07T10:21:39.574256+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:39.574256+0000","last_undegraded":"2024-03-07T10:21:39.574256+0000","last_fullsized":"2024-03-07T10:21:39.574256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576077+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:39.576077+0000","last_peered":"2024-03-07T10:21:39.576077+0000","last_clean":"2024-03-07T10:21:39.576077+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:39.576077+0000","last_undegraded":"2024-03-07T10:21:39.576077+0000","last_fullsized":"2024-03-07T10:21:39.576077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578533+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:39.578533+0000","last_peered":"2024-03-07T10:21:39.578533+0000","last_clean":"2024-03-07T10:21:39.578533+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:39.578533+0000","last_undegraded":"2024-03-07T10:21:39.578533+0000","last_fullsized":"2024-03-07T10:21:39.578533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573778+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:39.573778+0000","last_peered":"2024-03-07T10:21:39.573778+0000","last_clean":"2024-03-07T10:21:39.573778+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:39.573778+0000","last_undegraded":"2024-03-07T10:21:39.573778+0000","last_fullsized":"2024-03-07T10:21:39.573778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574159+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:39.574159+0000","last_peered":"2024-03-07T10:21:39.574159+0000","last_clean":"2024-03-07T10:21:39.574159+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:39.574159+0000","last_undegraded":"2024-03-07T10:21:39.574159+0000","last_fullsized":"2024-03-07T10:21:39.574159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574815+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:39.574815+0000","last_peered":"2024-03-07T10:21:39.574815+0000","last_clean":"2024-03-07T10:21:39.574815+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:39.574815+0000","last_undegraded":"2024-03-07T10:21:39.574815+0000","last_fullsized":"2024-03-07T10:21:39.574815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613299+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:39.613299+0000","last_peered":"2024-03-07T10:21:39.613299+0000","last_clean":"2024-03-07T10:21:39.613299+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:39.613299+0000","last_undegraded":"2024-03-07T10:21:39.613299+0000","last_fullsized":"2024-03-07T10:21:39.613299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611177+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:39.611177+0000","last_peered":"2024-03-07T10:21:39.611177+0000","last_clean":"2024-03-07T10:21:39.611177+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:39.611177+0000","last_undegraded":"2024-03-07T10:21:39.611177+0000","last_fullsized":"2024-03-07T10:21:39.611177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572411+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:39.572411+0000","last_peered":"2024-03-07T10:21:39.572411+0000","last_clean":"2024-03-07T10:21:39.572411+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:39.572411+0000","last_undegraded":"2024-03-07T10:21:39.572411+0000","last_fullsized":"2024-03-07T10:21:39.572411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573655+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:39.573655+0000","last_peered":"2024-03-07T10:21:39.573655+0000","last_clean":"2024-03-07T10:21:39.573655+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:39.573655+0000","last_undegraded":"2024-03-07T10:21:39.573655+0000","last_fullsized":"2024-03-07T10:21:39.573655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575828+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:39.575828+0000","last_peered":"2024-03-07T10:21:39.575828+0000","last_clean":"2024-03-07T10:21:39.575828+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:39.575828+0000","last_undegraded":"2024-03-07T10:21:39.575828+0000","last_fullsized":"2024-03-07T10:21:39.575828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610617+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:39.610617+0000","last_peered":"2024-03-07T10:21:39.610617+0000","last_clean":"2024-03-07T10:21:39.610617+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:39.610617+0000","last_undegraded":"2024-03-07T10:21:39.610617+0000","last_fullsized":"2024-03-07T10:21:39.610617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575953+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:39.575953+0000","last_peered":"2024-03-07T10:21:39.575953+0000","last_clean":"2024-03-07T10:21:39.575953+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:39.575953+0000","last_undegraded":"2024-03-07T10:21:39.575953+0000","last_fullsized":"2024-03-07T10:21:39.575953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575170+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:39.575170+0000","last_peered":"2024-03-07T10:21:39.575170+0000","last_clean":"2024-03-07T10:21:39.575170+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:39.575170+0000","last_undegraded":"2024-03-07T10:21:39.575170+0000","last_fullsized":"2024-03-07T10:21:39.575170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572154+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:39.572154+0000","last_peered":"2024-03-07T10:21:39.572154+0000","last_clean":"2024-03-07T10:21:39.572154+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:39.572154+0000","last_undegraded":"2024-03-07T10:21:39.572154+0000","last_fullsized":"2024-03-07T10:21:39.572154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572594+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:39.572594+0000","last_peered":"2024-03-07T10:21:39.572594+0000","last_clean":"2024-03-07T10:21:39.572594+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:39.572594+0000","last_undegraded":"2024-03-07T10:21:39.572594+0000","last_fullsized":"2024-03-07T10:21:39.572594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.581098+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:21:39.581098+0000","last_peered":"2024-03-07T10:21:39.581098+0000","last_clean":"2024-03-07T10:21:39.581098+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:21:39.581098+0000","last_undegraded":"2024-03-07T10:21:39.581098+0000","last_fullsized":"2024-03-07T10:21:39.581098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612166+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:39.612166+0000","last_peered":"2024-03-07T10:21:39.612166+0000","last_clean":"2024-03-07T10:21:39.612166+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:39.612166+0000","last_undegraded":"2024-03-07T10:21:39.612166+0000","last_fullsized":"2024-03-07T10:21:39.612166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571457+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:39.571457+0000","last_peered":"2024-03-07T10:21:39.571457+0000","last_clean":"2024-03-07T10:21:39.571457+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:39.571457+0000","last_undegraded":"2024-03-07T10:21:39.571457+0000","last_fullsized":"2024-03-07T10:21:39.571457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580192+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:39.580192+0000","last_peered":"2024-03-07T10:21:39.580192+0000","last_clean":"2024-03-07T10:21:39.580192+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:39.580192+0000","last_undegraded":"2024-03-07T10:21:39.580192+0000","last_fullsized":"2024-03-07T10:21:39.580192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616116+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:21:39.616116+0000","last_peered":"2024-03-07T10:21:39.616116+0000","last_clean":"2024-03-07T10:21:39.616116+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:21:39.616116+0000","last_undegraded":"2024-03-07T10:21:39.616116+0000","last_fullsized":"2024-03-07T10:21:39.616116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572662+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:39.572662+0000","last_peered":"2024-03-07T10:21:39.572662+0000","last_clean":"2024-03-07T10:21:39.572662+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:39.572662+0000","last_undegraded":"2024-03-07T10:21:39.572662+0000","last_fullsized":"2024-03-07T10:21:39.572662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612992+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:39.612992+0000","last_peered":"2024-03-07T10:21:39.612992+0000","last_clean":"2024-03-07T10:21:39.612992+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:39.612992+0000","last_undegraded":"2024-03-07T10:21:39.612992+0000","last_fullsized":"2024-03-07T10:21:39.612992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572873+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:39.572873+0000","last_peered":"2024-03-07T10:21:39.572873+0000","last_clean":"2024-03-07T10:21:39.572873+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:39.572873+0000","last_undegraded":"2024-03-07T10:21:39.572873+0000","last_fullsized":"2024-03-07T10:21:39.572873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575382+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:39.575382+0000","last_peered":"2024-03-07T10:21:39.575382+0000","last_clean":"2024-03-07T10:21:39.575382+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:39.575382+0000","last_undegraded":"2024-03-07T10:21:39.575382+0000","last_fullsized":"2024-03-07T10:21:39.575382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572685+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:39.572685+0000","last_peered":"2024-03-07T10:21:39.572685+0000","last_clean":"2024-03-07T10:21:39.572685+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:39.572685+0000","last_undegraded":"2024-03-07T10:21:39.572685+0000","last_fullsized":"2024-03-07T10:21:39.572685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611992+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:39.611992+0000","last_peered":"2024-03-07T10:21:39.611992+0000","last_clean":"2024-03-07T10:21:39.611992+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:39.611992+0000","last_undegraded":"2024-03-07T10:21:39.611992+0000","last_fullsized":"2024-03-07T10:21:39.611992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575817+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:39.575817+0000","last_peered":"2024-03-07T10:21:39.575817+0000","last_clean":"2024-03-07T10:21:39.575817+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:39.575817+0000","last_undegraded":"2024-03-07T10:21:39.575817+0000","last_fullsized":"2024-03-07T10:21:39.575817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580791+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:39.580791+0000","last_peered":"2024-03-07T10:21:39.580791+0000","last_clean":"2024-03-07T10:21:39.580791+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:39.580791+0000","last_undegraded":"2024-03-07T10:21:39.580791+0000","last_fullsized":"2024-03-07T10:21:39.580791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.617133+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:21:39.617133+0000","last_peered":"2024-03-07T10:21:39.617133+0000","last_clean":"2024-03-07T10:21:39.617133+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:21:39.617133+0000","last_undegraded":"2024-03-07T10:21:39.617133+0000","last_fullsized":"2024-03-07T10:21:39.617133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576751+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:39.576751+0000","last_peered":"2024-03-07T10:21:39.576751+0000","last_clean":"2024-03-07T10:21:39.576751+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:39.576751+0000","last_undegraded":"2024-03-07T10:21:39.576751+0000","last_fullsized":"2024-03-07T10:21:39.576751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576854+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:39.576854+0000","last_peered":"2024-03-07T10:21:39.576854+0000","last_clean":"2024-03-07T10:21:39.576854+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:39.576854+0000","last_undegraded":"2024-03-07T10:21:39.576854+0000","last_fullsized":"2024-03-07T10:21:39.576854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574123+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:39.574123+0000","last_peered":"2024-03-07T10:21:39.574123+0000","last_clean":"2024-03-07T10:21:39.574123+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:39.574123+0000","last_undegraded":"2024-03-07T10:21:39.574123+0000","last_fullsized":"2024-03-07T10:21:39.574123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575393+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:39.575393+0000","last_peered":"2024-03-07T10:21:39.575393+0000","last_clean":"2024-03-07T10:21:39.575393+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:39.575393+0000","last_undegraded":"2024-03-07T10:21:39.575393+0000","last_fullsized":"2024-03-07T10:21:39.575393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573663+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:39.573663+0000","last_peered":"2024-03-07T10:21:39.573663+0000","last_clean":"2024-03-07T10:21:39.573663+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:39.573663+0000","last_undegraded":"2024-03-07T10:21:39.573663+0000","last_fullsized":"2024-03-07T10:21:39.573663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612410+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:39.612410+0000","last_peered":"2024-03-07T10:21:39.612410+0000","last_clean":"2024-03-07T10:21:39.612410+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:39.612410+0000","last_undegraded":"2024-03-07T10:21:39.612410+0000","last_fullsized":"2024-03-07T10:21:39.612410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611804+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:39.611804+0000","last_peered":"2024-03-07T10:21:39.611804+0000","last_clean":"2024-03-07T10:21:39.611804+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:39.611804+0000","last_undegraded":"2024-03-07T10:21:39.611804+0000","last_fullsized":"2024-03-07T10:21:39.611804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572336+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:39.572336+0000","last_peered":"2024-03-07T10:21:39.572336+0000","last_clean":"2024-03-07T10:21:39.572336+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:39.572336+0000","last_undegraded":"2024-03-07T10:21:39.572336+0000","last_fullsized":"2024-03-07T10:21:39.572336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571766+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:39.571766+0000","last_peered":"2024-03-07T10:21:39.571766+0000","last_clean":"2024-03-07T10:21:39.571766+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:39.571766+0000","last_undegraded":"2024-03-07T10:21:39.571766+0000","last_fullsized":"2024-03-07T10:21:39.571766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576561+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:39.576561+0000","last_peered":"2024-03-07T10:21:39.576561+0000","last_clean":"2024-03-07T10:21:39.576561+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:39.576561+0000","last_undegraded":"2024-03-07T10:21:39.576561+0000","last_fullsized":"2024-03-07T10:21:39.576561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579274+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:39.579274+0000","last_peered":"2024-03-07T10:21:39.579274+0000","last_clean":"2024-03-07T10:21:39.579274+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:39.579274+0000","last_undegraded":"2024-03-07T10:21:39.579274+0000","last_fullsized":"2024-03-07T10:21:39.579274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575484+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:39.575484+0000","last_peered":"2024-03-07T10:21:39.575484+0000","last_clean":"2024-03-07T10:21:39.575484+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:39.575484+0000","last_undegraded":"2024-03-07T10:21:39.575484+0000","last_fullsized":"2024-03-07T10:21:39.575484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610952+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:39.610952+0000","last_peered":"2024-03-07T10:21:39.610952+0000","last_clean":"2024-03-07T10:21:39.610952+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:39.610952+0000","last_undegraded":"2024-03-07T10:21:39.610952+0000","last_fullsized":"2024-03-07T10:21:39.610952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575848+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:39.575848+0000","last_peered":"2024-03-07T10:21:39.575848+0000","last_clean":"2024-03-07T10:21:39.575848+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:39.575848+0000","last_undegraded":"2024-03-07T10:21:39.575848+0000","last_fullsized":"2024-03-07T10:21:39.575848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573421+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:39.573421+0000","last_peered":"2024-03-07T10:21:39.573421+0000","last_clean":"2024-03-07T10:21:39.573421+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:39.573421+0000","last_undegraded":"2024-03-07T10:21:39.573421+0000","last_fullsized":"2024-03-07T10:21:39.573421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612333+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:39.612333+0000","last_peered":"2024-03-07T10:21:39.612333+0000","last_clean":"2024-03-07T10:21:39.612333+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:39.612333+0000","last_undegraded":"2024-03-07T10:21:39.612333+0000","last_fullsized":"2024-03-07T10:21:39.612333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572442+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:39.572442+0000","last_peered":"2024-03-07T10:21:39.572442+0000","last_clean":"2024-03-07T10:21:39.572442+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:39.572442+0000","last_undegraded":"2024-03-07T10:21:39.572442+0000","last_fullsized":"2024-03-07T10:21:39.572442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571355+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:39.571355+0000","last_peered":"2024-03-07T10:21:39.571355+0000","last_clean":"2024-03-07T10:21:39.571355+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:39.571355+0000","last_undegraded":"2024-03-07T10:21:39.571355+0000","last_fullsized":"2024-03-07T10:21:39.571355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576195+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:39.576195+0000","last_peered":"2024-03-07T10:21:39.576195+0000","last_clean":"2024-03-07T10:21:39.576195+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:39.576195+0000","last_undegraded":"2024-03-07T10:21:39.576195+0000","last_fullsized":"2024-03-07T10:21:39.576195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611057+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:39.611057+0000","last_peered":"2024-03-07T10:21:39.611057+0000","last_clean":"2024-03-07T10:21:39.611057+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:39.611057+0000","last_undegraded":"2024-03-07T10:21:39.611057+0000","last_fullsized":"2024-03-07T10:21:39.611057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574324+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:39.574324+0000","last_peered":"2024-03-07T10:21:39.574324+0000","last_clean":"2024-03-07T10:21:39.574324+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:39.574324+0000","last_undegraded":"2024-03-07T10:21:39.574324+0000","last_fullsized":"2024-03-07T10:21:39.574324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573830+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:39.573830+0000","last_peered":"2024-03-07T10:21:39.573830+0000","last_clean":"2024-03-07T10:21:39.573830+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:39.573830+0000","last_undegraded":"2024-03-07T10:21:39.573830+0000","last_fullsized":"2024-03-07T10:21:39.573830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573913+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:39.573913+0000","last_peered":"2024-03-07T10:21:39.573913+0000","last_clean":"2024-03-07T10:21:39.573913+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:39.573913+0000","last_undegraded":"2024-03-07T10:21:39.573913+0000","last_fullsized":"2024-03-07T10:21:39.573913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611500+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:39.611500+0000","last_peered":"2024-03-07T10:21:39.611500+0000","last_clean":"2024-03-07T10:21:39.611500+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:39.611500+0000","last_undegraded":"2024-03-07T10:21:39.611500+0000","last_fullsized":"2024-03-07T10:21:39.611500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571439+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:39.571439+0000","last_peered":"2024-03-07T10:21:39.571439+0000","last_clean":"2024-03-07T10:21:39.571439+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:39.571439+0000","last_undegraded":"2024-03-07T10:21:39.571439+0000","last_fullsized":"2024-03-07T10:21:39.571439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573967+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:39.573967+0000","last_peered":"2024-03-07T10:21:39.573967+0000","last_clean":"2024-03-07T10:21:39.573967+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:39.573967+0000","last_undegraded":"2024-03-07T10:21:39.573967+0000","last_fullsized":"2024-03-07T10:21:39.573967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579010+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:39.579010+0000","last_peered":"2024-03-07T10:21:39.579010+0000","last_clean":"2024-03-07T10:21:39.579010+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:39.579010+0000","last_undegraded":"2024-03-07T10:21:39.579010+0000","last_fullsized":"2024-03-07T10:21:39.579010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614561+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:39.614561+0000","last_peered":"2024-03-07T10:21:39.614561+0000","last_clean":"2024-03-07T10:21:39.614561+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:39.614561+0000","last_undegraded":"2024-03-07T10:21:39.614561+0000","last_fullsized":"2024-03-07T10:21:39.614561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610599+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:39.610599+0000","last_peered":"2024-03-07T10:21:39.610599+0000","last_clean":"2024-03-07T10:21:39.610599+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:39.610599+0000","last_undegraded":"2024-03-07T10:21:39.610599+0000","last_fullsized":"2024-03-07T10:21:39.610599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577099+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:39.577099+0000","last_peered":"2024-03-07T10:21:39.577099+0000","last_clean":"2024-03-07T10:21:39.577099+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:39.577099+0000","last_undegraded":"2024-03-07T10:21:39.577099+0000","last_fullsized":"2024-03-07T10:21:39.577099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610840+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:39.610840+0000","last_peered":"2024-03-07T10:21:39.610840+0000","last_clean":"2024-03-07T10:21:39.610840+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:39.610840+0000","last_undegraded":"2024-03-07T10:21:39.610840+0000","last_fullsized":"2024-03-07T10:21:39.610840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612287+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:39.612287+0000","last_peered":"2024-03-07T10:21:39.612287+0000","last_clean":"2024-03-07T10:21:39.612287+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:39.612287+0000","last_undegraded":"2024-03-07T10:21:39.612287+0000","last_fullsized":"2024-03-07T10:21:39.612287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":118811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:49.345 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:49.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.572+0000 7f9b8ca00640 1 Processor -- start 2024-03-07T10:21:49.573 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.572+0000 7f9b8ca00640 1 -- start start 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9b88150b70 0x7f9b880a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88156c20 0x7f9b8806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b880a9a10 0x7f9b8806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b88153980 con 0x7f9b880a9a10 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b88153c60 con 0x7f9b88150b70 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.573+0000 7f9b8ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88153f40 con 0x7f9b88156c20 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b880a9a10 0x7f9b8806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9b880a9a10 0x7f9b8806de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42288/0 (socket says 172.21.15.194:42288) 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 -- 172.21.15.194:0/2091034790 learned_addr learned my addr 172.21.15.194:0/2091034790 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b85e00640 1 --2- 172.21.15.194:0/2091034790 >> v2:172.21.15.196:3300/0 conn(0x7f9b88150b70 0x7f9b880a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.576 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b85400640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88156c20 0x7f9b8806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 -- 172.21.15.194:0/2091034790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88156c20 msgr2=0x7f9b8806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:49.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88156c20 0x7f9b8806d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 -- 172.21.15.194:0/2091034790 >> v2:172.21.15.196:3300/0 conn(0x7f9b88150b70 msgr2=0x7f9b880a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:49.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 --2- 172.21.15.194:0/2091034790 >> v2:172.21.15.196:3300/0 conn(0x7f9b88150b70 0x7f9b880a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.574+0000 7f9b86800640 1 -- 172.21.15.194:0/2091034790 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88154220 con 0x7f9b880a9a10 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.575+0000 7f9b86800640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b8806de40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b88073240 tx=0x7f9b8002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f154e30a32d77c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.575+0000 7f9b84a00640 1 -- 172.21.15.194:0/2091034790 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8002c9e0 con 0x7f9b880a9a10 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.575+0000 7f9b84a00640 1 -- 172.21.15.194:0/2091034790 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8002cb80 con 0x7f9b880a9a10 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.575+0000 7f9b84a00640 1 -- 172.21.15.194:0/2091034790 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800343f0 con 0x7f9b880a9a10 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 -- 172.21.15.194:0/2091034790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 msgr2=0x7f9b8806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b8806de40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9b88073240 tx=0x7f9b8002be40 comp rx=0 tx=0).stop 2024-03-07T10:21:49.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 -- 172.21.15.194:0/2091034790 shutdown_connections 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b8806de40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/2091034790 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88156c20 0x7f9b8806d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/2091034790 >> v2:172.21.15.196:3300/0 conn(0x7f9b88150b70 0x7f9b880a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 -- 172.21.15.194:0/2091034790 >> 172.21.15.194:0/2091034790 conn(0x7f9b8806b840 msgr2=0x7f9b880c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 -- 172.21.15.194:0/2091034790 shutdown_connections 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.576+0000 7f9b8ca00640 1 -- 172.21.15.194:0/2091034790 wait complete. 2024-03-07T10:21:49.579 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.578+0000 7f9b8ca00640 1 Processor -- start 2024-03-07T10:21:49.580 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.578+0000 7f9b8ca00640 1 -- start start 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88150b70 0x7f9b881ee5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 0x7f9b881524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88150f50 con 0x7f9b880a9a10 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88153630 con 0x7f9b88156c20 2024-03-07T10:21:49.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b8ca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881510d0 con 0x7f9b88150b70 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b85e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b85e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42302/0 (socket says 172.21.15.194:42302) 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 0x7f9b881524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b85e00640 1 -- 172.21.15.194:0/1519909477 learned_addr learned my addr 172.21.15.194:0/1519909477 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b85400640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88150b70 0x7f9b881ee5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 -- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88150b70 msgr2=0x7f9b881ee5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88150b70 0x7f9b881ee5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 -- 172.21.15.194:0/1519909477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 msgr2=0x7f9b881ebbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b86800640 1 -- 172.21.15.194:0/1519909477 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b880727e0 con 0x7f9b88156c20 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.579+0000 7f9b85e00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b86800640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 0x7f9b881524f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b80032000 tx=0x7f9b80004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80043020 con 0x7f9b88156c20 2024-03-07T10:21:49.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8003e450 con 0x7f9b88156c20 2024-03-07T10:21:49.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88072ac0 con 0x7f9b88156c20 2024-03-07T10:21:49.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80009510 con 0x7f9b88156c20 2024-03-07T10:21:49.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.580+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88146150 con 0x7f9b88156c20 2024-03-07T10:21:49.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.582+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8814e890 con 0x7f9b88156c20 2024-03-07T10:21:49.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.584+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9b80046020 con 0x7f9b88156c20 2024-03-07T10:21:49.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.584+0000 7f9b7e000640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 0x7f9b6806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:49.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.585+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9b800acfe0 con 0x7f9b88156c20 2024-03-07T10:21:49.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.585+0000 7f9b85e00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 0x7f9b6806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:49.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.586+0000 7f9b85e00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 0x7f9b6806d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9b880ac6c0 tx=0x7f9b78009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:49.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.599+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9b8814e890 con 0x7f9b88156c20 2024-03-07T10:21:49.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.790+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b88072590 con 0x7f9b6806b500 2024-03-07T10:21:49.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.816+0000 7f9b7e000640 1 -- 172.21.15.194:0/1519909477 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490337 (secure 0 0 0) 0x7f9b88072590 con 0x7f9b6806b500 2024-03-07T10:21:49.825 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:49.829 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:49.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 msgr2=0x7f9b6806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 0x7f9b6806d9c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9b880ac6c0 tx=0x7f9b78009190 comp rx=0 tx=0).stop 2024-03-07T10:21:49.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 msgr2=0x7f9b881524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 0x7f9b881524f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b80032000 tx=0x7f9b80004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 shutdown_connections 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b6806b500 0x7f9b6806d9c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9b88156c20 0x7f9b881524f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9b88150b70 0x7f9b881ee5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 --2- 172.21.15.194:0/1519909477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9b880a9a10 0x7f9b881ebbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 >> 172.21.15.194:0/1519909477 conn(0x7f9b8806b840 msgr2=0x7f9b8814e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 shutdown_connections 2024-03-07T10:21:49.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:49.826+0000 7f9b8ca00640 1 -- 172.21.15.194:0/1519909477 wait complete. 2024-03-07T10:21:49.846 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-03-07T10:21:48.431203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":255,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3547136,"data_stored":2099956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.872979"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572163+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:39.572163+0000","last_peered":"2024-03-07T10:21:39.572163+0000","last_clean":"2024-03-07T10:21:39.572163+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:39.572163+0000","last_undegraded":"2024-03-07T10:21:39.572163+0000","last_fullsized":"2024-03-07T10:21:39.572163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614708+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:39.614708+0000","last_peered":"2024-03-07T10:21:39.614708+0000","last_clean":"2024-03-07T10:21:39.614708+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:39.614708+0000","last_undegraded":"2024-03-07T10:21:39.614708+0000","last_fullsized":"2024-03-07T10:21:39.614708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573086+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:39.573086+0000","last_peered":"2024-03-07T10:21:39.573086+0000","last_clean":"2024-03-07T10:21:39.573086+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:39.573086+0000","last_undegraded":"2024-03-07T10:21:39.573086+0000","last_fullsized":"2024-03-07T10:21:39.573086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571310+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:39.571310+0000","last_peered":"2024-03-07T10:21:39.571310+0000","last_clean":"2024-03-07T10:21:39.571310+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:39.571310+0000","last_undegraded":"2024-03-07T10:21:39.571310+0000","last_fullsized":"2024-03-07T10:21:39.571310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574108+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:39.574108+0000","last_peered":"2024-03-07T10:21:39.574108+0000","last_clean":"2024-03-07T10:21:39.574108+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:39.574108+0000","last_undegraded":"2024-03-07T10:21:39.574108+0000","last_fullsized":"2024-03-07T10:21:39.574108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573209+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:39.573209+0000","last_peered":"2024-03-07T10:21:39.573209+0000","last_clean":"2024-03-07T10:21:39.573209+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:39.573209+0000","last_undegraded":"2024-03-07T10:21:39.573209+0000","last_fullsized":"2024-03-07T10:21:39.573209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614635+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:39.614635+0000","last_peered":"2024-03-07T10:21:39.614635+0000","last_clean":"2024-03-07T10:21:39.614635+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:39.614635+0000","last_undegraded":"2024-03-07T10:21:39.614635+0000","last_fullsized":"2024-03-07T10:21:39.614635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572283+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:39.572283+0000","last_peered":"2024-03-07T10:21:39.572283+0000","last_clean":"2024-03-07T10:21:39.572283+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:39.572283+0000","last_undegraded":"2024-03-07T10:21:39.572283+0000","last_fullsized":"2024-03-07T10:21:39.572283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611309+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:39.611309+0000","last_peered":"2024-03-07T10:21:39.611309+0000","last_clean":"2024-03-07T10:21:39.611309+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:39.611309+0000","last_undegraded":"2024-03-07T10:21:39.611309+0000","last_fullsized":"2024-03-07T10:21:39.611309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611948+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:39.611948+0000","last_peered":"2024-03-07T10:21:39.611948+0000","last_clean":"2024-03-07T10:21:39.611948+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:39.611948+0000","last_undegraded":"2024-03-07T10:21:39.611948+0000","last_fullsized":"2024-03-07T10:21:39.611948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574692+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:39.574692+0000","last_peered":"2024-03-07T10:21:39.574692+0000","last_clean":"2024-03-07T10:21:39.574692+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:39.574692+0000","last_undegraded":"2024-03-07T10:21:39.574692+0000","last_fullsized":"2024-03-07T10:21:39.574692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574004+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:39.574004+0000","last_peered":"2024-03-07T10:21:39.574004+0000","last_clean":"2024-03-07T10:21:39.574004+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:39.574004+0000","last_undegraded":"2024-03-07T10:21:39.574004+0000","last_fullsized":"2024-03-07T10:21:39.574004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611614+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:39.611614+0000","last_peered":"2024-03-07T10:21:39.611614+0000","last_clean":"2024-03-07T10:21:39.611614+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:39.611614+0000","last_undegraded":"2024-03-07T10:21:39.611614+0000","last_fullsized":"2024-03-07T10:21:39.611614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574277+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:39.574277+0000","last_peered":"2024-03-07T10:21:39.574277+0000","last_clean":"2024-03-07T10:21:39.574277+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:39.574277+0000","last_undegraded":"2024-03-07T10:21:39.574277+0000","last_fullsized":"2024-03-07T10:21:39.574277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573022+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:39.573022+0000","last_peered":"2024-03-07T10:21:39.573022+0000","last_clean":"2024-03-07T10:21:39.573022+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:39.573022+0000","last_undegraded":"2024-03-07T10:21:39.573022+0000","last_fullsized":"2024-03-07T10:21:39.573022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574485+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:39.574485+0000","last_peered":"2024-03-07T10:21:39.574485+0000","last_clean":"2024-03-07T10:21:39.574485+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:39.574485+0000","last_undegraded":"2024-03-07T10:21:39.574485+0000","last_fullsized":"2024-03-07T10:21:39.574485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575914+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:39.575914+0000","last_peered":"2024-03-07T10:21:39.575914+0000","last_clean":"2024-03-07T10:21:39.575914+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:39.575914+0000","last_undegraded":"2024-03-07T10:21:39.575914+0000","last_fullsized":"2024-03-07T10:21:39.575914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611660+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:39.611660+0000","last_peered":"2024-03-07T10:21:39.611660+0000","last_clean":"2024-03-07T10:21:39.611660+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:39.611660+0000","last_undegraded":"2024-03-07T10:21:39.611660+0000","last_fullsized":"2024-03-07T10:21:39.611660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576434+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:39.576434+0000","last_peered":"2024-03-07T10:21:39.576434+0000","last_clean":"2024-03-07T10:21:39.576434+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:39.576434+0000","last_undegraded":"2024-03-07T10:21:39.576434+0000","last_fullsized":"2024-03-07T10:21:39.576434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580492+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:39.580492+0000","last_peered":"2024-03-07T10:21:39.580492+0000","last_clean":"2024-03-07T10:21:39.580492+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:39.580492+0000","last_undegraded":"2024-03-07T10:21:39.580492+0000","last_fullsized":"2024-03-07T10:21:39.580492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572376+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:39.572376+0000","last_peered":"2024-03-07T10:21:39.572376+0000","last_clean":"2024-03-07T10:21:39.572376+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:39.572376+0000","last_undegraded":"2024-03-07T10:21:39.572376+0000","last_fullsized":"2024-03-07T10:21:39.572376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575014+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:39.575014+0000","last_peered":"2024-03-07T10:21:39.575014+0000","last_clean":"2024-03-07T10:21:39.575014+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:39.575014+0000","last_undegraded":"2024-03-07T10:21:39.575014+0000","last_fullsized":"2024-03-07T10:21:39.575014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576311+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:39.576311+0000","last_peered":"2024-03-07T10:21:39.576311+0000","last_clean":"2024-03-07T10:21:39.576311+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:39.576311+0000","last_undegraded":"2024-03-07T10:21:39.576311+0000","last_fullsized":"2024-03-07T10:21:39.576311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574002+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:39.574002+0000","last_peered":"2024-03-07T10:21:39.574002+0000","last_clean":"2024-03-07T10:21:39.574002+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:39.574002+0000","last_undegraded":"2024-03-07T10:21:39.574002+0000","last_fullsized":"2024-03-07T10:21:39.574002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571534+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:39.571534+0000","last_peered":"2024-03-07T10:21:39.571534+0000","last_clean":"2024-03-07T10:21:39.571534+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:39.571534+0000","last_undegraded":"2024-03-07T10:21:39.571534+0000","last_fullsized":"2024-03-07T10:21:39.571534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575556+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:39.575556+0000","last_peered":"2024-03-07T10:21:39.575556+0000","last_clean":"2024-03-07T10:21:39.575556+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:39.575556+0000","last_undegraded":"2024-03-07T10:21:39.575556+0000","last_fullsized":"2024-03-07T10:21:39.575556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576157+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:39.576157+0000","last_peered":"2024-03-07T10:21:39.576157+0000","last_clean":"2024-03-07T10:21:39.576157+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:39.576157+0000","last_undegraded":"2024-03-07T10:21:39.576157+0000","last_fullsized":"2024-03-07T10:21:39.576157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574801+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:39.574801+0000","last_peered":"2024-03-07T10:21:39.574801+0000","last_clean":"2024-03-07T10:21:39.574801+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:39.574801+0000","last_undegraded":"2024-03-07T10:21:39.574801+0000","last_fullsized":"2024-03-07T10:21:39.574801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573009+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:39.573009+0000","last_peered":"2024-03-07T10:21:39.573009+0000","last_clean":"2024-03-07T10:21:39.573009+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:39.573009+0000","last_undegraded":"2024-03-07T10:21:39.573009+0000","last_fullsized":"2024-03-07T10:21:39.573009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610860+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:39.610860+0000","last_peered":"2024-03-07T10:21:39.610860+0000","last_clean":"2024-03-07T10:21:39.610860+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:39.610860+0000","last_undegraded":"2024-03-07T10:21:39.610860+0000","last_fullsized":"2024-03-07T10:21:39.610860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574147+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:39.574147+0000","last_peered":"2024-03-07T10:21:39.574147+0000","last_clean":"2024-03-07T10:21:39.574147+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:39.574147+0000","last_undegraded":"2024-03-07T10:21:39.574147+0000","last_fullsized":"2024-03-07T10:21:39.574147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571032+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:39.571032+0000","last_peered":"2024-03-07T10:21:39.571032+0000","last_clean":"2024-03-07T10:21:39.571032+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:39.571032+0000","last_undegraded":"2024-03-07T10:21:39.571032+0000","last_fullsized":"2024-03-07T10:21:39.571032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614870+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:39.614870+0000","last_peered":"2024-03-07T10:21:39.614870+0000","last_clean":"2024-03-07T10:21:39.614870+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:39.614870+0000","last_undegraded":"2024-03-07T10:21:39.614870+0000","last_fullsized":"2024-03-07T10:21:39.614870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576641+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:39.576641+0000","last_peered":"2024-03-07T10:21:39.576641+0000","last_clean":"2024-03-07T10:21:39.576641+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:39.576641+0000","last_undegraded":"2024-03-07T10:21:39.576641+0000","last_fullsized":"2024-03-07T10:21:39.576641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572763+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:39.572763+0000","last_peered":"2024-03-07T10:21:39.572763+0000","last_clean":"2024-03-07T10:21:39.572763+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:39.572763+0000","last_undegraded":"2024-03-07T10:21:39.572763+0000","last_fullsized":"2024-03-07T10:21:39.572763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572027+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:39.572027+0000","last_peered":"2024-03-07T10:21:39.572027+0000","last_clean":"2024-03-07T10:21:39.572027+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:39.572027+0000","last_undegraded":"2024-03-07T10:21:39.572027+0000","last_fullsized":"2024-03-07T10:21:39.572027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572183+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:39.572183+0000","last_peered":"2024-03-07T10:21:39.572183+0000","last_clean":"2024-03-07T10:21:39.572183+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:39.572183+0000","last_undegraded":"2024-03-07T10:21:39.572183+0000","last_fullsized":"2024-03-07T10:21:39.572183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577524+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:39.577524+0000","last_peered":"2024-03-07T10:21:39.577524+0000","last_clean":"2024-03-07T10:21:39.577524+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:39.577524+0000","last_undegraded":"2024-03-07T10:21:39.577524+0000","last_fullsized":"2024-03-07T10:21:39.577524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571050+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:39.571050+0000","last_peered":"2024-03-07T10:21:39.571050+0000","last_clean":"2024-03-07T10:21:39.571050+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:39.571050+0000","last_undegraded":"2024-03-07T10:21:39.571050+0000","last_fullsized":"2024-03-07T10:21:39.571050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575639+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:39.575639+0000","last_peered":"2024-03-07T10:21:39.575639+0000","last_clean":"2024-03-07T10:21:39.575639+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:39.575639+0000","last_undegraded":"2024-03-07T10:21:39.575639+0000","last_fullsized":"2024-03-07T10:21:39.575639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575005+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:39.575005+0000","last_peered":"2024-03-07T10:21:39.575005+0000","last_clean":"2024-03-07T10:21:39.575005+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:39.575005+0000","last_undegraded":"2024-03-07T10:21:39.575005+0000","last_fullsized":"2024-03-07T10:21:39.575005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612611+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:39.612611+0000","last_peered":"2024-03-07T10:21:39.612611+0000","last_clean":"2024-03-07T10:21:39.612611+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:39.612611+0000","last_undegraded":"2024-03-07T10:21:39.612611+0000","last_fullsized":"2024-03-07T10:21:39.612611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613055+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:39.613055+0000","last_peered":"2024-03-07T10:21:39.613055+0000","last_clean":"2024-03-07T10:21:39.613055+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:39.613055+0000","last_undegraded":"2024-03-07T10:21:39.613055+0000","last_fullsized":"2024-03-07T10:21:39.613055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574365+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:39.574365+0000","last_peered":"2024-03-07T10:21:39.574365+0000","last_clean":"2024-03-07T10:21:39.574365+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:39.574365+0000","last_undegraded":"2024-03-07T10:21:39.574365+0000","last_fullsized":"2024-03-07T10:21:39.574365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575148+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:39.575148+0000","last_peered":"2024-03-07T10:21:39.575148+0000","last_clean":"2024-03-07T10:21:39.575148+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:39.575148+0000","last_undegraded":"2024-03-07T10:21:39.575148+0000","last_fullsized":"2024-03-07T10:21:39.575148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574627+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:39.574627+0000","last_peered":"2024-03-07T10:21:39.574627+0000","last_clean":"2024-03-07T10:21:39.574627+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:39.574627+0000","last_undegraded":"2024-03-07T10:21:39.574627+0000","last_fullsized":"2024-03-07T10:21:39.574627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614219+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:39.614219+0000","last_peered":"2024-03-07T10:21:39.614219+0000","last_clean":"2024-03-07T10:21:39.614219+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:39.614219+0000","last_undegraded":"2024-03-07T10:21:39.614219+0000","last_fullsized":"2024-03-07T10:21:39.614219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574381+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:39.574381+0000","last_peered":"2024-03-07T10:21:39.574381+0000","last_clean":"2024-03-07T10:21:39.574381+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:39.574381+0000","last_undegraded":"2024-03-07T10:21:39.574381+0000","last_fullsized":"2024-03-07T10:21:39.574381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574850+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:39.574850+0000","last_peered":"2024-03-07T10:21:39.574850+0000","last_clean":"2024-03-07T10:21:39.574850+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:39.574850+0000","last_undegraded":"2024-03-07T10:21:39.574850+0000","last_fullsized":"2024-03-07T10:21:39.574850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580521+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:39.580521+0000","last_peered":"2024-03-07T10:21:39.580521+0000","last_clean":"2024-03-07T10:21:39.580521+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:39.580521+0000","last_undegraded":"2024-03-07T10:21:39.580521+0000","last_fullsized":"2024-03-07T10:21:39.580521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574296+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:39.574296+0000","last_peered":"2024-03-07T10:21:39.574296+0000","last_clean":"2024-03-07T10:21:39.574296+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:39.574296+0000","last_undegraded":"2024-03-07T10:21:39.574296+0000","last_fullsized":"2024-03-07T10:21:39.574296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578629+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:39.578629+0000","last_peered":"2024-03-07T10:21:39.578629+0000","last_clean":"2024-03-07T10:21:39.578629+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:39.578629+0000","last_undegraded":"2024-03-07T10:21:39.578629+0000","last_fullsized":"2024-03-07T10:21:39.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576232+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:39.576232+0000","last_peered":"2024-03-07T10:21:39.576232+0000","last_clean":"2024-03-07T10:21:39.576232+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:39.576232+0000","last_undegraded":"2024-03-07T10:21:39.576232+0000","last_fullsized":"2024-03-07T10:21:39.576232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574913+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:39.574913+0000","last_peered":"2024-03-07T10:21:39.574913+0000","last_clean":"2024-03-07T10:21:39.574913+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:39.574913+0000","last_undegraded":"2024-03-07T10:21:39.574913+0000","last_fullsized":"2024-03-07T10:21:39.574913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612177+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:39.612177+0000","last_peered":"2024-03-07T10:21:39.612177+0000","last_clean":"2024-03-07T10:21:39.612177+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:39.612177+0000","last_undegraded":"2024-03-07T10:21:39.612177+0000","last_fullsized":"2024-03-07T10:21:39.612177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610878+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:39.610878+0000","last_peered":"2024-03-07T10:21:39.610878+0000","last_clean":"2024-03-07T10:21:39.610878+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:39.610878+0000","last_undegraded":"2024-03-07T10:21:39.610878+0000","last_fullsized":"2024-03-07T10:21:39.610878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614988+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:39.614988+0000","last_peered":"2024-03-07T10:21:39.614988+0000","last_clean":"2024-03-07T10:21:39.614988+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:39.614988+0000","last_undegraded":"2024-03-07T10:21:39.614988+0000","last_fullsized":"2024-03-07T10:21:39.614988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611174+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:39.611174+0000","last_peered":"2024-03-07T10:21:39.611174+0000","last_clean":"2024-03-07T10:21:39.611174+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:39.611174+0000","last_undegraded":"2024-03-07T10:21:39.611174+0000","last_fullsized":"2024-03-07T10:21:39.611174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572309+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:39.572309+0000","last_peered":"2024-03-07T10:21:39.572309+0000","last_clean":"2024-03-07T10:21:39.572309+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:39.572309+0000","last_undegraded":"2024-03-07T10:21:39.572309+0000","last_fullsized":"2024-03-07T10:21:39.572309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575001+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:39.575001+0000","last_peered":"2024-03-07T10:21:39.575001+0000","last_clean":"2024-03-07T10:21:39.575001+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:39.575001+0000","last_undegraded":"2024-03-07T10:21:39.575001+0000","last_fullsized":"2024-03-07T10:21:39.575001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610997+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:39.610997+0000","last_peered":"2024-03-07T10:21:39.610997+0000","last_clean":"2024-03-07T10:21:39.610997+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:39.610997+0000","last_undegraded":"2024-03-07T10:21:39.610997+0000","last_fullsized":"2024-03-07T10:21:39.610997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575280+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:39.575280+0000","last_peered":"2024-03-07T10:21:39.575280+0000","last_clean":"2024-03-07T10:21:39.575280+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:39.575280+0000","last_undegraded":"2024-03-07T10:21:39.575280+0000","last_fullsized":"2024-03-07T10:21:39.575280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579635+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:39.579635+0000","last_peered":"2024-03-07T10:21:39.579635+0000","last_clean":"2024-03-07T10:21:39.579635+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:39.579635+0000","last_undegraded":"2024-03-07T10:21:39.579635+0000","last_fullsized":"2024-03-07T10:21:39.579635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611900+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:39.611900+0000","last_peered":"2024-03-07T10:21:39.611900+0000","last_clean":"2024-03-07T10:21:39.611900+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:39.611900+0000","last_undegraded":"2024-03-07T10:21:39.611900+0000","last_fullsized":"2024-03-07T10:21:39.611900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580649+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:39.580649+0000","last_peered":"2024-03-07T10:21:39.580649+0000","last_clean":"2024-03-07T10:21:39.580649+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:39.580649+0000","last_undegraded":"2024-03-07T10:21:39.580649+0000","last_fullsized":"2024-03-07T10:21:39.580649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575754+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:39.575754+0000","last_peered":"2024-03-07T10:21:39.575754+0000","last_clean":"2024-03-07T10:21:39.575754+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:39.575754+0000","last_undegraded":"2024-03-07T10:21:39.575754+0000","last_fullsized":"2024-03-07T10:21:39.575754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578752+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:39.578752+0000","last_peered":"2024-03-07T10:21:39.578752+0000","last_clean":"2024-03-07T10:21:39.578752+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:39.578752+0000","last_undegraded":"2024-03-07T10:21:39.578752+0000","last_fullsized":"2024-03-07T10:21:39.578752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574862+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:39.574862+0000","last_peered":"2024-03-07T10:21:39.574862+0000","last_clean":"2024-03-07T10:21:39.574862+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:39.574862+0000","last_undegraded":"2024-03-07T10:21:39.574862+0000","last_fullsized":"2024-03-07T10:21:39.574862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576091+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:39.576091+0000","last_peered":"2024-03-07T10:21:39.576091+0000","last_clean":"2024-03-07T10:21:39.576091+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:39.576091+0000","last_undegraded":"2024-03-07T10:21:39.576091+0000","last_fullsized":"2024-03-07T10:21:39.576091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612354+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:39.612354+0000","last_peered":"2024-03-07T10:21:39.612354+0000","last_clean":"2024-03-07T10:21:39.612354+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:39.612354+0000","last_undegraded":"2024-03-07T10:21:39.612354+0000","last_fullsized":"2024-03-07T10:21:39.612354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611040+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:39.611040+0000","last_peered":"2024-03-07T10:21:39.611040+0000","last_clean":"2024-03-07T10:21:39.611040+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:39.611040+0000","last_undegraded":"2024-03-07T10:21:39.611040+0000","last_fullsized":"2024-03-07T10:21:39.611040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612376+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:39.612376+0000","last_peered":"2024-03-07T10:21:39.612376+0000","last_clean":"2024-03-07T10:21:39.612376+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:39.612376+0000","last_undegraded":"2024-03-07T10:21:39.612376+0000","last_fullsized":"2024-03-07T10:21:39.612376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580941+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:39.580941+0000","last_peered":"2024-03-07T10:21:39.580941+0000","last_clean":"2024-03-07T10:21:39.580941+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:39.580941+0000","last_undegraded":"2024-03-07T10:21:39.580941+0000","last_fullsized":"2024-03-07T10:21:39.580941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575978+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:39.575978+0000","last_peered":"2024-03-07T10:21:39.575978+0000","last_clean":"2024-03-07T10:21:39.575978+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:39.575978+0000","last_undegraded":"2024-03-07T10:21:39.575978+0000","last_fullsized":"2024-03-07T10:21:39.575978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578874+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:39.578874+0000","last_peered":"2024-03-07T10:21:39.578874+0000","last_clean":"2024-03-07T10:21:39.578874+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:39.578874+0000","last_undegraded":"2024-03-07T10:21:39.578874+0000","last_fullsized":"2024-03-07T10:21:39.578874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611855+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:39.611855+0000","last_peered":"2024-03-07T10:21:39.611855+0000","last_clean":"2024-03-07T10:21:39.611855+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:39.611855+0000","last_undegraded":"2024-03-07T10:21:39.611855+0000","last_fullsized":"2024-03-07T10:21:39.611855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574763+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:39.574763+0000","last_peered":"2024-03-07T10:21:39.574763+0000","last_clean":"2024-03-07T10:21:39.574763+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:39.574763+0000","last_undegraded":"2024-03-07T10:21:39.574763+0000","last_fullsized":"2024-03-07T10:21:39.574763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572513+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:39.572513+0000","last_peered":"2024-03-07T10:21:39.572513+0000","last_clean":"2024-03-07T10:21:39.572513+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:39.572513+0000","last_undegraded":"2024-03-07T10:21:39.572513+0000","last_fullsized":"2024-03-07T10:21:39.572513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571971+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:39.571971+0000","last_peered":"2024-03-07T10:21:39.571971+0000","last_clean":"2024-03-07T10:21:39.571971+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:39.571971+0000","last_undegraded":"2024-03-07T10:21:39.571971+0000","last_fullsized":"2024-03-07T10:21:39.571971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611215+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:39.611215+0000","last_peered":"2024-03-07T10:21:39.611215+0000","last_clean":"2024-03-07T10:21:39.611215+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:39.611215+0000","last_undegraded":"2024-03-07T10:21:39.611215+0000","last_fullsized":"2024-03-07T10:21:39.611215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578998+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:39.578998+0000","last_peered":"2024-03-07T10:21:39.578998+0000","last_clean":"2024-03-07T10:21:39.578998+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:39.578998+0000","last_undegraded":"2024-03-07T10:21:39.578998+0000","last_fullsized":"2024-03-07T10:21:39.578998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614858+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:39.614858+0000","last_peered":"2024-03-07T10:21:39.614858+0000","last_clean":"2024-03-07T10:21:39.614858+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:39.614858+0000","last_undegraded":"2024-03-07T10:21:39.614858+0000","last_fullsized":"2024-03-07T10:21:39.614858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573910+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:39.573910+0000","last_peered":"2024-03-07T10:21:39.573910+0000","last_clean":"2024-03-07T10:21:39.573910+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:39.573910+0000","last_undegraded":"2024-03-07T10:21:39.573910+0000","last_fullsized":"2024-03-07T10:21:39.573910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574355+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:39.574355+0000","last_peered":"2024-03-07T10:21:39.574355+0000","last_clean":"2024-03-07T10:21:39.574355+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:39.574355+0000","last_undegraded":"2024-03-07T10:21:39.574355+0000","last_fullsized":"2024-03-07T10:21:39.574355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575466+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:39.575466+0000","last_peered":"2024-03-07T10:21:39.575466+0000","last_clean":"2024-03-07T10:21:39.575466+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:39.575466+0000","last_undegraded":"2024-03-07T10:21:39.575466+0000","last_fullsized":"2024-03-07T10:21:39.575466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571974+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:39.571974+0000","last_peered":"2024-03-07T10:21:39.571974+0000","last_clean":"2024-03-07T10:21:39.571974+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:39.571974+0000","last_undegraded":"2024-03-07T10:21:39.571974+0000","last_fullsized":"2024-03-07T10:21:39.571974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573504+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:39.573504+0000","last_peered":"2024-03-07T10:21:39.573504+0000","last_clean":"2024-03-07T10:21:39.573504+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:39.573504+0000","last_undegraded":"2024-03-07T10:21:39.573504+0000","last_fullsized":"2024-03-07T10:21:39.573504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611570+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:39.611570+0000","last_peered":"2024-03-07T10:21:39.611570+0000","last_clean":"2024-03-07T10:21:39.611570+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:39.611570+0000","last_undegraded":"2024-03-07T10:21:39.611570+0000","last_fullsized":"2024-03-07T10:21:39.611570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574271+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:39.574271+0000","last_peered":"2024-03-07T10:21:39.574271+0000","last_clean":"2024-03-07T10:21:39.574271+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:39.574271+0000","last_undegraded":"2024-03-07T10:21:39.574271+0000","last_fullsized":"2024-03-07T10:21:39.574271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:42.565814+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:42.565814+0000","last_peered":"2024-03-07T10:21:42.565814+0000","last_clean":"2024-03-07T10:21:42.565814+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:42.565814+0000","last_undegraded":"2024-03-07T10:21:42.565814+0000","last_fullsized":"2024-03-07T10:21:42.565814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571758+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:39.571758+0000","last_peered":"2024-03-07T10:21:39.571758+0000","last_clean":"2024-03-07T10:21:39.571758+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:39.571758+0000","last_undegraded":"2024-03-07T10:21:39.571758+0000","last_fullsized":"2024-03-07T10:21:39.571758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612468+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:39.612468+0000","last_peered":"2024-03-07T10:21:39.612468+0000","last_clean":"2024-03-07T10:21:39.612468+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:39.612468+0000","last_undegraded":"2024-03-07T10:21:39.612468+0000","last_fullsized":"2024-03-07T10:21:39.612468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613779+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:39.613779+0000","last_peered":"2024-03-07T10:21:39.613779+0000","last_clean":"2024-03-07T10:21:39.613779+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:39.613779+0000","last_undegraded":"2024-03-07T10:21:39.613779+0000","last_fullsized":"2024-03-07T10:21:39.613779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575196+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:39.575196+0000","last_peered":"2024-03-07T10:21:39.575196+0000","last_clean":"2024-03-07T10:21:39.575196+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:39.575196+0000","last_undegraded":"2024-03-07T10:21:39.575196+0000","last_fullsized":"2024-03-07T10:21:39.575196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572109+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:39.572109+0000","last_peered":"2024-03-07T10:21:39.572109+0000","last_clean":"2024-03-07T10:21:39.572109+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:39.572109+0000","last_undegraded":"2024-03-07T10:21:39.572109+0000","last_fullsized":"2024-03-07T10:21:39.572109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611833+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:39.611833+0000","last_peered":"2024-03-07T10:21:39.611833+0000","last_clean":"2024-03-07T10:21:39.611833+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:39.611833+0000","last_undegraded":"2024-03-07T10:21:39.611833+0000","last_fullsized":"2024-03-07T10:21:39.611833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575566+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:39.575566+0000","last_peered":"2024-03-07T10:21:39.575566+0000","last_clean":"2024-03-07T10:21:39.575566+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:39.575566+0000","last_undegraded":"2024-03-07T10:21:39.575566+0000","last_fullsized":"2024-03-07T10:21:39.575566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574384+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:39.574384+0000","last_peered":"2024-03-07T10:21:39.574384+0000","last_clean":"2024-03-07T10:21:39.574384+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:39.574384+0000","last_undegraded":"2024-03-07T10:21:39.574384+0000","last_fullsized":"2024-03-07T10:21:39.574384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574902+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:39.574902+0000","last_peered":"2024-03-07T10:21:39.574902+0000","last_clean":"2024-03-07T10:21:39.574902+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:39.574902+0000","last_undegraded":"2024-03-07T10:21:39.574902+0000","last_fullsized":"2024-03-07T10:21:39.574902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576663+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:39.576663+0000","last_peered":"2024-03-07T10:21:39.576663+0000","last_clean":"2024-03-07T10:21:39.576663+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:39.576663+0000","last_undegraded":"2024-03-07T10:21:39.576663+0000","last_fullsized":"2024-03-07T10:21:39.576663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575968+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:39.575968+0000","last_peered":"2024-03-07T10:21:39.575968+0000","last_clean":"2024-03-07T10:21:39.575968+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:39.575968+0000","last_undegraded":"2024-03-07T10:21:39.575968+0000","last_fullsized":"2024-03-07T10:21:39.575968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574186+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:39.574186+0000","last_peered":"2024-03-07T10:21:39.574186+0000","last_clean":"2024-03-07T10:21:39.574186+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:39.574186+0000","last_undegraded":"2024-03-07T10:21:39.574186+0000","last_fullsized":"2024-03-07T10:21:39.574186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575272+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:39.575272+0000","last_peered":"2024-03-07T10:21:39.575272+0000","last_clean":"2024-03-07T10:21:39.575272+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:39.575272+0000","last_undegraded":"2024-03-07T10:21:39.575272+0000","last_fullsized":"2024-03-07T10:21:39.575272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614759+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:39.614759+0000","last_peered":"2024-03-07T10:21:39.614759+0000","last_clean":"2024-03-07T10:21:39.614759+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:39.614759+0000","last_undegraded":"2024-03-07T10:21:39.614759+0000","last_fullsized":"2024-03-07T10:21:39.614759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574662+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:39.574662+0000","last_peered":"2024-03-07T10:21:39.574662+0000","last_clean":"2024-03-07T10:21:39.574662+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:39.574662+0000","last_undegraded":"2024-03-07T10:21:39.574662+0000","last_fullsized":"2024-03-07T10:21:39.574662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571197+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:39.571197+0000","last_peered":"2024-03-07T10:21:39.571197+0000","last_clean":"2024-03-07T10:21:39.571197+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:39.571197+0000","last_undegraded":"2024-03-07T10:21:39.571197+0000","last_fullsized":"2024-03-07T10:21:39.571197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610726+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:39.610726+0000","last_peered":"2024-03-07T10:21:39.610726+0000","last_clean":"2024-03-07T10:21:39.610726+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:39.610726+0000","last_undegraded":"2024-03-07T10:21:39.610726+0000","last_fullsized":"2024-03-07T10:21:39.610726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616041+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:21:39.616041+0000","last_peered":"2024-03-07T10:21:39.616041+0000","last_clean":"2024-03-07T10:21:39.616041+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:21:39.616041+0000","last_undegraded":"2024-03-07T10:21:39.616041+0000","last_fullsized":"2024-03-07T10:21:39.616041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576546+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:39.576546+0000","last_peered":"2024-03-07T10:21:39.576546+0000","last_clean":"2024-03-07T10:21:39.576546+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:39.576546+0000","last_undegraded":"2024-03-07T10:21:39.576546+0000","last_fullsized":"2024-03-07T10:21:39.576546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571166+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:39.571166+0000","last_peered":"2024-03-07T10:21:39.571166+0000","last_clean":"2024-03-07T10:21:39.571166+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:39.571166+0000","last_undegraded":"2024-03-07T10:21:39.571166+0000","last_fullsized":"2024-03-07T10:21:39.571166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576299+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:39.576299+0000","last_peered":"2024-03-07T10:21:39.576299+0000","last_clean":"2024-03-07T10:21:39.576299+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:39.576299+0000","last_undegraded":"2024-03-07T10:21:39.576299+0000","last_fullsized":"2024-03-07T10:21:39.576299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614648+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:39.614648+0000","last_peered":"2024-03-07T10:21:39.614648+0000","last_clean":"2024-03-07T10:21:39.614648+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:39.614648+0000","last_undegraded":"2024-03-07T10:21:39.614648+0000","last_fullsized":"2024-03-07T10:21:39.614648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575260+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:39.575260+0000","last_peered":"2024-03-07T10:21:39.575260+0000","last_clean":"2024-03-07T10:21:39.575260+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:39.575260+0000","last_undegraded":"2024-03-07T10:21:39.575260+0000","last_fullsized":"2024-03-07T10:21:39.575260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576970+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:39.576970+0000","last_peered":"2024-03-07T10:21:39.576970+0000","last_clean":"2024-03-07T10:21:39.576970+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:39.576970+0000","last_undegraded":"2024-03-07T10:21:39.576970+0000","last_fullsized":"2024-03-07T10:21:39.576970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614505+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:39.614505+0000","last_peered":"2024-03-07T10:21:39.614505+0000","last_clean":"2024-03-07T10:21:39.614505+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:39.614505+0000","last_undegraded":"2024-03-07T10:21:39.614505+0000","last_fullsized":"2024-03-07T10:21:39.614505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576394+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:39.576394+0000","last_peered":"2024-03-07T10:21:39.576394+0000","last_clean":"2024-03-07T10:21:39.576394+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:39.576394+0000","last_undegraded":"2024-03-07T10:21:39.576394+0000","last_fullsized":"2024-03-07T10:21:39.576394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571501+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:39.571501+0000","last_peered":"2024-03-07T10:21:39.571501+0000","last_clean":"2024-03-07T10:21:39.571501+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:39.571501+0000","last_undegraded":"2024-03-07T10:21:39.571501+0000","last_fullsized":"2024-03-07T10:21:39.571501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571465+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:39.571465+0000","last_peered":"2024-03-07T10:21:39.571465+0000","last_clean":"2024-03-07T10:21:39.571465+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:39.571465+0000","last_undegraded":"2024-03-07T10:21:39.571465+0000","last_fullsized":"2024-03-07T10:21:39.571465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574997+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:39.574997+0000","last_peered":"2024-03-07T10:21:39.574997+0000","last_clean":"2024-03-07T10:21:39.574997+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:39.574997+0000","last_undegraded":"2024-03-07T10:21:39.574997+0000","last_fullsized":"2024-03-07T10:21:39.574997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576018+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:39.576018+0000","last_peered":"2024-03-07T10:21:39.576018+0000","last_clean":"2024-03-07T10:21:39.576018+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:39.576018+0000","last_undegraded":"2024-03-07T10:21:39.576018+0000","last_fullsized":"2024-03-07T10:21:39.576018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613381+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:39.613381+0000","last_peered":"2024-03-07T10:21:39.613381+0000","last_clean":"2024-03-07T10:21:39.613381+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:39.613381+0000","last_undegraded":"2024-03-07T10:21:39.613381+0000","last_fullsized":"2024-03-07T10:21:39.613381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580254+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:39.580254+0000","last_peered":"2024-03-07T10:21:39.580254+0000","last_clean":"2024-03-07T10:21:39.580254+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:39.580254+0000","last_undegraded":"2024-03-07T10:21:39.580254+0000","last_fullsized":"2024-03-07T10:21:39.580254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576755+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:39.576755+0000","last_peered":"2024-03-07T10:21:39.576755+0000","last_clean":"2024-03-07T10:21:39.576755+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:39.576755+0000","last_undegraded":"2024-03-07T10:21:39.576755+0000","last_fullsized":"2024-03-07T10:21:39.576755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572585+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:39.572585+0000","last_peered":"2024-03-07T10:21:39.572585+0000","last_clean":"2024-03-07T10:21:39.572585+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:39.572585+0000","last_undegraded":"2024-03-07T10:21:39.572585+0000","last_fullsized":"2024-03-07T10:21:39.572585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573281+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:39.573281+0000","last_peered":"2024-03-07T10:21:39.573281+0000","last_clean":"2024-03-07T10:21:39.573281+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:39.573281+0000","last_undegraded":"2024-03-07T10:21:39.573281+0000","last_fullsized":"2024-03-07T10:21:39.573281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572783+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:39.572783+0000","last_peered":"2024-03-07T10:21:39.572783+0000","last_clean":"2024-03-07T10:21:39.572783+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:39.572783+0000","last_undegraded":"2024-03-07T10:21:39.572783+0000","last_fullsized":"2024-03-07T10:21:39.572783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572715+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:39.572715+0000","last_peered":"2024-03-07T10:21:39.572715+0000","last_clean":"2024-03-07T10:21:39.572715+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:39.572715+0000","last_undegraded":"2024-03-07T10:21:39.572715+0000","last_fullsized":"2024-03-07T10:21:39.572715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574256+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:39.574256+0000","last_peered":"2024-03-07T10:21:39.574256+0000","last_clean":"2024-03-07T10:21:39.574256+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:39.574256+0000","last_undegraded":"2024-03-07T10:21:39.574256+0000","last_fullsized":"2024-03-07T10:21:39.574256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576077+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:39.576077+0000","last_peered":"2024-03-07T10:21:39.576077+0000","last_clean":"2024-03-07T10:21:39.576077+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:39.576077+0000","last_undegraded":"2024-03-07T10:21:39.576077+0000","last_fullsized":"2024-03-07T10:21:39.576077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578533+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:39.578533+0000","last_peered":"2024-03-07T10:21:39.578533+0000","last_clean":"2024-03-07T10:21:39.578533+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:39.578533+0000","last_undegraded":"2024-03-07T10:21:39.578533+0000","last_fullsized":"2024-03-07T10:21:39.578533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573778+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:39.573778+0000","last_peered":"2024-03-07T10:21:39.573778+0000","last_clean":"2024-03-07T10:21:39.573778+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:39.573778+0000","last_undegraded":"2024-03-07T10:21:39.573778+0000","last_fullsized":"2024-03-07T10:21:39.573778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574159+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:39.574159+0000","last_peered":"2024-03-07T10:21:39.574159+0000","last_clean":"2024-03-07T10:21:39.574159+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:39.574159+0000","last_undegraded":"2024-03-07T10:21:39.574159+0000","last_fullsized":"2024-03-07T10:21:39.574159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574815+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:39.574815+0000","last_peered":"2024-03-07T10:21:39.574815+0000","last_clean":"2024-03-07T10:21:39.574815+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:39.574815+0000","last_undegraded":"2024-03-07T10:21:39.574815+0000","last_fullsized":"2024-03-07T10:21:39.574815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613299+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:39.613299+0000","last_peered":"2024-03-07T10:21:39.613299+0000","last_clean":"2024-03-07T10:21:39.613299+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:39.613299+0000","last_undegraded":"2024-03-07T10:21:39.613299+0000","last_fullsized":"2024-03-07T10:21:39.613299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611177+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:39.611177+0000","last_peered":"2024-03-07T10:21:39.611177+0000","last_clean":"2024-03-07T10:21:39.611177+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:39.611177+0000","last_undegraded":"2024-03-07T10:21:39.611177+0000","last_fullsized":"2024-03-07T10:21:39.611177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572411+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:39.572411+0000","last_peered":"2024-03-07T10:21:39.572411+0000","last_clean":"2024-03-07T10:21:39.572411+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:39.572411+0000","last_undegraded":"2024-03-07T10:21:39.572411+0000","last_fullsized":"2024-03-07T10:21:39.572411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573655+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:39.573655+0000","last_peered":"2024-03-07T10:21:39.573655+0000","last_clean":"2024-03-07T10:21:39.573655+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:39.573655+0000","last_undegraded":"2024-03-07T10:21:39.573655+0000","last_fullsized":"2024-03-07T10:21:39.573655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575828+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:39.575828+0000","last_peered":"2024-03-07T10:21:39.575828+0000","last_clean":"2024-03-07T10:21:39.575828+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:39.575828+0000","last_undegraded":"2024-03-07T10:21:39.575828+0000","last_fullsized":"2024-03-07T10:21:39.575828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610617+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:39.610617+0000","last_peered":"2024-03-07T10:21:39.610617+0000","last_clean":"2024-03-07T10:21:39.610617+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:39.610617+0000","last_undegraded":"2024-03-07T10:21:39.610617+0000","last_fullsized":"2024-03-07T10:21:39.610617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575953+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:39.575953+0000","last_peered":"2024-03-07T10:21:39.575953+0000","last_clean":"2024-03-07T10:21:39.575953+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:39.575953+0000","last_undegraded":"2024-03-07T10:21:39.575953+0000","last_fullsized":"2024-03-07T10:21:39.575953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575170+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:39.575170+0000","last_peered":"2024-03-07T10:21:39.575170+0000","last_clean":"2024-03-07T10:21:39.575170+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:39.575170+0000","last_undegraded":"2024-03-07T10:21:39.575170+0000","last_fullsized":"2024-03-07T10:21:39.575170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572154+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:39.572154+0000","last_peered":"2024-03-07T10:21:39.572154+0000","last_clean":"2024-03-07T10:21:39.572154+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:39.572154+0000","last_undegraded":"2024-03-07T10:21:39.572154+0000","last_fullsized":"2024-03-07T10:21:39.572154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572594+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:39.572594+0000","last_peered":"2024-03-07T10:21:39.572594+0000","last_clean":"2024-03-07T10:21:39.572594+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:39.572594+0000","last_undegraded":"2024-03-07T10:21:39.572594+0000","last_fullsized":"2024-03-07T10:21:39.572594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.581098+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:21:39.581098+0000","last_peered":"2024-03-07T10:21:39.581098+0000","last_clean":"2024-03-07T10:21:39.581098+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:21:39.581098+0000","last_undegraded":"2024-03-07T10:21:39.581098+0000","last_fullsized":"2024-03-07T10:21:39.581098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612166+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:39.612166+0000","last_peered":"2024-03-07T10:21:39.612166+0000","last_clean":"2024-03-07T10:21:39.612166+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:39.612166+0000","last_undegraded":"2024-03-07T10:21:39.612166+0000","last_fullsized":"2024-03-07T10:21:39.612166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571457+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:39.571457+0000","last_peered":"2024-03-07T10:21:39.571457+0000","last_clean":"2024-03-07T10:21:39.571457+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:39.571457+0000","last_undegraded":"2024-03-07T10:21:39.571457+0000","last_fullsized":"2024-03-07T10:21:39.571457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580192+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:39.580192+0000","last_peered":"2024-03-07T10:21:39.580192+0000","last_clean":"2024-03-07T10:21:39.580192+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:39.580192+0000","last_undegraded":"2024-03-07T10:21:39.580192+0000","last_fullsized":"2024-03-07T10:21:39.580192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616116+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:21:39.616116+0000","last_peered":"2024-03-07T10:21:39.616116+0000","last_clean":"2024-03-07T10:21:39.616116+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:21:39.616116+0000","last_undegraded":"2024-03-07T10:21:39.616116+0000","last_fullsized":"2024-03-07T10:21:39.616116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572662+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:39.572662+0000","last_peered":"2024-03-07T10:21:39.572662+0000","last_clean":"2024-03-07T10:21:39.572662+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:39.572662+0000","last_undegraded":"2024-03-07T10:21:39.572662+0000","last_fullsized":"2024-03-07T10:21:39.572662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612992+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:39.612992+0000","last_peered":"2024-03-07T10:21:39.612992+0000","last_clean":"2024-03-07T10:21:39.612992+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:39.612992+0000","last_undegraded":"2024-03-07T10:21:39.612992+0000","last_fullsized":"2024-03-07T10:21:39.612992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572873+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:39.572873+0000","last_peered":"2024-03-07T10:21:39.572873+0000","last_clean":"2024-03-07T10:21:39.572873+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:39.572873+0000","last_undegraded":"2024-03-07T10:21:39.572873+0000","last_fullsized":"2024-03-07T10:21:39.572873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575382+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:39.575382+0000","last_peered":"2024-03-07T10:21:39.575382+0000","last_clean":"2024-03-07T10:21:39.575382+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:39.575382+0000","last_undegraded":"2024-03-07T10:21:39.575382+0000","last_fullsized":"2024-03-07T10:21:39.575382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572685+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:39.572685+0000","last_peered":"2024-03-07T10:21:39.572685+0000","last_clean":"2024-03-07T10:21:39.572685+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:39.572685+0000","last_undegraded":"2024-03-07T10:21:39.572685+0000","last_fullsized":"2024-03-07T10:21:39.572685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611992+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:39.611992+0000","last_peered":"2024-03-07T10:21:39.611992+0000","last_clean":"2024-03-07T10:21:39.611992+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:39.611992+0000","last_undegraded":"2024-03-07T10:21:39.611992+0000","last_fullsized":"2024-03-07T10:21:39.611992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575817+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:39.575817+0000","last_peered":"2024-03-07T10:21:39.575817+0000","last_clean":"2024-03-07T10:21:39.575817+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:39.575817+0000","last_undegraded":"2024-03-07T10:21:39.575817+0000","last_fullsized":"2024-03-07T10:21:39.575817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580791+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:39.580791+0000","last_peered":"2024-03-07T10:21:39.580791+0000","last_clean":"2024-03-07T10:21:39.580791+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:39.580791+0000","last_undegraded":"2024-03-07T10:21:39.580791+0000","last_fullsized":"2024-03-07T10:21:39.580791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.617133+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:21:39.617133+0000","last_peered":"2024-03-07T10:21:39.617133+0000","last_clean":"2024-03-07T10:21:39.617133+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:21:39.617133+0000","last_undegraded":"2024-03-07T10:21:39.617133+0000","last_fullsized":"2024-03-07T10:21:39.617133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576751+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:39.576751+0000","last_peered":"2024-03-07T10:21:39.576751+0000","last_clean":"2024-03-07T10:21:39.576751+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:39.576751+0000","last_undegraded":"2024-03-07T10:21:39.576751+0000","last_fullsized":"2024-03-07T10:21:39.576751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576854+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:39.576854+0000","last_peered":"2024-03-07T10:21:39.576854+0000","last_clean":"2024-03-07T10:21:39.576854+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:39.576854+0000","last_undegraded":"2024-03-07T10:21:39.576854+0000","last_fullsized":"2024-03-07T10:21:39.576854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574123+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:39.574123+0000","last_peered":"2024-03-07T10:21:39.574123+0000","last_clean":"2024-03-07T10:21:39.574123+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:39.574123+0000","last_undegraded":"2024-03-07T10:21:39.574123+0000","last_fullsized":"2024-03-07T10:21:39.574123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575393+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:39.575393+0000","last_peered":"2024-03-07T10:21:39.575393+0000","last_clean":"2024-03-07T10:21:39.575393+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:39.575393+0000","last_undegraded":"2024-03-07T10:21:39.575393+0000","last_fullsized":"2024-03-07T10:21:39.575393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573663+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:39.573663+0000","last_peered":"2024-03-07T10:21:39.573663+0000","last_clean":"2024-03-07T10:21:39.573663+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:39.573663+0000","last_undegraded":"2024-03-07T10:21:39.573663+0000","last_fullsized":"2024-03-07T10:21:39.573663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612410+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:39.612410+0000","last_peered":"2024-03-07T10:21:39.612410+0000","last_clean":"2024-03-07T10:21:39.612410+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:39.612410+0000","last_undegraded":"2024-03-07T10:21:39.612410+0000","last_fullsized":"2024-03-07T10:21:39.612410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611804+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:39.611804+0000","last_peered":"2024-03-07T10:21:39.611804+0000","last_clean":"2024-03-07T10:21:39.611804+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:39.611804+0000","last_undegraded":"2024-03-07T10:21:39.611804+0000","last_fullsized":"2024-03-07T10:21:39.611804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572336+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:39.572336+0000","last_peered":"2024-03-07T10:21:39.572336+0000","last_clean":"2024-03-07T10:21:39.572336+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:39.572336+0000","last_undegraded":"2024-03-07T10:21:39.572336+0000","last_fullsized":"2024-03-07T10:21:39.572336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571766+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:39.571766+0000","last_peered":"2024-03-07T10:21:39.571766+0000","last_clean":"2024-03-07T10:21:39.571766+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:39.571766+0000","last_undegraded":"2024-03-07T10:21:39.571766+0000","last_fullsized":"2024-03-07T10:21:39.571766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576561+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:39.576561+0000","last_peered":"2024-03-07T10:21:39.576561+0000","last_clean":"2024-03-07T10:21:39.576561+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:39.576561+0000","last_undegraded":"2024-03-07T10:21:39.576561+0000","last_fullsized":"2024-03-07T10:21:39.576561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579274+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:39.579274+0000","last_peered":"2024-03-07T10:21:39.579274+0000","last_clean":"2024-03-07T10:21:39.579274+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:39.579274+0000","last_undegraded":"2024-03-07T10:21:39.579274+0000","last_fullsized":"2024-03-07T10:21:39.579274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575484+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:39.575484+0000","last_peered":"2024-03-07T10:21:39.575484+0000","last_clean":"2024-03-07T10:21:39.575484+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:39.575484+0000","last_undegraded":"2024-03-07T10:21:39.575484+0000","last_fullsized":"2024-03-07T10:21:39.575484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610952+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:39.610952+0000","last_peered":"2024-03-07T10:21:39.610952+0000","last_clean":"2024-03-07T10:21:39.610952+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:39.610952+0000","last_undegraded":"2024-03-07T10:21:39.610952+0000","last_fullsized":"2024-03-07T10:21:39.610952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575848+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:39.575848+0000","last_peered":"2024-03-07T10:21:39.575848+0000","last_clean":"2024-03-07T10:21:39.575848+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:39.575848+0000","last_undegraded":"2024-03-07T10:21:39.575848+0000","last_fullsized":"2024-03-07T10:21:39.575848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573421+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:39.573421+0000","last_peered":"2024-03-07T10:21:39.573421+0000","last_clean":"2024-03-07T10:21:39.573421+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:39.573421+0000","last_undegraded":"2024-03-07T10:21:39.573421+0000","last_fullsized":"2024-03-07T10:21:39.573421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612333+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:39.612333+0000","last_peered":"2024-03-07T10:21:39.612333+0000","last_clean":"2024-03-07T10:21:39.612333+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:39.612333+0000","last_undegraded":"2024-03-07T10:21:39.612333+0000","last_fullsized":"2024-03-07T10:21:39.612333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572442+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:39.572442+0000","last_peered":"2024-03-07T10:21:39.572442+0000","last_clean":"2024-03-07T10:21:39.572442+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:39.572442+0000","last_undegraded":"2024-03-07T10:21:39.572442+0000","last_fullsized":"2024-03-07T10:21:39.572442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571355+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:39.571355+0000","last_peered":"2024-03-07T10:21:39.571355+0000","last_clean":"2024-03-07T10:21:39.571355+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:39.571355+0000","last_undegraded":"2024-03-07T10:21:39.571355+0000","last_fullsized":"2024-03-07T10:21:39.571355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576195+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:39.576195+0000","last_peered":"2024-03-07T10:21:39.576195+0000","last_clean":"2024-03-07T10:21:39.576195+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:39.576195+0000","last_undegraded":"2024-03-07T10:21:39.576195+0000","last_fullsized":"2024-03-07T10:21:39.576195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611057+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:39.611057+0000","last_peered":"2024-03-07T10:21:39.611057+0000","last_clean":"2024-03-07T10:21:39.611057+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:39.611057+0000","last_undegraded":"2024-03-07T10:21:39.611057+0000","last_fullsized":"2024-03-07T10:21:39.611057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574324+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:39.574324+0000","last_peered":"2024-03-07T10:21:39.574324+0000","last_clean":"2024-03-07T10:21:39.574324+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:39.574324+0000","last_undegraded":"2024-03-07T10:21:39.574324+0000","last_fullsized":"2024-03-07T10:21:39.574324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573830+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:39.573830+0000","last_peered":"2024-03-07T10:21:39.573830+0000","last_clean":"2024-03-07T10:21:39.573830+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:39.573830+0000","last_undegraded":"2024-03-07T10:21:39.573830+0000","last_fullsized":"2024-03-07T10:21:39.573830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573913+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:39.573913+0000","last_peered":"2024-03-07T10:21:39.573913+0000","last_clean":"2024-03-07T10:21:39.573913+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:39.573913+0000","last_undegraded":"2024-03-07T10:21:39.573913+0000","last_fullsized":"2024-03-07T10:21:39.573913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611500+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:39.611500+0000","last_peered":"2024-03-07T10:21:39.611500+0000","last_clean":"2024-03-07T10:21:39.611500+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:39.611500+0000","last_undegraded":"2024-03-07T10:21:39.611500+0000","last_fullsized":"2024-03-07T10:21:39.611500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571439+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:39.571439+0000","last_peered":"2024-03-07T10:21:39.571439+0000","last_clean":"2024-03-07T10:21:39.571439+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:39.571439+0000","last_undegraded":"2024-03-07T10:21:39.571439+0000","last_fullsized":"2024-03-07T10:21:39.571439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573967+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:39.573967+0000","last_peered":"2024-03-07T10:21:39.573967+0000","last_clean":"2024-03-07T10:21:39.573967+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:39.573967+0000","last_undegraded":"2024-03-07T10:21:39.573967+0000","last_fullsized":"2024-03-07T10:21:39.573967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579010+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:39.579010+0000","last_peered":"2024-03-07T10:21:39.579010+0000","last_clean":"2024-03-07T10:21:39.579010+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:39.579010+0000","last_undegraded":"2024-03-07T10:21:39.579010+0000","last_fullsized":"2024-03-07T10:21:39.579010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614561+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:39.614561+0000","last_peered":"2024-03-07T10:21:39.614561+0000","last_clean":"2024-03-07T10:21:39.614561+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:39.614561+0000","last_undegraded":"2024-03-07T10:21:39.614561+0000","last_fullsized":"2024-03-07T10:21:39.614561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610599+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:39.610599+0000","last_peered":"2024-03-07T10:21:39.610599+0000","last_clean":"2024-03-07T10:21:39.610599+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:39.610599+0000","last_undegraded":"2024-03-07T10:21:39.610599+0000","last_fullsized":"2024-03-07T10:21:39.610599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577099+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:39.577099+0000","last_peered":"2024-03-07T10:21:39.577099+0000","last_clean":"2024-03-07T10:21:39.577099+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:39.577099+0000","last_undegraded":"2024-03-07T10:21:39.577099+0000","last_fullsized":"2024-03-07T10:21:39.577099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610840+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:39.610840+0000","last_peered":"2024-03-07T10:21:39.610840+0000","last_clean":"2024-03-07T10:21:39.610840+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:39.610840+0000","last_undegraded":"2024-03-07T10:21:39.610840+0000","last_fullsized":"2024-03-07T10:21:39.610840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612287+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:39.612287+0000","last_peered":"2024-03-07T10:21:39.612287+0000","last_clean":"2024-03-07T10:21:39.612287+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:39.612287+0000","last_undegraded":"2024-03-07T10:21:39.612287+0000","last_fullsized":"2024-03-07T10:21:39.612287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":118811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:49.853 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-03-07T10:21:49.854 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:21:50.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.095+0000 7f38bfe00640 1 Processor -- start 2024-03-07T10:21:50.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.095+0000 7f38bfe00640 1 -- start start 2024-03-07T10:21:50.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b80a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f38b8156c20 0x7f38b806d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bfe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38b8153980 con 0x7f38b80a9a10 2024-03-07T10:21:50.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bfe00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38b806e550 con 0x7f38b8156c20 2024-03-07T10:21:50.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8153c60 con 0x7f38b8150b70 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.096+0000 7f38bde00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f38b80a9a10 0x7f38b806de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42110/0 (socket says 172.21.15.194:42110) 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bde00640 1 -- 172.21.15.194:0/3967180914 learned_addr learned my addr 172.21.15.194:0/3967180914 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bd400640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b80a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bca00640 1 --2- 172.21.15.194:0/3967180914 >> v2:172.21.15.196:3300/0 conn(0x7f38b8156c20 0x7f38b806d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328039490 0 0) 0x7f38b8153980 con 0x7f38b80a9a10 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38a0003520 con 0x7f38b80a9a10 2024-03-07T10:21:50.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bca00640 1 -- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 msgr2=0x7f38b80a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:50.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bca00640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b80a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1001423482 0 0) 0x7f38a0003520 con 0x7f38b80a9a10 2024-03-07T10:21:50.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bca00640 1 -- 172.21.15.194:0/3967180914 >> v1:172.21.15.194:6789/0 conn(0x7f38b80a9a10 legacy=0x7f38b806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bca00640 1 -- 172.21.15.194:0/3967180914 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8153f40 con 0x7f38b8156c20 2024-03-07T10:21:50.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.097+0000 7f38bd400640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b80a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:21:50.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.098+0000 7f38bca00640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b8156c20 0x7f38b806d900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38a40097a0 tx=0x7f38a402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef0527c4bb0f23f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.099+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a4037070 con 0x7f38b8156c20 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.099+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4030510 con 0x7f38b8156c20 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.099+0000 7f38b7e00640 1 -- 172.21.15.194:0/3967180914 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0001670 con 0x7f38b8156c20 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.099+0000 7f38bfe00640 1 -- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b8156c20 msgr2=0x7f38b806d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.099+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b8156c20 0x7f38b806d900 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f38a40097a0 tx=0x7f38a402b710 comp rx=0 tx=0).stop 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 -- 172.21.15.194:0/3967180914 shutdown_connections 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b8156c20 0x7f38b806d900 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3967180914 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b80a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 -- 172.21.15.194:0/3967180914 >> 172.21.15.194:0/3967180914 conn(0x7f38b806b840 msgr2=0x7f38b80c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 -- 172.21.15.194:0/3967180914 shutdown_connections 2024-03-07T10:21:50.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.100+0000 7f38bfe00640 1 -- 172.21.15.194:0/3967180914 wait complete. 2024-03-07T10:21:50.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.101+0000 7f38bfe00640 1 Processor -- start 2024-03-07T10:21:50.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 -- start start 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b80a9a10 0x7f38b814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b81ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b8153630 con 0x7f38b8156c20 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80c7a30 con 0x7f38b80a9a10 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.102+0000 7f38bfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38b80ac460 con 0x7f38b8150b70 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42318/0 (socket says 172.21.15.194:42318) 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 -- 172.21.15.194:0/3043623993 learned_addr learned my addr 172.21.15.194:0/3043623993 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:50.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bd400640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b80a9a10 0x7f38b814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bca00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b81ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 -- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 msgr2=0x7f38b81ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b81ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 -- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b80a9a10 msgr2=0x7f38b814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b80a9a10 0x7f38b814e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.103+0000 7f38bde00640 1 -- 172.21.15.194:0/3043623993 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8072520 con 0x7f38b8156c20 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38bde00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c6d0 tx=0x7f38b000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0005ad0 con 0x7f38b8156c20 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38b0005c70 con 0x7f38b8156c20 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b0007270 con 0x7f38b8156c20 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38b80c6ad0 con 0x7f38b8156c20 2024-03-07T10:21:50.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.104+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38b8072240 con 0x7f38b8156c20 2024-03-07T10:21:50.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.105+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b8068170 con 0x7f38b8156c20 2024-03-07T10:21:50.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.107+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f38b0007410 con 0x7f38b8156c20 2024-03-07T10:21:50.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.108+0000 7f38b5600640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 0x7f389806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.108+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f38b008a270 con 0x7f38b8156c20 2024-03-07T10:21:50.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.109+0000 7f38bd400640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 0x7f389806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.109+0000 7f38bd400640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 0x7f389806d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009bd0 tx=0x7f38ac00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.113+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f38b0058d40 con 0x7f38b8156c20 2024-03-07T10:21:50.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.305+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38b81ee560 con 0x7f389806b4d0 2024-03-07T10:21:50.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.340+0000 7f38b5600640 1 -- 172.21.15.194:0/3043623993 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490337 (secure 0 0 0) 0x7f38ac017440 con 0x7f389806b4d0 2024-03-07T10:21:50.349 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:50.352 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 msgr2=0x7f389806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 0x7f389806d990 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009bd0 tx=0x7f38ac00b040 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 msgr2=0x7f38b81eed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f38b000c6d0 tx=0x7f38b000cb90 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 shutdown_connections 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f389806b4d0 0x7f389806d990 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38b8156c20 0x7f38b81eed80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f38b8150b70 0x7f38b81ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 --2- 172.21.15.194:0/3043623993 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f38b80a9a10 0x7f38b814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.349+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 >> 172.21.15.194:0/3043623993 conn(0x7f38b806b840 msgr2=0x7f38b80c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.350+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 shutdown_connections 2024-03-07T10:21:50.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.350+0000 7f38bfe00640 1 -- 172.21.15.194:0/3043623993 wait complete. 2024-03-07T10:21:50.368 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-03-07T10:21:48.431203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597678,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":255,"num_write_kb":2450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219640,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755080,"statfs":{"total":773094113280,"available":772869201920,"internally_reserved":0,"allocated":3547136,"data_stored":2099956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2490,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.872979"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572163+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:21:39.572163+0000","last_peered":"2024-03-07T10:21:39.572163+0000","last_clean":"2024-03-07T10:21:39.572163+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:21:39.572163+0000","last_undegraded":"2024-03-07T10:21:39.572163+0000","last_fullsized":"2024-03-07T10:21:39.572163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614708+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:21:39.614708+0000","last_peered":"2024-03-07T10:21:39.614708+0000","last_clean":"2024-03-07T10:21:39.614708+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:21:39.614708+0000","last_undegraded":"2024-03-07T10:21:39.614708+0000","last_fullsized":"2024-03-07T10:21:39.614708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573086+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:21:39.573086+0000","last_peered":"2024-03-07T10:21:39.573086+0000","last_clean":"2024-03-07T10:21:39.573086+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:21:39.573086+0000","last_undegraded":"2024-03-07T10:21:39.573086+0000","last_fullsized":"2024-03-07T10:21:39.573086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571310+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:21:39.571310+0000","last_peered":"2024-03-07T10:21:39.571310+0000","last_clean":"2024-03-07T10:21:39.571310+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:21:39.571310+0000","last_undegraded":"2024-03-07T10:21:39.571310+0000","last_fullsized":"2024-03-07T10:21:39.571310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574108+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:21:39.574108+0000","last_peered":"2024-03-07T10:21:39.574108+0000","last_clean":"2024-03-07T10:21:39.574108+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:21:39.574108+0000","last_undegraded":"2024-03-07T10:21:39.574108+0000","last_fullsized":"2024-03-07T10:21:39.574108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573209+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:21:39.573209+0000","last_peered":"2024-03-07T10:21:39.573209+0000","last_clean":"2024-03-07T10:21:39.573209+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:21:39.573209+0000","last_undegraded":"2024-03-07T10:21:39.573209+0000","last_fullsized":"2024-03-07T10:21:39.573209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614635+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:21:39.614635+0000","last_peered":"2024-03-07T10:21:39.614635+0000","last_clean":"2024-03-07T10:21:39.614635+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:21:39.614635+0000","last_undegraded":"2024-03-07T10:21:39.614635+0000","last_fullsized":"2024-03-07T10:21:39.614635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572283+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:21:39.572283+0000","last_peered":"2024-03-07T10:21:39.572283+0000","last_clean":"2024-03-07T10:21:39.572283+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:21:39.572283+0000","last_undegraded":"2024-03-07T10:21:39.572283+0000","last_fullsized":"2024-03-07T10:21:39.572283+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611309+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:21:39.611309+0000","last_peered":"2024-03-07T10:21:39.611309+0000","last_clean":"2024-03-07T10:21:39.611309+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:21:39.611309+0000","last_undegraded":"2024-03-07T10:21:39.611309+0000","last_fullsized":"2024-03-07T10:21:39.611309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611948+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:21:39.611948+0000","last_peered":"2024-03-07T10:21:39.611948+0000","last_clean":"2024-03-07T10:21:39.611948+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:21:39.611948+0000","last_undegraded":"2024-03-07T10:21:39.611948+0000","last_fullsized":"2024-03-07T10:21:39.611948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574692+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:21:39.574692+0000","last_peered":"2024-03-07T10:21:39.574692+0000","last_clean":"2024-03-07T10:21:39.574692+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:21:39.574692+0000","last_undegraded":"2024-03-07T10:21:39.574692+0000","last_fullsized":"2024-03-07T10:21:39.574692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574004+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:21:39.574004+0000","last_peered":"2024-03-07T10:21:39.574004+0000","last_clean":"2024-03-07T10:21:39.574004+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:21:39.574004+0000","last_undegraded":"2024-03-07T10:21:39.574004+0000","last_fullsized":"2024-03-07T10:21:39.574004+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611614+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:21:39.611614+0000","last_peered":"2024-03-07T10:21:39.611614+0000","last_clean":"2024-03-07T10:21:39.611614+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:21:39.611614+0000","last_undegraded":"2024-03-07T10:21:39.611614+0000","last_fullsized":"2024-03-07T10:21:39.611614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574277+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:21:39.574277+0000","last_peered":"2024-03-07T10:21:39.574277+0000","last_clean":"2024-03-07T10:21:39.574277+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:21:39.574277+0000","last_undegraded":"2024-03-07T10:21:39.574277+0000","last_fullsized":"2024-03-07T10:21:39.574277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573022+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:21:39.573022+0000","last_peered":"2024-03-07T10:21:39.573022+0000","last_clean":"2024-03-07T10:21:39.573022+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:21:39.573022+0000","last_undegraded":"2024-03-07T10:21:39.573022+0000","last_fullsized":"2024-03-07T10:21:39.573022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574485+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:21:39.574485+0000","last_peered":"2024-03-07T10:21:39.574485+0000","last_clean":"2024-03-07T10:21:39.574485+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:21:39.574485+0000","last_undegraded":"2024-03-07T10:21:39.574485+0000","last_fullsized":"2024-03-07T10:21:39.574485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575914+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:21:39.575914+0000","last_peered":"2024-03-07T10:21:39.575914+0000","last_clean":"2024-03-07T10:21:39.575914+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:21:39.575914+0000","last_undegraded":"2024-03-07T10:21:39.575914+0000","last_fullsized":"2024-03-07T10:21:39.575914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611660+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:21:39.611660+0000","last_peered":"2024-03-07T10:21:39.611660+0000","last_clean":"2024-03-07T10:21:39.611660+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:21:39.611660+0000","last_undegraded":"2024-03-07T10:21:39.611660+0000","last_fullsized":"2024-03-07T10:21:39.611660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576434+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:21:39.576434+0000","last_peered":"2024-03-07T10:21:39.576434+0000","last_clean":"2024-03-07T10:21:39.576434+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:21:39.576434+0000","last_undegraded":"2024-03-07T10:21:39.576434+0000","last_fullsized":"2024-03-07T10:21:39.576434+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580492+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:21:39.580492+0000","last_peered":"2024-03-07T10:21:39.580492+0000","last_clean":"2024-03-07T10:21:39.580492+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:21:39.580492+0000","last_undegraded":"2024-03-07T10:21:39.580492+0000","last_fullsized":"2024-03-07T10:21:39.580492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572376+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:21:39.572376+0000","last_peered":"2024-03-07T10:21:39.572376+0000","last_clean":"2024-03-07T10:21:39.572376+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:21:39.572376+0000","last_undegraded":"2024-03-07T10:21:39.572376+0000","last_fullsized":"2024-03-07T10:21:39.572376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575014+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:21:39.575014+0000","last_peered":"2024-03-07T10:21:39.575014+0000","last_clean":"2024-03-07T10:21:39.575014+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:21:39.575014+0000","last_undegraded":"2024-03-07T10:21:39.575014+0000","last_fullsized":"2024-03-07T10:21:39.575014+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576311+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:21:39.576311+0000","last_peered":"2024-03-07T10:21:39.576311+0000","last_clean":"2024-03-07T10:21:39.576311+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:21:39.576311+0000","last_undegraded":"2024-03-07T10:21:39.576311+0000","last_fullsized":"2024-03-07T10:21:39.576311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574002+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:21:39.574002+0000","last_peered":"2024-03-07T10:21:39.574002+0000","last_clean":"2024-03-07T10:21:39.574002+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:21:39.574002+0000","last_undegraded":"2024-03-07T10:21:39.574002+0000","last_fullsized":"2024-03-07T10:21:39.574002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571534+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:21:39.571534+0000","last_peered":"2024-03-07T10:21:39.571534+0000","last_clean":"2024-03-07T10:21:39.571534+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:21:39.571534+0000","last_undegraded":"2024-03-07T10:21:39.571534+0000","last_fullsized":"2024-03-07T10:21:39.571534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575556+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:21:39.575556+0000","last_peered":"2024-03-07T10:21:39.575556+0000","last_clean":"2024-03-07T10:21:39.575556+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:21:39.575556+0000","last_undegraded":"2024-03-07T10:21:39.575556+0000","last_fullsized":"2024-03-07T10:21:39.575556+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576157+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:21:39.576157+0000","last_peered":"2024-03-07T10:21:39.576157+0000","last_clean":"2024-03-07T10:21:39.576157+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:21:39.576157+0000","last_undegraded":"2024-03-07T10:21:39.576157+0000","last_fullsized":"2024-03-07T10:21:39.576157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574801+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:21:39.574801+0000","last_peered":"2024-03-07T10:21:39.574801+0000","last_clean":"2024-03-07T10:21:39.574801+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:21:39.574801+0000","last_undegraded":"2024-03-07T10:21:39.574801+0000","last_fullsized":"2024-03-07T10:21:39.574801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573009+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:21:39.573009+0000","last_peered":"2024-03-07T10:21:39.573009+0000","last_clean":"2024-03-07T10:21:39.573009+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:21:39.573009+0000","last_undegraded":"2024-03-07T10:21:39.573009+0000","last_fullsized":"2024-03-07T10:21:39.573009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610860+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:21:39.610860+0000","last_peered":"2024-03-07T10:21:39.610860+0000","last_clean":"2024-03-07T10:21:39.610860+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:21:39.610860+0000","last_undegraded":"2024-03-07T10:21:39.610860+0000","last_fullsized":"2024-03-07T10:21:39.610860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574147+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:21:39.574147+0000","last_peered":"2024-03-07T10:21:39.574147+0000","last_clean":"2024-03-07T10:21:39.574147+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:21:39.574147+0000","last_undegraded":"2024-03-07T10:21:39.574147+0000","last_fullsized":"2024-03-07T10:21:39.574147+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571032+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:21:39.571032+0000","last_peered":"2024-03-07T10:21:39.571032+0000","last_clean":"2024-03-07T10:21:39.571032+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:21:39.571032+0000","last_undegraded":"2024-03-07T10:21:39.571032+0000","last_fullsized":"2024-03-07T10:21:39.571032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614870+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:21:39.614870+0000","last_peered":"2024-03-07T10:21:39.614870+0000","last_clean":"2024-03-07T10:21:39.614870+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:21:39.614870+0000","last_undegraded":"2024-03-07T10:21:39.614870+0000","last_fullsized":"2024-03-07T10:21:39.614870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576641+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:21:39.576641+0000","last_peered":"2024-03-07T10:21:39.576641+0000","last_clean":"2024-03-07T10:21:39.576641+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:21:39.576641+0000","last_undegraded":"2024-03-07T10:21:39.576641+0000","last_fullsized":"2024-03-07T10:21:39.576641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572763+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:21:39.572763+0000","last_peered":"2024-03-07T10:21:39.572763+0000","last_clean":"2024-03-07T10:21:39.572763+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:21:39.572763+0000","last_undegraded":"2024-03-07T10:21:39.572763+0000","last_fullsized":"2024-03-07T10:21:39.572763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572027+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:21:39.572027+0000","last_peered":"2024-03-07T10:21:39.572027+0000","last_clean":"2024-03-07T10:21:39.572027+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:21:39.572027+0000","last_undegraded":"2024-03-07T10:21:39.572027+0000","last_fullsized":"2024-03-07T10:21:39.572027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572183+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:21:39.572183+0000","last_peered":"2024-03-07T10:21:39.572183+0000","last_clean":"2024-03-07T10:21:39.572183+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:21:39.572183+0000","last_undegraded":"2024-03-07T10:21:39.572183+0000","last_fullsized":"2024-03-07T10:21:39.572183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577524+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:21:39.577524+0000","last_peered":"2024-03-07T10:21:39.577524+0000","last_clean":"2024-03-07T10:21:39.577524+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:21:39.577524+0000","last_undegraded":"2024-03-07T10:21:39.577524+0000","last_fullsized":"2024-03-07T10:21:39.577524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571050+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:21:39.571050+0000","last_peered":"2024-03-07T10:21:39.571050+0000","last_clean":"2024-03-07T10:21:39.571050+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:21:39.571050+0000","last_undegraded":"2024-03-07T10:21:39.571050+0000","last_fullsized":"2024-03-07T10:21:39.571050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575639+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:21:39.575639+0000","last_peered":"2024-03-07T10:21:39.575639+0000","last_clean":"2024-03-07T10:21:39.575639+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:21:39.575639+0000","last_undegraded":"2024-03-07T10:21:39.575639+0000","last_fullsized":"2024-03-07T10:21:39.575639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575005+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:21:39.575005+0000","last_peered":"2024-03-07T10:21:39.575005+0000","last_clean":"2024-03-07T10:21:39.575005+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:21:39.575005+0000","last_undegraded":"2024-03-07T10:21:39.575005+0000","last_fullsized":"2024-03-07T10:21:39.575005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612611+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:21:39.612611+0000","last_peered":"2024-03-07T10:21:39.612611+0000","last_clean":"2024-03-07T10:21:39.612611+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:21:39.612611+0000","last_undegraded":"2024-03-07T10:21:39.612611+0000","last_fullsized":"2024-03-07T10:21:39.612611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613055+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:21:39.613055+0000","last_peered":"2024-03-07T10:21:39.613055+0000","last_clean":"2024-03-07T10:21:39.613055+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:21:39.613055+0000","last_undegraded":"2024-03-07T10:21:39.613055+0000","last_fullsized":"2024-03-07T10:21:39.613055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574365+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:21:39.574365+0000","last_peered":"2024-03-07T10:21:39.574365+0000","last_clean":"2024-03-07T10:21:39.574365+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:21:39.574365+0000","last_undegraded":"2024-03-07T10:21:39.574365+0000","last_fullsized":"2024-03-07T10:21:39.574365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575148+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:21:39.575148+0000","last_peered":"2024-03-07T10:21:39.575148+0000","last_clean":"2024-03-07T10:21:39.575148+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:21:39.575148+0000","last_undegraded":"2024-03-07T10:21:39.575148+0000","last_fullsized":"2024-03-07T10:21:39.575148+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574627+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:21:39.574627+0000","last_peered":"2024-03-07T10:21:39.574627+0000","last_clean":"2024-03-07T10:21:39.574627+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:21:39.574627+0000","last_undegraded":"2024-03-07T10:21:39.574627+0000","last_fullsized":"2024-03-07T10:21:39.574627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614219+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:21:39.614219+0000","last_peered":"2024-03-07T10:21:39.614219+0000","last_clean":"2024-03-07T10:21:39.614219+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:21:39.614219+0000","last_undegraded":"2024-03-07T10:21:39.614219+0000","last_fullsized":"2024-03-07T10:21:39.614219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574579+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:21:39.574579+0000","last_peered":"2024-03-07T10:21:39.574579+0000","last_clean":"2024-03-07T10:21:39.574579+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:21:39.574579+0000","last_undegraded":"2024-03-07T10:21:39.574579+0000","last_fullsized":"2024-03-07T10:21:39.574579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574381+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:21:39.574381+0000","last_peered":"2024-03-07T10:21:39.574381+0000","last_clean":"2024-03-07T10:21:39.574381+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:21:39.574381+0000","last_undegraded":"2024-03-07T10:21:39.574381+0000","last_fullsized":"2024-03-07T10:21:39.574381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574850+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:21:39.574850+0000","last_peered":"2024-03-07T10:21:39.574850+0000","last_clean":"2024-03-07T10:21:39.574850+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:21:39.574850+0000","last_undegraded":"2024-03-07T10:21:39.574850+0000","last_fullsized":"2024-03-07T10:21:39.574850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580521+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:21:39.580521+0000","last_peered":"2024-03-07T10:21:39.580521+0000","last_clean":"2024-03-07T10:21:39.580521+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:21:39.580521+0000","last_undegraded":"2024-03-07T10:21:39.580521+0000","last_fullsized":"2024-03-07T10:21:39.580521+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574296+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:21:39.574296+0000","last_peered":"2024-03-07T10:21:39.574296+0000","last_clean":"2024-03-07T10:21:39.574296+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:21:39.574296+0000","last_undegraded":"2024-03-07T10:21:39.574296+0000","last_fullsized":"2024-03-07T10:21:39.574296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578629+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:21:39.578629+0000","last_peered":"2024-03-07T10:21:39.578629+0000","last_clean":"2024-03-07T10:21:39.578629+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:21:39.578629+0000","last_undegraded":"2024-03-07T10:21:39.578629+0000","last_fullsized":"2024-03-07T10:21:39.578629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576232+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:21:39.576232+0000","last_peered":"2024-03-07T10:21:39.576232+0000","last_clean":"2024-03-07T10:21:39.576232+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:21:39.576232+0000","last_undegraded":"2024-03-07T10:21:39.576232+0000","last_fullsized":"2024-03-07T10:21:39.576232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574913+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:21:39.574913+0000","last_peered":"2024-03-07T10:21:39.574913+0000","last_clean":"2024-03-07T10:21:39.574913+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:21:39.574913+0000","last_undegraded":"2024-03-07T10:21:39.574913+0000","last_fullsized":"2024-03-07T10:21:39.574913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612177+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:21:39.612177+0000","last_peered":"2024-03-07T10:21:39.612177+0000","last_clean":"2024-03-07T10:21:39.612177+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:21:39.612177+0000","last_undegraded":"2024-03-07T10:21:39.612177+0000","last_fullsized":"2024-03-07T10:21:39.612177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610878+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:21:39.610878+0000","last_peered":"2024-03-07T10:21:39.610878+0000","last_clean":"2024-03-07T10:21:39.610878+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:21:39.610878+0000","last_undegraded":"2024-03-07T10:21:39.610878+0000","last_fullsized":"2024-03-07T10:21:39.610878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614988+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:21:39.614988+0000","last_peered":"2024-03-07T10:21:39.614988+0000","last_clean":"2024-03-07T10:21:39.614988+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:21:39.614988+0000","last_undegraded":"2024-03-07T10:21:39.614988+0000","last_fullsized":"2024-03-07T10:21:39.614988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611174+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:21:39.611174+0000","last_peered":"2024-03-07T10:21:39.611174+0000","last_clean":"2024-03-07T10:21:39.611174+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:21:39.611174+0000","last_undegraded":"2024-03-07T10:21:39.611174+0000","last_fullsized":"2024-03-07T10:21:39.611174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572309+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:21:39.572309+0000","last_peered":"2024-03-07T10:21:39.572309+0000","last_clean":"2024-03-07T10:21:39.572309+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:21:39.572309+0000","last_undegraded":"2024-03-07T10:21:39.572309+0000","last_fullsized":"2024-03-07T10:21:39.572309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575001+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:21:39.575001+0000","last_peered":"2024-03-07T10:21:39.575001+0000","last_clean":"2024-03-07T10:21:39.575001+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:21:39.575001+0000","last_undegraded":"2024-03-07T10:21:39.575001+0000","last_fullsized":"2024-03-07T10:21:39.575001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610997+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:21:39.610997+0000","last_peered":"2024-03-07T10:21:39.610997+0000","last_clean":"2024-03-07T10:21:39.610997+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:21:39.610997+0000","last_undegraded":"2024-03-07T10:21:39.610997+0000","last_fullsized":"2024-03-07T10:21:39.610997+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575280+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:21:39.575280+0000","last_peered":"2024-03-07T10:21:39.575280+0000","last_clean":"2024-03-07T10:21:39.575280+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:21:39.575280+0000","last_undegraded":"2024-03-07T10:21:39.575280+0000","last_fullsized":"2024-03-07T10:21:39.575280+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579635+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:21:39.579635+0000","last_peered":"2024-03-07T10:21:39.579635+0000","last_clean":"2024-03-07T10:21:39.579635+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:21:39.579635+0000","last_undegraded":"2024-03-07T10:21:39.579635+0000","last_fullsized":"2024-03-07T10:21:39.579635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611900+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:21:39.611900+0000","last_peered":"2024-03-07T10:21:39.611900+0000","last_clean":"2024-03-07T10:21:39.611900+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:21:39.611900+0000","last_undegraded":"2024-03-07T10:21:39.611900+0000","last_fullsized":"2024-03-07T10:21:39.611900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580649+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:21:39.580649+0000","last_peered":"2024-03-07T10:21:39.580649+0000","last_clean":"2024-03-07T10:21:39.580649+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:21:39.580649+0000","last_undegraded":"2024-03-07T10:21:39.580649+0000","last_fullsized":"2024-03-07T10:21:39.580649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575754+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:21:39.575754+0000","last_peered":"2024-03-07T10:21:39.575754+0000","last_clean":"2024-03-07T10:21:39.575754+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:21:39.575754+0000","last_undegraded":"2024-03-07T10:21:39.575754+0000","last_fullsized":"2024-03-07T10:21:39.575754+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578752+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:21:39.578752+0000","last_peered":"2024-03-07T10:21:39.578752+0000","last_clean":"2024-03-07T10:21:39.578752+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:21:39.578752+0000","last_undegraded":"2024-03-07T10:21:39.578752+0000","last_fullsized":"2024-03-07T10:21:39.578752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574862+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:21:39.574862+0000","last_peered":"2024-03-07T10:21:39.574862+0000","last_clean":"2024-03-07T10:21:39.574862+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:21:39.574862+0000","last_undegraded":"2024-03-07T10:21:39.574862+0000","last_fullsized":"2024-03-07T10:21:39.574862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576091+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:21:39.576091+0000","last_peered":"2024-03-07T10:21:39.576091+0000","last_clean":"2024-03-07T10:21:39.576091+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:21:39.576091+0000","last_undegraded":"2024-03-07T10:21:39.576091+0000","last_fullsized":"2024-03-07T10:21:39.576091+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612354+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:21:39.612354+0000","last_peered":"2024-03-07T10:21:39.612354+0000","last_clean":"2024-03-07T10:21:39.612354+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:21:39.612354+0000","last_undegraded":"2024-03-07T10:21:39.612354+0000","last_fullsized":"2024-03-07T10:21:39.612354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611040+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:21:39.611040+0000","last_peered":"2024-03-07T10:21:39.611040+0000","last_clean":"2024-03-07T10:21:39.611040+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:21:39.611040+0000","last_undegraded":"2024-03-07T10:21:39.611040+0000","last_fullsized":"2024-03-07T10:21:39.611040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612376+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:21:39.612376+0000","last_peered":"2024-03-07T10:21:39.612376+0000","last_clean":"2024-03-07T10:21:39.612376+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:21:39.612376+0000","last_undegraded":"2024-03-07T10:21:39.612376+0000","last_fullsized":"2024-03-07T10:21:39.612376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580941+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:21:39.580941+0000","last_peered":"2024-03-07T10:21:39.580941+0000","last_clean":"2024-03-07T10:21:39.580941+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:21:39.580941+0000","last_undegraded":"2024-03-07T10:21:39.580941+0000","last_fullsized":"2024-03-07T10:21:39.580941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575978+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:21:39.575978+0000","last_peered":"2024-03-07T10:21:39.575978+0000","last_clean":"2024-03-07T10:21:39.575978+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:21:39.575978+0000","last_undegraded":"2024-03-07T10:21:39.575978+0000","last_fullsized":"2024-03-07T10:21:39.575978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578874+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:21:39.578874+0000","last_peered":"2024-03-07T10:21:39.578874+0000","last_clean":"2024-03-07T10:21:39.578874+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:21:39.578874+0000","last_undegraded":"2024-03-07T10:21:39.578874+0000","last_fullsized":"2024-03-07T10:21:39.578874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611855+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:21:39.611855+0000","last_peered":"2024-03-07T10:21:39.611855+0000","last_clean":"2024-03-07T10:21:39.611855+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:21:39.611855+0000","last_undegraded":"2024-03-07T10:21:39.611855+0000","last_fullsized":"2024-03-07T10:21:39.611855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574763+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:21:39.574763+0000","last_peered":"2024-03-07T10:21:39.574763+0000","last_clean":"2024-03-07T10:21:39.574763+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:21:39.574763+0000","last_undegraded":"2024-03-07T10:21:39.574763+0000","last_fullsized":"2024-03-07T10:21:39.574763+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572513+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:21:39.572513+0000","last_peered":"2024-03-07T10:21:39.572513+0000","last_clean":"2024-03-07T10:21:39.572513+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:21:39.572513+0000","last_undegraded":"2024-03-07T10:21:39.572513+0000","last_fullsized":"2024-03-07T10:21:39.572513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571971+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:21:39.571971+0000","last_peered":"2024-03-07T10:21:39.571971+0000","last_clean":"2024-03-07T10:21:39.571971+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:21:39.571971+0000","last_undegraded":"2024-03-07T10:21:39.571971+0000","last_fullsized":"2024-03-07T10:21:39.571971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611215+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:21:39.611215+0000","last_peered":"2024-03-07T10:21:39.611215+0000","last_clean":"2024-03-07T10:21:39.611215+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:21:39.611215+0000","last_undegraded":"2024-03-07T10:21:39.611215+0000","last_fullsized":"2024-03-07T10:21:39.611215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578998+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:21:39.578998+0000","last_peered":"2024-03-07T10:21:39.578998+0000","last_clean":"2024-03-07T10:21:39.578998+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:21:39.578998+0000","last_undegraded":"2024-03-07T10:21:39.578998+0000","last_fullsized":"2024-03-07T10:21:39.578998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614858+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:21:39.614858+0000","last_peered":"2024-03-07T10:21:39.614858+0000","last_clean":"2024-03-07T10:21:39.614858+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:21:39.614858+0000","last_undegraded":"2024-03-07T10:21:39.614858+0000","last_fullsized":"2024-03-07T10:21:39.614858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573910+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:21:39.573910+0000","last_peered":"2024-03-07T10:21:39.573910+0000","last_clean":"2024-03-07T10:21:39.573910+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:21:39.573910+0000","last_undegraded":"2024-03-07T10:21:39.573910+0000","last_fullsized":"2024-03-07T10:21:39.573910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574355+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:21:39.574355+0000","last_peered":"2024-03-07T10:21:39.574355+0000","last_clean":"2024-03-07T10:21:39.574355+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:21:39.574355+0000","last_undegraded":"2024-03-07T10:21:39.574355+0000","last_fullsized":"2024-03-07T10:21:39.574355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575466+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:21:39.575466+0000","last_peered":"2024-03-07T10:21:39.575466+0000","last_clean":"2024-03-07T10:21:39.575466+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:21:39.575466+0000","last_undegraded":"2024-03-07T10:21:39.575466+0000","last_fullsized":"2024-03-07T10:21:39.575466+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571974+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:21:39.571974+0000","last_peered":"2024-03-07T10:21:39.571974+0000","last_clean":"2024-03-07T10:21:39.571974+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:21:39.571974+0000","last_undegraded":"2024-03-07T10:21:39.571974+0000","last_fullsized":"2024-03-07T10:21:39.571974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573504+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:21:39.573504+0000","last_peered":"2024-03-07T10:21:39.573504+0000","last_clean":"2024-03-07T10:21:39.573504+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:21:39.573504+0000","last_undegraded":"2024-03-07T10:21:39.573504+0000","last_fullsized":"2024-03-07T10:21:39.573504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611570+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:21:39.611570+0000","last_peered":"2024-03-07T10:21:39.611570+0000","last_clean":"2024-03-07T10:21:39.611570+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:21:39.611570+0000","last_undegraded":"2024-03-07T10:21:39.611570+0000","last_fullsized":"2024-03-07T10:21:39.611570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574271+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:21:39.574271+0000","last_peered":"2024-03-07T10:21:39.574271+0000","last_clean":"2024-03-07T10:21:39.574271+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:21:39.574271+0000","last_undegraded":"2024-03-07T10:21:39.574271+0000","last_fullsized":"2024-03-07T10:21:39.574271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'9","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:42.565814+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:21:42.565814+0000","last_peered":"2024-03-07T10:21:42.565814+0000","last_clean":"2024-03-07T10:21:42.565814+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:21:42.565814+0000","last_undegraded":"2024-03-07T10:21:42.565814+0000","last_fullsized":"2024-03-07T10:21:42.565814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571758+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:21:39.571758+0000","last_peered":"2024-03-07T10:21:39.571758+0000","last_clean":"2024-03-07T10:21:39.571758+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:21:39.571758+0000","last_undegraded":"2024-03-07T10:21:39.571758+0000","last_fullsized":"2024-03-07T10:21:39.571758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612468+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:21:39.612468+0000","last_peered":"2024-03-07T10:21:39.612468+0000","last_clean":"2024-03-07T10:21:39.612468+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:21:39.612468+0000","last_undegraded":"2024-03-07T10:21:39.612468+0000","last_fullsized":"2024-03-07T10:21:39.612468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613779+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:21:39.613779+0000","last_peered":"2024-03-07T10:21:39.613779+0000","last_clean":"2024-03-07T10:21:39.613779+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:21:39.613779+0000","last_undegraded":"2024-03-07T10:21:39.613779+0000","last_fullsized":"2024-03-07T10:21:39.613779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"23'3","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575196+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:21:39.575196+0000","last_peered":"2024-03-07T10:21:39.575196+0000","last_clean":"2024-03-07T10:21:39.575196+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:21:39.575196+0000","last_undegraded":"2024-03-07T10:21:39.575196+0000","last_fullsized":"2024-03-07T10:21:39.575196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572109+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:21:39.572109+0000","last_peered":"2024-03-07T10:21:39.572109+0000","last_clean":"2024-03-07T10:21:39.572109+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:21:39.572109+0000","last_undegraded":"2024-03-07T10:21:39.572109+0000","last_fullsized":"2024-03-07T10:21:39.572109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611833+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:21:39.611833+0000","last_peered":"2024-03-07T10:21:39.611833+0000","last_clean":"2024-03-07T10:21:39.611833+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:21:39.611833+0000","last_undegraded":"2024-03-07T10:21:39.611833+0000","last_fullsized":"2024-03-07T10:21:39.611833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":35,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575566+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:21:39.575566+0000","last_peered":"2024-03-07T10:21:39.575566+0000","last_clean":"2024-03-07T10:21:39.575566+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:21:39.575566+0000","last_undegraded":"2024-03-07T10:21:39.575566+0000","last_fullsized":"2024-03-07T10:21:39.575566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2857,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574384+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:21:39.574384+0000","last_peered":"2024-03-07T10:21:39.574384+0000","last_clean":"2024-03-07T10:21:39.574384+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:21:39.574384+0000","last_undegraded":"2024-03-07T10:21:39.574384+0000","last_fullsized":"2024-03-07T10:21:39.574384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574902+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:21:39.574902+0000","last_peered":"2024-03-07T10:21:39.574902+0000","last_clean":"2024-03-07T10:21:39.574902+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:21:39.574902+0000","last_undegraded":"2024-03-07T10:21:39.574902+0000","last_fullsized":"2024-03-07T10:21:39.574902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576663+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:21:39.576663+0000","last_peered":"2024-03-07T10:21:39.576663+0000","last_clean":"2024-03-07T10:21:39.576663+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:21:39.576663+0000","last_undegraded":"2024-03-07T10:21:39.576663+0000","last_fullsized":"2024-03-07T10:21:39.576663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575968+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:21:39.575968+0000","last_peered":"2024-03-07T10:21:39.575968+0000","last_clean":"2024-03-07T10:21:39.575968+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:21:39.575968+0000","last_undegraded":"2024-03-07T10:21:39.575968+0000","last_fullsized":"2024-03-07T10:21:39.575968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574186+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:21:39.574186+0000","last_peered":"2024-03-07T10:21:39.574186+0000","last_clean":"2024-03-07T10:21:39.574186+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:21:39.574186+0000","last_undegraded":"2024-03-07T10:21:39.574186+0000","last_fullsized":"2024-03-07T10:21:39.574186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575272+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:21:39.575272+0000","last_peered":"2024-03-07T10:21:39.575272+0000","last_clean":"2024-03-07T10:21:39.575272+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:21:39.575272+0000","last_undegraded":"2024-03-07T10:21:39.575272+0000","last_fullsized":"2024-03-07T10:21:39.575272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614759+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:21:39.614759+0000","last_peered":"2024-03-07T10:21:39.614759+0000","last_clean":"2024-03-07T10:21:39.614759+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:21:39.614759+0000","last_undegraded":"2024-03-07T10:21:39.614759+0000","last_fullsized":"2024-03-07T10:21:39.614759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574662+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:21:39.574662+0000","last_peered":"2024-03-07T10:21:39.574662+0000","last_clean":"2024-03-07T10:21:39.574662+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:21:39.574662+0000","last_undegraded":"2024-03-07T10:21:39.574662+0000","last_fullsized":"2024-03-07T10:21:39.574662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571197+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:21:39.571197+0000","last_peered":"2024-03-07T10:21:39.571197+0000","last_clean":"2024-03-07T10:21:39.571197+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:21:39.571197+0000","last_undegraded":"2024-03-07T10:21:39.571197+0000","last_fullsized":"2024-03-07T10:21:39.571197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610726+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:21:39.610726+0000","last_peered":"2024-03-07T10:21:39.610726+0000","last_clean":"2024-03-07T10:21:39.610726+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:21:39.610726+0000","last_undegraded":"2024-03-07T10:21:39.610726+0000","last_fullsized":"2024-03-07T10:21:39.610726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616041+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:21:39.616041+0000","last_peered":"2024-03-07T10:21:39.616041+0000","last_clean":"2024-03-07T10:21:39.616041+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:21:39.616041+0000","last_undegraded":"2024-03-07T10:21:39.616041+0000","last_fullsized":"2024-03-07T10:21:39.616041+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576546+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:21:39.576546+0000","last_peered":"2024-03-07T10:21:39.576546+0000","last_clean":"2024-03-07T10:21:39.576546+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:21:39.576546+0000","last_undegraded":"2024-03-07T10:21:39.576546+0000","last_fullsized":"2024-03-07T10:21:39.576546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571166+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:21:39.571166+0000","last_peered":"2024-03-07T10:21:39.571166+0000","last_clean":"2024-03-07T10:21:39.571166+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:21:39.571166+0000","last_undegraded":"2024-03-07T10:21:39.571166+0000","last_fullsized":"2024-03-07T10:21:39.571166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576299+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:21:39.576299+0000","last_peered":"2024-03-07T10:21:39.576299+0000","last_clean":"2024-03-07T10:21:39.576299+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:21:39.576299+0000","last_undegraded":"2024-03-07T10:21:39.576299+0000","last_fullsized":"2024-03-07T10:21:39.576299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"23'1","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614648+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:21:39.614648+0000","last_peered":"2024-03-07T10:21:39.614648+0000","last_clean":"2024-03-07T10:21:39.614648+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:21:39.614648+0000","last_undegraded":"2024-03-07T10:21:39.614648+0000","last_fullsized":"2024-03-07T10:21:39.614648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575260+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:21:39.575260+0000","last_peered":"2024-03-07T10:21:39.575260+0000","last_clean":"2024-03-07T10:21:39.575260+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:21:39.575260+0000","last_undegraded":"2024-03-07T10:21:39.575260+0000","last_fullsized":"2024-03-07T10:21:39.575260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576970+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:21:39.576970+0000","last_peered":"2024-03-07T10:21:39.576970+0000","last_clean":"2024-03-07T10:21:39.576970+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:21:39.576970+0000","last_undegraded":"2024-03-07T10:21:39.576970+0000","last_fullsized":"2024-03-07T10:21:39.576970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614505+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:21:39.614505+0000","last_peered":"2024-03-07T10:21:39.614505+0000","last_clean":"2024-03-07T10:21:39.614505+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:21:39.614505+0000","last_undegraded":"2024-03-07T10:21:39.614505+0000","last_fullsized":"2024-03-07T10:21:39.614505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"23'4","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576394+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:21:39.576394+0000","last_peered":"2024-03-07T10:21:39.576394+0000","last_clean":"2024-03-07T10:21:39.576394+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:21:39.576394+0000","last_undegraded":"2024-03-07T10:21:39.576394+0000","last_fullsized":"2024-03-07T10:21:39.576394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571501+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:21:39.571501+0000","last_peered":"2024-03-07T10:21:39.571501+0000","last_clean":"2024-03-07T10:21:39.571501+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:21:39.571501+0000","last_undegraded":"2024-03-07T10:21:39.571501+0000","last_fullsized":"2024-03-07T10:21:39.571501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571465+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:21:39.571465+0000","last_peered":"2024-03-07T10:21:39.571465+0000","last_clean":"2024-03-07T10:21:39.571465+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:21:39.571465+0000","last_undegraded":"2024-03-07T10:21:39.571465+0000","last_fullsized":"2024-03-07T10:21:39.571465+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574997+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:21:39.574997+0000","last_peered":"2024-03-07T10:21:39.574997+0000","last_clean":"2024-03-07T10:21:39.574997+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:21:39.574997+0000","last_undegraded":"2024-03-07T10:21:39.574997+0000","last_fullsized":"2024-03-07T10:21:39.574997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576018+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:21:39.576018+0000","last_peered":"2024-03-07T10:21:39.576018+0000","last_clean":"2024-03-07T10:21:39.576018+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:21:39.576018+0000","last_undegraded":"2024-03-07T10:21:39.576018+0000","last_fullsized":"2024-03-07T10:21:39.576018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613381+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:21:39.613381+0000","last_peered":"2024-03-07T10:21:39.613381+0000","last_clean":"2024-03-07T10:21:39.613381+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:21:39.613381+0000","last_undegraded":"2024-03-07T10:21:39.613381+0000","last_fullsized":"2024-03-07T10:21:39.613381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580254+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:21:39.580254+0000","last_peered":"2024-03-07T10:21:39.580254+0000","last_clean":"2024-03-07T10:21:39.580254+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:21:39.580254+0000","last_undegraded":"2024-03-07T10:21:39.580254+0000","last_fullsized":"2024-03-07T10:21:39.580254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576755+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:21:39.576755+0000","last_peered":"2024-03-07T10:21:39.576755+0000","last_clean":"2024-03-07T10:21:39.576755+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:21:39.576755+0000","last_undegraded":"2024-03-07T10:21:39.576755+0000","last_fullsized":"2024-03-07T10:21:39.576755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572585+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:21:39.572585+0000","last_peered":"2024-03-07T10:21:39.572585+0000","last_clean":"2024-03-07T10:21:39.572585+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:21:39.572585+0000","last_undegraded":"2024-03-07T10:21:39.572585+0000","last_fullsized":"2024-03-07T10:21:39.572585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573281+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:21:39.573281+0000","last_peered":"2024-03-07T10:21:39.573281+0000","last_clean":"2024-03-07T10:21:39.573281+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:21:39.573281+0000","last_undegraded":"2024-03-07T10:21:39.573281+0000","last_fullsized":"2024-03-07T10:21:39.573281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"23'2","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572783+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:21:39.572783+0000","last_peered":"2024-03-07T10:21:39.572783+0000","last_clean":"2024-03-07T10:21:39.572783+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:21:39.572783+0000","last_undegraded":"2024-03-07T10:21:39.572783+0000","last_fullsized":"2024-03-07T10:21:39.572783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572715+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:21:39.572715+0000","last_peered":"2024-03-07T10:21:39.572715+0000","last_clean":"2024-03-07T10:21:39.572715+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:21:39.572715+0000","last_undegraded":"2024-03-07T10:21:39.572715+0000","last_fullsized":"2024-03-07T10:21:39.572715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574256+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:21:39.574256+0000","last_peered":"2024-03-07T10:21:39.574256+0000","last_clean":"2024-03-07T10:21:39.574256+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:21:39.574256+0000","last_undegraded":"2024-03-07T10:21:39.574256+0000","last_fullsized":"2024-03-07T10:21:39.574256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576077+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:21:39.576077+0000","last_peered":"2024-03-07T10:21:39.576077+0000","last_clean":"2024-03-07T10:21:39.576077+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:21:39.576077+0000","last_undegraded":"2024-03-07T10:21:39.576077+0000","last_fullsized":"2024-03-07T10:21:39.576077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.578533+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:21:39.578533+0000","last_peered":"2024-03-07T10:21:39.578533+0000","last_clean":"2024-03-07T10:21:39.578533+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:21:39.578533+0000","last_undegraded":"2024-03-07T10:21:39.578533+0000","last_fullsized":"2024-03-07T10:21:39.578533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573778+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:21:39.573778+0000","last_peered":"2024-03-07T10:21:39.573778+0000","last_clean":"2024-03-07T10:21:39.573778+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:21:39.573778+0000","last_undegraded":"2024-03-07T10:21:39.573778+0000","last_fullsized":"2024-03-07T10:21:39.573778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574159+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:21:39.574159+0000","last_peered":"2024-03-07T10:21:39.574159+0000","last_clean":"2024-03-07T10:21:39.574159+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:21:39.574159+0000","last_undegraded":"2024-03-07T10:21:39.574159+0000","last_fullsized":"2024-03-07T10:21:39.574159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574815+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:21:39.574815+0000","last_peered":"2024-03-07T10:21:39.574815+0000","last_clean":"2024-03-07T10:21:39.574815+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:21:39.574815+0000","last_undegraded":"2024-03-07T10:21:39.574815+0000","last_fullsized":"2024-03-07T10:21:39.574815+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.613299+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:21:39.613299+0000","last_peered":"2024-03-07T10:21:39.613299+0000","last_clean":"2024-03-07T10:21:39.613299+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:21:39.613299+0000","last_undegraded":"2024-03-07T10:21:39.613299+0000","last_fullsized":"2024-03-07T10:21:39.613299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611177+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:21:39.611177+0000","last_peered":"2024-03-07T10:21:39.611177+0000","last_clean":"2024-03-07T10:21:39.611177+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:21:39.611177+0000","last_undegraded":"2024-03-07T10:21:39.611177+0000","last_fullsized":"2024-03-07T10:21:39.611177+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572411+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:21:39.572411+0000","last_peered":"2024-03-07T10:21:39.572411+0000","last_clean":"2024-03-07T10:21:39.572411+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:21:39.572411+0000","last_undegraded":"2024-03-07T10:21:39.572411+0000","last_fullsized":"2024-03-07T10:21:39.572411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573655+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:21:39.573655+0000","last_peered":"2024-03-07T10:21:39.573655+0000","last_clean":"2024-03-07T10:21:39.573655+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:21:39.573655+0000","last_undegraded":"2024-03-07T10:21:39.573655+0000","last_fullsized":"2024-03-07T10:21:39.573655+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575828+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:21:39.575828+0000","last_peered":"2024-03-07T10:21:39.575828+0000","last_clean":"2024-03-07T10:21:39.575828+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:21:39.575828+0000","last_undegraded":"2024-03-07T10:21:39.575828+0000","last_fullsized":"2024-03-07T10:21:39.575828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610617+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:21:39.610617+0000","last_peered":"2024-03-07T10:21:39.610617+0000","last_clean":"2024-03-07T10:21:39.610617+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:21:39.610617+0000","last_undegraded":"2024-03-07T10:21:39.610617+0000","last_fullsized":"2024-03-07T10:21:39.610617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575953+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:21:39.575953+0000","last_peered":"2024-03-07T10:21:39.575953+0000","last_clean":"2024-03-07T10:21:39.575953+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:21:39.575953+0000","last_undegraded":"2024-03-07T10:21:39.575953+0000","last_fullsized":"2024-03-07T10:21:39.575953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575170+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:21:39.575170+0000","last_peered":"2024-03-07T10:21:39.575170+0000","last_clean":"2024-03-07T10:21:39.575170+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:21:39.575170+0000","last_undegraded":"2024-03-07T10:21:39.575170+0000","last_fullsized":"2024-03-07T10:21:39.575170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572154+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:21:39.572154+0000","last_peered":"2024-03-07T10:21:39.572154+0000","last_clean":"2024-03-07T10:21:39.572154+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:21:39.572154+0000","last_undegraded":"2024-03-07T10:21:39.572154+0000","last_fullsized":"2024-03-07T10:21:39.572154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572594+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:21:39.572594+0000","last_peered":"2024-03-07T10:21:39.572594+0000","last_clean":"2024-03-07T10:21:39.572594+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:21:39.572594+0000","last_undegraded":"2024-03-07T10:21:39.572594+0000","last_fullsized":"2024-03-07T10:21:39.572594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.581098+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:21:39.581098+0000","last_peered":"2024-03-07T10:21:39.581098+0000","last_clean":"2024-03-07T10:21:39.581098+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:21:39.581098+0000","last_undegraded":"2024-03-07T10:21:39.581098+0000","last_fullsized":"2024-03-07T10:21:39.581098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612166+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:21:39.612166+0000","last_peered":"2024-03-07T10:21:39.612166+0000","last_clean":"2024-03-07T10:21:39.612166+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:21:39.612166+0000","last_undegraded":"2024-03-07T10:21:39.612166+0000","last_fullsized":"2024-03-07T10:21:39.612166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571457+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:21:39.571457+0000","last_peered":"2024-03-07T10:21:39.571457+0000","last_clean":"2024-03-07T10:21:39.571457+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:21:39.571457+0000","last_undegraded":"2024-03-07T10:21:39.571457+0000","last_fullsized":"2024-03-07T10:21:39.571457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580192+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:21:39.580192+0000","last_peered":"2024-03-07T10:21:39.580192+0000","last_clean":"2024-03-07T10:21:39.580192+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:21:39.580192+0000","last_undegraded":"2024-03-07T10:21:39.580192+0000","last_fullsized":"2024-03-07T10:21:39.580192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.616116+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:21:39.616116+0000","last_peered":"2024-03-07T10:21:39.616116+0000","last_clean":"2024-03-07T10:21:39.616116+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:21:39.616116+0000","last_undegraded":"2024-03-07T10:21:39.616116+0000","last_fullsized":"2024-03-07T10:21:39.616116+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572662+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:21:39.572662+0000","last_peered":"2024-03-07T10:21:39.572662+0000","last_clean":"2024-03-07T10:21:39.572662+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:21:39.572662+0000","last_undegraded":"2024-03-07T10:21:39.572662+0000","last_fullsized":"2024-03-07T10:21:39.572662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612992+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:21:39.612992+0000","last_peered":"2024-03-07T10:21:39.612992+0000","last_clean":"2024-03-07T10:21:39.612992+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:21:39.612992+0000","last_undegraded":"2024-03-07T10:21:39.612992+0000","last_fullsized":"2024-03-07T10:21:39.612992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572873+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:21:39.572873+0000","last_peered":"2024-03-07T10:21:39.572873+0000","last_clean":"2024-03-07T10:21:39.572873+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:21:39.572873+0000","last_undegraded":"2024-03-07T10:21:39.572873+0000","last_fullsized":"2024-03-07T10:21:39.572873+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575382+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:21:39.575382+0000","last_peered":"2024-03-07T10:21:39.575382+0000","last_clean":"2024-03-07T10:21:39.575382+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:21:39.575382+0000","last_undegraded":"2024-03-07T10:21:39.575382+0000","last_fullsized":"2024-03-07T10:21:39.575382+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572685+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:21:39.572685+0000","last_peered":"2024-03-07T10:21:39.572685+0000","last_clean":"2024-03-07T10:21:39.572685+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:21:39.572685+0000","last_undegraded":"2024-03-07T10:21:39.572685+0000","last_fullsized":"2024-03-07T10:21:39.572685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611992+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:21:39.611992+0000","last_peered":"2024-03-07T10:21:39.611992+0000","last_clean":"2024-03-07T10:21:39.611992+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:21:39.611992+0000","last_undegraded":"2024-03-07T10:21:39.611992+0000","last_fullsized":"2024-03-07T10:21:39.611992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575817+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:21:39.575817+0000","last_peered":"2024-03-07T10:21:39.575817+0000","last_clean":"2024-03-07T10:21:39.575817+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:21:39.575817+0000","last_undegraded":"2024-03-07T10:21:39.575817+0000","last_fullsized":"2024-03-07T10:21:39.575817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.580791+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:21:39.580791+0000","last_peered":"2024-03-07T10:21:39.580791+0000","last_clean":"2024-03-07T10:21:39.580791+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:21:39.580791+0000","last_undegraded":"2024-03-07T10:21:39.580791+0000","last_fullsized":"2024-03-07T10:21:39.580791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612094+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:21:39.612094+0000","last_peered":"2024-03-07T10:21:39.612094+0000","last_clean":"2024-03-07T10:21:39.612094+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:21:39.612094+0000","last_undegraded":"2024-03-07T10:21:39.612094+0000","last_fullsized":"2024-03-07T10:21:39.612094+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.617133+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:21:39.617133+0000","last_peered":"2024-03-07T10:21:39.617133+0000","last_clean":"2024-03-07T10:21:39.617133+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:21:39.617133+0000","last_undegraded":"2024-03-07T10:21:39.617133+0000","last_fullsized":"2024-03-07T10:21:39.617133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576751+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:21:39.576751+0000","last_peered":"2024-03-07T10:21:39.576751+0000","last_clean":"2024-03-07T10:21:39.576751+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:21:39.576751+0000","last_undegraded":"2024-03-07T10:21:39.576751+0000","last_fullsized":"2024-03-07T10:21:39.576751+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576854+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:21:39.576854+0000","last_peered":"2024-03-07T10:21:39.576854+0000","last_clean":"2024-03-07T10:21:39.576854+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:21:39.576854+0000","last_undegraded":"2024-03-07T10:21:39.576854+0000","last_fullsized":"2024-03-07T10:21:39.576854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574123+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:21:39.574123+0000","last_peered":"2024-03-07T10:21:39.574123+0000","last_clean":"2024-03-07T10:21:39.574123+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:21:39.574123+0000","last_undegraded":"2024-03-07T10:21:39.574123+0000","last_fullsized":"2024-03-07T10:21:39.574123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575393+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:21:39.575393+0000","last_peered":"2024-03-07T10:21:39.575393+0000","last_clean":"2024-03-07T10:21:39.575393+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:21:39.575393+0000","last_undegraded":"2024-03-07T10:21:39.575393+0000","last_fullsized":"2024-03-07T10:21:39.575393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573663+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:21:39.573663+0000","last_peered":"2024-03-07T10:21:39.573663+0000","last_clean":"2024-03-07T10:21:39.573663+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:21:39.573663+0000","last_undegraded":"2024-03-07T10:21:39.573663+0000","last_fullsized":"2024-03-07T10:21:39.573663+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612410+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:21:39.612410+0000","last_peered":"2024-03-07T10:21:39.612410+0000","last_clean":"2024-03-07T10:21:39.612410+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:21:39.612410+0000","last_undegraded":"2024-03-07T10:21:39.612410+0000","last_fullsized":"2024-03-07T10:21:39.612410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611804+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:21:39.611804+0000","last_peered":"2024-03-07T10:21:39.611804+0000","last_clean":"2024-03-07T10:21:39.611804+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:21:39.611804+0000","last_undegraded":"2024-03-07T10:21:39.611804+0000","last_fullsized":"2024-03-07T10:21:39.611804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572336+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:21:39.572336+0000","last_peered":"2024-03-07T10:21:39.572336+0000","last_clean":"2024-03-07T10:21:39.572336+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:21:39.572336+0000","last_undegraded":"2024-03-07T10:21:39.572336+0000","last_fullsized":"2024-03-07T10:21:39.572336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571766+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:21:39.571766+0000","last_peered":"2024-03-07T10:21:39.571766+0000","last_clean":"2024-03-07T10:21:39.571766+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:21:39.571766+0000","last_undegraded":"2024-03-07T10:21:39.571766+0000","last_fullsized":"2024-03-07T10:21:39.571766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576561+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:21:39.576561+0000","last_peered":"2024-03-07T10:21:39.576561+0000","last_clean":"2024-03-07T10:21:39.576561+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:21:39.576561+0000","last_undegraded":"2024-03-07T10:21:39.576561+0000","last_fullsized":"2024-03-07T10:21:39.576561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579274+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:21:39.579274+0000","last_peered":"2024-03-07T10:21:39.579274+0000","last_clean":"2024-03-07T10:21:39.579274+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:21:39.579274+0000","last_undegraded":"2024-03-07T10:21:39.579274+0000","last_fullsized":"2024-03-07T10:21:39.579274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575484+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:21:39.575484+0000","last_peered":"2024-03-07T10:21:39.575484+0000","last_clean":"2024-03-07T10:21:39.575484+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:21:39.575484+0000","last_undegraded":"2024-03-07T10:21:39.575484+0000","last_fullsized":"2024-03-07T10:21:39.575484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610952+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:21:39.610952+0000","last_peered":"2024-03-07T10:21:39.610952+0000","last_clean":"2024-03-07T10:21:39.610952+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:21:39.610952+0000","last_undegraded":"2024-03-07T10:21:39.610952+0000","last_fullsized":"2024-03-07T10:21:39.610952+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.575848+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:21:39.575848+0000","last_peered":"2024-03-07T10:21:39.575848+0000","last_clean":"2024-03-07T10:21:39.575848+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:21:39.575848+0000","last_undegraded":"2024-03-07T10:21:39.575848+0000","last_fullsized":"2024-03-07T10:21:39.575848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573421+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:21:39.573421+0000","last_peered":"2024-03-07T10:21:39.573421+0000","last_clean":"2024-03-07T10:21:39.573421+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:21:39.573421+0000","last_undegraded":"2024-03-07T10:21:39.573421+0000","last_fullsized":"2024-03-07T10:21:39.573421+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612333+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:21:39.612333+0000","last_peered":"2024-03-07T10:21:39.612333+0000","last_clean":"2024-03-07T10:21:39.612333+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:21:39.612333+0000","last_undegraded":"2024-03-07T10:21:39.612333+0000","last_fullsized":"2024-03-07T10:21:39.612333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.572442+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:21:39.572442+0000","last_peered":"2024-03-07T10:21:39.572442+0000","last_clean":"2024-03-07T10:21:39.572442+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:21:39.572442+0000","last_undegraded":"2024-03-07T10:21:39.572442+0000","last_fullsized":"2024-03-07T10:21:39.572442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571355+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:21:39.571355+0000","last_peered":"2024-03-07T10:21:39.571355+0000","last_clean":"2024-03-07T10:21:39.571355+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:21:39.571355+0000","last_undegraded":"2024-03-07T10:21:39.571355+0000","last_fullsized":"2024-03-07T10:21:39.571355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.576195+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:21:39.576195+0000","last_peered":"2024-03-07T10:21:39.576195+0000","last_clean":"2024-03-07T10:21:39.576195+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:21:39.576195+0000","last_undegraded":"2024-03-07T10:21:39.576195+0000","last_fullsized":"2024-03-07T10:21:39.576195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611057+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:21:39.611057+0000","last_peered":"2024-03-07T10:21:39.611057+0000","last_clean":"2024-03-07T10:21:39.611057+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:21:39.611057+0000","last_undegraded":"2024-03-07T10:21:39.611057+0000","last_fullsized":"2024-03-07T10:21:39.611057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.574324+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:21:39.574324+0000","last_peered":"2024-03-07T10:21:39.574324+0000","last_clean":"2024-03-07T10:21:39.574324+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:21:39.574324+0000","last_undegraded":"2024-03-07T10:21:39.574324+0000","last_fullsized":"2024-03-07T10:21:39.574324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573830+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:21:39.573830+0000","last_peered":"2024-03-07T10:21:39.573830+0000","last_clean":"2024-03-07T10:21:39.573830+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:21:39.573830+0000","last_undegraded":"2024-03-07T10:21:39.573830+0000","last_fullsized":"2024-03-07T10:21:39.573830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573913+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:21:39.573913+0000","last_peered":"2024-03-07T10:21:39.573913+0000","last_clean":"2024-03-07T10:21:39.573913+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:21:39.573913+0000","last_undegraded":"2024-03-07T10:21:39.573913+0000","last_fullsized":"2024-03-07T10:21:39.573913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.611500+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:21:39.611500+0000","last_peered":"2024-03-07T10:21:39.611500+0000","last_clean":"2024-03-07T10:21:39.611500+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:21:39.611500+0000","last_undegraded":"2024-03-07T10:21:39.611500+0000","last_fullsized":"2024-03-07T10:21:39.611500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.571439+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:21:39.571439+0000","last_peered":"2024-03-07T10:21:39.571439+0000","last_clean":"2024-03-07T10:21:39.571439+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:21:39.571439+0000","last_undegraded":"2024-03-07T10:21:39.571439+0000","last_fullsized":"2024-03-07T10:21:39.571439+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.573967+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:21:39.573967+0000","last_peered":"2024-03-07T10:21:39.573967+0000","last_clean":"2024-03-07T10:21:39.573967+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:21:39.573967+0000","last_undegraded":"2024-03-07T10:21:39.573967+0000","last_fullsized":"2024-03-07T10:21:39.573967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.579010+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:21:39.579010+0000","last_peered":"2024-03-07T10:21:39.579010+0000","last_clean":"2024-03-07T10:21:39.579010+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:21:39.579010+0000","last_undegraded":"2024-03-07T10:21:39.579010+0000","last_fullsized":"2024-03-07T10:21:39.579010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.614561+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:21:39.614561+0000","last_peered":"2024-03-07T10:21:39.614561+0000","last_clean":"2024-03-07T10:21:39.614561+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:21:39.614561+0000","last_undegraded":"2024-03-07T10:21:39.614561+0000","last_fullsized":"2024-03-07T10:21:39.614561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610599+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:21:39.610599+0000","last_peered":"2024-03-07T10:21:39.610599+0000","last_clean":"2024-03-07T10:21:39.610599+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:21:39.610599+0000","last_undegraded":"2024-03-07T10:21:39.610599+0000","last_fullsized":"2024-03-07T10:21:39.610599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.577099+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:21:39.577099+0000","last_peered":"2024-03-07T10:21:39.577099+0000","last_clean":"2024-03-07T10:21:39.577099+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:21:39.577099+0000","last_undegraded":"2024-03-07T10:21:39.577099+0000","last_fullsized":"2024-03-07T10:21:39.577099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.610840+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:21:39.610840+0000","last_peered":"2024-03-07T10:21:39.610840+0000","last_clean":"2024-03-07T10:21:39.610840+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:21:39.610840+0000","last_undegraded":"2024-03-07T10:21:39.610840+0000","last_fullsized":"2024-03-07T10:21:39.610840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-07T10:21:39.612287+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:21:39.612287+0000","last_peered":"2024-03-07T10:21:39.612287+0000","last_clean":"2024-03-07T10:21:39.612287+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:21:39.612287+0000","last_undegraded":"2024-03-07T10:21:39.612287+0000","last_fullsized":"2024-03-07T10:21:39.612287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3655,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343956,"statfs":{"total":96636764160,"available":96608210944,"internally_reserved":0,"allocated":880640,"data_stored":704115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":116548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":113837,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":113305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":118811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":113145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":704081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2879,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:21:50.376 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:50.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.614+0000 7fcc1f800640 1 Processor -- start 2024-03-07T10:21:50.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.614+0000 7fcc1f800640 1 -- start start 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.615+0000 7fcc1f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcc180adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.615+0000 7fcc1f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180c2180 con 0x7fcc180ad8e0 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.615+0000 7fcc1f800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180c39f0 con 0x7fcc180c2f70 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.615+0000 7fcc1f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c3cd0 con 0x7fcc18159a40 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc1ce00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fcc180ad8e0 0x7fcc18155760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42124/0 (socket says 172.21.15.194:42124) 2024-03-07T10:21:50.617 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1754735712 learned_addr learned my addr 172.21.15.194:0/1754735712 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcc180adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454908836 0 0) 0x7fcc180c2180 con 0x7fcc180ad8e0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf8003520 con 0x7fcc180ad8e0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3499080782 0 0) 0x7fcbf8003520 con 0x7fcc180ad8e0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 msgr2=0x7fcc180adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcc180adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.616+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 >> v1:172.21.15.196:6789/0 conn(0x7fcc180c2f70 legacy=0x7fcc181600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180c1ea0 con 0x7fcc180ad8e0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fcc08001670 con 0x7fcc180ad8e0 2024-03-07T10:21:50.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 >> v1:172.21.15.194:6789/0 conn(0x7fcc180ad8e0 legacy=0x7fcc18155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcbf8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf8004800 0x7fcbf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcbf8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c3cd0 con 0x7fcbf80039e0 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800baf0 con 0x7fcbf8004800 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf800bcf0 con 0x7fcc18159a40 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcbf8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf8004800 0x7fcbf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1d800640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcbf8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 msgr2=0x7fcbf8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcbf8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf8004800 msgr2=0x7fcbf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:50.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf8004800 0x7fcbf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1754735712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8003520 con 0x7fcbf80039e0 2024-03-07T10:21:50.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcbf8004800 0x7fcbf8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:50.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.617+0000 7fcc1d800640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc18159a40 0x7fcbf8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:50.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcbf8003e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c240 tx=0x7fcbf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2b99c13e4ae332 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08007d10 con 0x7fcbf80039e0 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08030070 con 0x7fcbf80039e0 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc17400640 1 -- 172.21.15.194:0/1754735712 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0802cd80 con 0x7fcbf80039e0 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1f800640 1 -- 172.21.15.194:0/1754735712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 msgr2=0x7fcbf8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1754735712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcbf8003e00 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c240 tx=0x7fcbf8005830 comp rx=0 tx=0).stop 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1d800640 1 -- 172.21.15.194:0/1754735712 reap_dead start 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1f800640 1 -- 172.21.15.194:0/1754735712 shutdown_connections 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.619+0000 7fcc1f800640 1 -- 172.21.15.194:0/1754735712 >> 172.21.15.194:0/1754735712 conn(0x7fcc180c4b40 msgr2=0x7fcc180c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.620+0000 7fcc1f800640 1 -- 172.21.15.194:0/1754735712 shutdown_connections 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.620+0000 7fcc1f800640 1 -- 172.21.15.194:0/1754735712 wait complete. 2024-03-07T10:21:50.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.621+0000 7fcc1f800640 1 Processor -- start 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.621+0000 7fcc1f800640 1 -- start start 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc181589c0 0x7fcc18149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc1814a3b0 0x7fcc181eb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18153050 con 0x7fcbf80039e0 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180c4340 con 0x7fcc1814a3b0 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.622+0000 7fcc1f800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181531d0 con 0x7fcc181589c0 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42336/0 (socket says 172.21.15.194:42336) 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1548834984 learned_addr learned my addr 172.21.15.194:0/1548834984 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc181589c0 0x7fcc18149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc181589c0 msgr2=0x7fcc18149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc181589c0 0x7fcc18149e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc1814a3b0 msgr2=0x7fcc181eb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc1814a3b0 0x7fcc181eb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 -- 172.21.15.194:0/1548834984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1814b0e0 con 0x7fcbf80039e0 2024-03-07T10:21:50.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.623+0000 7fcc1ce00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c360 tx=0x7fcc180c3bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.626+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08045070 con 0x7fcbf80039e0 2024-03-07T10:21:50.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.626+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc08000ed0 con 0x7fcbf80039e0 2024-03-07T10:21:50.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.626+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc181eeaa0 con 0x7fcbf80039e0 2024-03-07T10:21:50.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.626+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08007d10 con 0x7fcbf80039e0 2024-03-07T10:21:50.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.626+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc181ef060 con 0x7fcbf80039e0 2024-03-07T10:21:50.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.627+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc181eb190 con 0x7fcbf80039e0 2024-03-07T10:21:50.629 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.628+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcc08007070 con 0x7fcbf80039e0 2024-03-07T10:21:50.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.629+0000 7fcc14c00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 0x7fcbf406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:50.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.629+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fcc080ab5a0 con 0x7fcbf80039e0 2024-03-07T10:21:50.631 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.629+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 0x7fcbf406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:50.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.631+0000 7fcc17e00640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 0x7fcbf406d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc180c7a50 tx=0x7fcc0000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:50.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.638+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcc08079a20 con 0x7fcbf80039e0 2024-03-07T10:21:50.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.833+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc18068170 con 0x7fcbf80039e0 2024-03-07T10:21:50.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.835+0000 7fcc14c00640 1 -- 172.21.15.194:0/1548834984 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7fcc0807dac0 con 0x7fcbf80039e0 2024-03-07T10:21:50.837 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:50.837 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 msgr2=0x7fcbf406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 0x7fcbf406d990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcc180c7a50 tx=0x7fcc0000d040 comp rx=0 tx=0).stop 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 msgr2=0x7fcc1814aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800c360 tx=0x7fcc180c3bc0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 shutdown_connections 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcbf406b4d0 0x7fcbf406d990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcc1814a3b0 0x7fcc181eb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.841 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcc181589c0 0x7fcc18149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 --2- 172.21.15.194:0/1548834984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf80039e0 0x7fcc1814aba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:50.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 >> 172.21.15.194:0/1548834984 conn(0x7fcc180c4b40 msgr2=0x7fcc18150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:50.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 shutdown_connections 2024-03-07T10:21:50.842 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:50.838+0000 7fcc1f800640 1 -- 172.21.15.194:0/1548834984 wait complete. 2024-03-07T10:21:50.866 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:50.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:51.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.068+0000 7fbf21400640 1 Processor -- start 2024-03-07T10:21:51.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.068+0000 7fbf21400640 1 -- start start 2024-03-07T10:21:51.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.069+0000 7fbf21400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf1c152da0 0x7fbf1c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.069+0000 7fbf21400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb7a0 0x7fbf1c1560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.069+0000 7fbf21400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1c153180 con 0x7fbf1c0cb380 2024-03-07T10:21:51.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf21400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1c158f70 con 0x7fbf1c152da0 2024-03-07T10:21:51.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf21400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c159250 con 0x7fbf1c0cb7a0 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf1a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf1c152da0 0x7fbf1c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf1a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbf1c152da0 0x7fbf1c0c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42338/0 (socket says 172.21.15.194:42338) 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf1a800640 1 -- 172.21.15.194:0/413136124 learned_addr learned my addr 172.21.15.194:0/413136124 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf19e00640 1 --1- 172.21.15.194:0/413136124 >> v1:172.21.15.194:6789/0 conn(0x7fbf1c0cb380 0x7fbf1c155990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42132/0 (socket says 172.21.15.194:42132) 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.070+0000 7fbf1b200640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb7a0 0x7fbf1c1560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.071+0000 7fbf1a800640 1 -- 172.21.15.194:0/413136124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb7a0 msgr2=0x7fbf1c1560a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:51.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.071+0000 7fbf1a800640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb7a0 0x7fbf1c1560a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.071+0000 7fbf1a800640 1 -- 172.21.15.194:0/413136124 >> v1:172.21.15.194:6789/0 conn(0x7fbf1c0cb380 legacy=0x7fbf1c155990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.071+0000 7fbf1a800640 1 -- 172.21.15.194:0/413136124 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c159530 con 0x7fbf1c152da0 2024-03-07T10:21:51.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.071+0000 7fbf19400640 1 -- 172.21.15.194:0/413136124 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678792361 0 0) 0x7fbf1c153180 con 0x7fbf1c0cb380 2024-03-07T10:21:51.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf1a800640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0c8f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009870 tx=0x7fbf0c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda6fc10a545142d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf19400640 1 -- 172.21.15.194:0/413136124 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c034070 con 0x7fbf1c152da0 2024-03-07T10:21:51.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf19400640 1 -- 172.21.15.194:0/413136124 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c030840 con 0x7fbf1c152da0 2024-03-07T10:21:51.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf19400640 1 -- 172.21.15.194:0/413136124 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c030c10 con 0x7fbf1c152da0 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf21400640 1 -- 172.21.15.194:0/413136124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 msgr2=0x7fbf1c0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.073+0000 7fbf21400640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0c8f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009870 tx=0x7fbf0c02b980 comp rx=0 tx=0).stop 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 -- 172.21.15.194:0/413136124 shutdown_connections 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb7a0 0x7fbf1c1560a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 --2- 172.21.15.194:0/413136124 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0c8f10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 -- 172.21.15.194:0/413136124 >> 172.21.15.194:0/413136124 conn(0x7fbf1c066f70 msgr2=0x7fbf1c067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 -- 172.21.15.194:0/413136124 shutdown_connections 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.074+0000 7fbf21400640 1 -- 172.21.15.194:0/413136124 wait complete. 2024-03-07T10:21:51.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.075+0000 7fbf21400640 1 Processor -- start 2024-03-07T10:21:51.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.075+0000 7fbf21400640 1 -- start start 2024-03-07T10:21:51.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb380 0x7fbf1c14f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 0x7fbf1c14e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0be8c0 con 0x7fbf1c152da0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c1565e0 con 0x7fbf1c0cb7a0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.076+0000 7fbf21400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1c0c9450 con 0x7fbf1c0cb380 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42352/0 (socket says 172.21.15.194:42352) 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 -- 172.21.15.194:0/281275292 learned_addr learned my addr 172.21.15.194:0/281275292 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1a800640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb380 0x7fbf1c14f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf19e00640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 0x7fbf1c14e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 -- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb380 msgr2=0x7fbf1c14f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb380 0x7fbf1c14f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 -- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 msgr2=0x7fbf1c14e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 0x7fbf1c14e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 -- 172.21.15.194:0/281275292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c158ad0 con 0x7fbf1c152da0 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf19e00640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 0x7fbf1c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:51.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.077+0000 7fbf1b200640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbf14007d90 tx=0x7fbf1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.078+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14014420 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.078+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf14019070 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.078+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf14014820 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.078+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf1c14f960 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.078+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1c14dd10 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.079+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1c068170 con 0x7fbf1c152da0 2024-03-07T10:21:51.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.080+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbf140149c0 con 0x7fbf1c152da0 2024-03-07T10:21:51.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.081+0000 7fbf12a00640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 0x7fbefc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.081+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbf1408ae10 con 0x7fbf1c152da0 2024-03-07T10:21:51.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.082+0000 7fbf1a800640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 0x7fbefc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.083+0000 7fbf1a800640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 0x7fbefc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c036000 tx=0x7fbf0c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.085+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbf1408e030 con 0x7fbf1c152da0 2024-03-07T10:21:51.319 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.318+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbf1c0c5440 con 0x7fbf1c152da0 2024-03-07T10:21:51.320 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.319+0000 7fbf12a00640 1 -- 172.21.15.194:0/281275292 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbf140598e0 con 0x7fbf1c152da0 2024-03-07T10:21:51.320 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 msgr2=0x7fbefc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 0x7fbefc06d990 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c036000 tx=0x7fbf0c03b040 comp rx=0 tx=0).stop 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 msgr2=0x7fbf1c0bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbf14007d90 tx=0x7fbf1400e4b0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 shutdown_connections 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbefc06b4d0 0x7fbefc06d990 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.324 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbf1c152da0 0x7fbf1c0bef70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbf1c0cb7a0 0x7fbf1c14e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 --2- 172.21.15.194:0/281275292 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbf1c0cb380 0x7fbf1c14f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 >> 172.21.15.194:0/281275292 conn(0x7fbf1c066f70 msgr2=0x7fbf1c155990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:51.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 shutdown_connections 2024-03-07T10:21:51.325 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.322+0000 7fbf21400640 1 -- 172.21.15.194:0/281275292 wait complete. 2024-03-07T10:21:51.342 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.546+0000 7f9f01600640 1 Processor -- start 2024-03-07T10:21:51.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.546+0000 7f9f01600640 1 -- start start 2024-03-07T10:21:51.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9f01600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9efc0c8d90 0x7f9efc155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9f01600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc155b30 con 0x7f9efc14f7c0 2024-03-07T10:21:51.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9f01600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9efc155e10 con 0x7f9efc159020 2024-03-07T10:21:51.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9f01600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9efc1560f0 con 0x7f9efc0c8d90 2024-03-07T10:21:51.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9efbe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9efc14f7c0 0x7f9efc0c5810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42142/0 (socket says 172.21.15.194:42142) 2024-03-07T10:21:51.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.548+0000 7f9efbe00640 1 -- 172.21.15.194:0/1432181522 learned_addr learned my addr 172.21.15.194:0/1432181522 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/1432181522 >> v2:172.21.15.196:3300/0 conn(0x7f9efc0c8d90 0x7f9efc155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555171278 0 0) 0x7f9efc155b30 con 0x7f9efc14f7c0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee0003520 con 0x7f9efc14f7c0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 255321539 0 0) 0x7f9ee0003520 con 0x7f9efc14f7c0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 >> v2:172.21.15.196:3300/0 conn(0x7f9efc0c8d90 msgr2=0x7f9efc155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 --2- 172.21.15.194:0/1432181522 >> v2:172.21.15.196:3300/0 conn(0x7f9efc0c8d90 0x7f9efc155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 >> v1:172.21.15.196:6789/0 conn(0x7f9efc159020 legacy=0x7f9efc159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc1563d0 con 0x7f9efc14f7c0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f9eec001670 con 0x7f9efc14f7c0 2024-03-07T10:21:51.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 >> v1:172.21.15.194:6789/0 conn(0x7f9efc14f7c0 legacy=0x7f9efc0c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee00039b0 0x7f9ee0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee00051c0 0x7f9ee000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc1560f0 con 0x7f9ee0004800 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee000c160 con 0x7f9ee00039b0 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.549+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee000c360 con 0x7f9ee00051c0 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9efbe00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee00039b0 0x7f9ee0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9f00c00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee00051c0 0x7f9ee000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 -- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee00051c0 msgr2=0x7f9ee000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee00051c0 0x7f9ee000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 -- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee00039b0 msgr2=0x7f9ee0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ee00039b0 0x7f9ee0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9ef3e00640 1 -- 172.21.15.194:0/1432181522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0003520 con 0x7f9ee0004800 2024-03-07T10:21:51.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9f00c00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ee00051c0 0x7f9ee000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:51.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.550+0000 7f9f00c00640 1 -- 172.21.15.194:0/1432181522 reap_dead start 2024-03-07T10:21:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.551+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009ac0 tx=0x7f9ee0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88201b07c71efdd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.551+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4039070 con 0x7f9ee0004800 2024-03-07T10:21:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee402c6b0 con 0x7f9ee0004800 2024-03-07T10:21:51.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9efb400640 1 -- 172.21.15.194:0/1432181522 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4009690 con 0x7f9ee0004800 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9f01600640 1 -- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 msgr2=0x7f9ee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9f01600640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4009ac0 tx=0x7f9ee0005830 comp rx=0 tx=0).stop 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9f01600640 1 -- 172.21.15.194:0/1432181522 shutdown_connections 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9f01600640 1 --2- 172.21.15.194:0/1432181522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9ee0004c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.552+0000 7f9f01600640 1 -- 172.21.15.194:0/1432181522 >> 172.21.15.194:0/1432181522 conn(0x7f9efc06b4a0 msgr2=0x7f9efc06b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.553+0000 7f9f01600640 1 -- 172.21.15.194:0/1432181522 shutdown_connections 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.553+0000 7f9f01600640 1 -- 172.21.15.194:0/1432181522 wait complete. 2024-03-07T10:21:51.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.555+0000 7f9f01600640 1 Processor -- start 2024-03-07T10:21:51.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.555+0000 7f9f01600640 1 -- start start 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9efc154030 0x7f9efc149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9efc154c30 0x7f9efc149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc155550 con 0x7f9ee0004800 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc072890 con 0x7f9efc154c30 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f01600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9efc1556d0 con 0x7f9efc154030 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9efbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42384/0 (socket says 172.21.15.194:42384) 2024-03-07T10:21:51.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9efbe00640 1 -- 172.21.15.194:0/3949117494 learned_addr learned my addr 172.21.15.194:0/3949117494 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9f00c00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9efc154c30 0x7f9efc149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.557+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9efc154030 0x7f9efc149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 -- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9efc154030 msgr2=0x7f9efc149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9efc154030 0x7f9efc149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 -- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9efc154c30 msgr2=0x7f9efc149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9efc154c30 0x7f9efc149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 -- 172.21.15.194:0/3949117494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc149050 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9efbe00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e8f0 tx=0x7f9eec00edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00c870 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec018070 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00cc70 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.558+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9efc155170 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.559+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9efc1ec000 con 0x7f9ee0004800 2024-03-07T10:21:51.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.560+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9efc149220 con 0x7f9ee0004800 2024-03-07T10:21:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.560+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9eec013420 con 0x7f9ee0004800 2024-03-07T10:21:51.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.561+0000 7f9ef8c00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 0x7f9ed806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.561+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9eec08a180 con 0x7f9ee0004800 2024-03-07T10:21:51.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.562+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 0x7f9ed806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:51.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.563+0000 7f9ef3e00640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 0x7f9ed806d9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4036000 tx=0x7f9ee4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:51.567 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.566+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9eec058c50 con 0x7f9ee0004800 2024-03-07T10:21:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.864+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9efc158b80 con 0x7f9ee0004800 2024-03-07T10:21:51.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.865+0000 7f9ef8c00640 1 -- 172.21.15.194:0/3949117494 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f9efc158b80 con 0x7f9ee0004800 2024-03-07T10:21:51.867 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 msgr2=0x7f9ed806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 0x7f9ed806d9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4036000 tx=0x7f9ee4030000 comp rx=0 tx=0).stop 2024-03-07T10:21:51.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 msgr2=0x7f9efc1546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00e8f0 tx=0x7f9eec00edb0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 shutdown_connections 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9ed806b500 0x7f9ed806d9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9efc154c30 0x7f9efc149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9efc154030 0x7f9efc149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 --2- 172.21.15.194:0/3949117494 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ee0004800 0x7f9efc1546f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 >> 172.21.15.194:0/3949117494 conn(0x7f9efc06b4a0 msgr2=0x7f9efc159490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 shutdown_connections 2024-03-07T10:21:51.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:51.868+0000 7f9f01600640 1 -- 172.21.15.194:0/3949117494 wait complete. 2024-03-07T10:21:51.886 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:52.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.089+0000 7fa394200640 1 Processor -- start 2024-03-07T10:21:52.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.089+0000 7fa394200640 1 -- start start 2024-03-07T10:21:52.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.090+0000 7fa394200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 0x7fa38c0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa394200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa38c156f60 0x7fa38c157410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa394200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c154b90 con 0x7fa38c0a7c80 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa394200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0c58d0 con 0x7fa38c156f60 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa394200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c0c4510 con 0x7fa38c1547b0 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa390e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa38c0a7c80 0x7fa38c06fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42158/0 (socket says 172.21.15.194:42158) 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa390e00640 1 -- 172.21.15.194:0/2438156140 learned_addr learned my addr 172.21.15.194:0/2438156140 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa392200640 1 --2- 172.21.15.194:0/2438156140 >> v2:172.21.15.194:3300/0 conn(0x7fa38c156f60 0x7fa38c157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa391800640 1 --2- 172.21.15.194:0/2438156140 >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 0x7fa38c0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa38be00640 1 -- 172.21.15.194:0/2438156140 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35863259 0 0) 0x7fa38c154b90 con 0x7fa38c0a7c80 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.091+0000 7fa38be00640 1 -- 172.21.15.194:0/2438156140 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa374003520 con 0x7fa38c0a7c80 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.092+0000 7fa392200640 1 -- 172.21.15.194:0/2438156140 >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 msgr2=0x7fa38c0c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.092+0000 7fa392200640 1 --2- 172.21.15.194:0/2438156140 >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 0x7fa38c0c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.092+0000 7fa392200640 1 -- 172.21.15.194:0/2438156140 >> v1:172.21.15.194:6789/0 conn(0x7fa38c0a7c80 legacy=0x7fa38c06fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.092+0000 7fa392200640 1 -- 172.21.15.194:0/2438156140 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0c47f0 con 0x7fa38c156f60 2024-03-07T10:21:52.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.092+0000 7fa391800640 1 --2- 172.21.15.194:0/2438156140 >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 0x7fa38c0c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.093+0000 7fa392200640 1 --2- 172.21.15.194:0/2438156140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c156f60 0x7fa38c157410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0c3ea0 tx=0x7fa38402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d614acf076db1c server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.093+0000 7fa38be00640 1 -- 172.21.15.194:0/2438156140 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384039070 con 0x7fa38c156f60 2024-03-07T10:21:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.093+0000 7fa38be00640 1 -- 172.21.15.194:0/2438156140 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38402cc80 con 0x7fa38c156f60 2024-03-07T10:21:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.093+0000 7fa38be00640 1 -- 172.21.15.194:0/2438156140 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa384034640 con 0x7fa38c156f60 2024-03-07T10:21:52.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 -- 172.21.15.194:0/2438156140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c156f60 msgr2=0x7fa38c157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 --2- 172.21.15.194:0/2438156140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c156f60 0x7fa38c157410 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0c3ea0 tx=0x7fa38402bed0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 -- 172.21.15.194:0/2438156140 shutdown_connections 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 --2- 172.21.15.194:0/2438156140 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c156f60 0x7fa38c157410 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 --2- 172.21.15.194:0/2438156140 >> v2:172.21.15.196:3300/0 conn(0x7fa38c1547b0 0x7fa38c0c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 -- 172.21.15.194:0/2438156140 >> 172.21.15.194:0/2438156140 conn(0x7fa38c06eca0 msgr2=0x7fa38c06f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 -- 172.21.15.194:0/2438156140 shutdown_connections 2024-03-07T10:21:52.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.094+0000 7fa394200640 1 -- 172.21.15.194:0/2438156140 wait complete. 2024-03-07T10:21:52.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.095+0000 7fa394200640 1 Processor -- start 2024-03-07T10:21:52.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 -- start start 2024-03-07T10:21:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 0x7fa38c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 0x7fa38c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0c41a0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0c6200 con 0x7fa38c156f60 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.096+0000 7fa394200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0703a0 con 0x7fa38c1547b0 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42412/0 (socket says 172.21.15.194:42412) 2024-03-07T10:21:52.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 -- 172.21.15.194:0/2990196414 learned_addr learned my addr 172.21.15.194:0/2990196414 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:52.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa390e00640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 0x7fa38c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa392200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 0x7fa38c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 -- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 msgr2=0x7fa38c1575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 0x7fa38c1575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 -- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 msgr2=0x7fa38c14ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 0x7fa38c14ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa391800640 1 -- 172.21.15.194:0/2990196414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c1ed1a0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa390e00640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 0x7fa38c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.097+0000 7fa392200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 0x7fa38c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa391800640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa38000e7e0 tx=0x7fa38000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000f040 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa380004030 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380004400 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c1ec3e0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.098+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c1ec9a0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.099+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c068880 con 0x7fa38c0a7c80 2024-03-07T10:21:52.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.100+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa38000c6d0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.101+0000 7fa389600640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 0x7fa36c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.101+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fa38008a2a0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.102+0000 7fa390e00640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 0x7fa36c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.103+0000 7fa390e00640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 0x7fa36c06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0abb80 tx=0x7fa378009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.105+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa380017020 con 0x7fa38c0a7c80 2024-03-07T10:21:52.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.292+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7fa38c0c64d0 con 0x7fa38c0a7c80 2024-03-07T10:21:52.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.292+0000 7fa389600640 1 -- 172.21.15.194:0/2990196414 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fa380058e10 con 0x7fa38c0a7c80 2024-03-07T10:21:52.294 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 msgr2=0x7fa36c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 0x7fa36c06d990 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0abb80 tx=0x7fa378009040 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 msgr2=0x7fa38c0c0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa38000e7e0 tx=0x7fa38000eca0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 shutdown_connections 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa36c06b4d0 0x7fa36c06d990 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa38c156f60 0x7fa38c14ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa38c1547b0 0x7fa38c1575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 --2- 172.21.15.194:0/2990196414 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa38c0a7c80 0x7fa38c0c0010 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 >> 172.21.15.194:0/2990196414 conn(0x7fa38c06eca0 msgr2=0x7fa38c0c6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:52.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 shutdown_connections 2024-03-07T10:21:52.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.295+0000 7fa394200640 1 -- 172.21.15.194:0/2990196414 wait complete. 2024-03-07T10:21:52.314 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:52.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.514+0000 7fbeca200640 1 Processor -- start 2024-03-07T10:21:52.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.515+0000 7fbeca200640 1 -- start start 2024-03-07T10:21:52.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.516+0000 7fbeca200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbec4152f80 0x7fbec40c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.516+0000 7fbeca200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.516+0000 7fbeca200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec40ad690 con 0x7fbec406d5a0 2024-03-07T10:21:52.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.516+0000 7fbeca200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec40c8f80 con 0x7fbec4152f80 2024-03-07T10:21:52.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.516+0000 7fbeca200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec40ad970 con 0x7fbec4155e40 2024-03-07T10:21:52.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbec4152f80 0x7fbec40c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:57286/0 (socket says 172.21.15.194:57286) 2024-03-07T10:21:52.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 -- 172.21.15.194:0/1933697689 learned_addr learned my addr 172.21.15.194:0/1933697689 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:52.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 -- 172.21.15.194:0/1933697689 >> v2:172.21.15.196:3300/0 conn(0x7fbec4152f80 msgr2=0x7fbec40c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:52.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 --2- 172.21.15.194:0/1933697689 >> v2:172.21.15.196:3300/0 conn(0x7fbec4152f80 0x7fbec40c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 -- 172.21.15.194:0/1933697689 >> v1:172.21.15.196:6789/0 conn(0x7fbec406d5a0 legacy=0x7fbec406c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.517+0000 7fbec3e00640 1 -- 172.21.15.194:0/1933697689 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40c5a00 con 0x7fbec4155e40 2024-03-07T10:21:52.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.519+0000 7fbec3e00640 1 --2- 172.21.15.194:0/1933697689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009870 tx=0x7fbebc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d7ae6f6c9b9436b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.519+0000 7fbec2000640 1 -- 172.21.15.194:0/1933697689 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc034070 con 0x7fbec4155e40 2024-03-07T10:21:52.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.519+0000 7fbec2000640 1 -- 172.21.15.194:0/1933697689 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc030840 con 0x7fbec4155e40 2024-03-07T10:21:52.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.519+0000 7fbec2000640 1 -- 172.21.15.194:0/1933697689 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc030c10 con 0x7fbec4155e40 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 -- 172.21.15.194:0/1933697689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 msgr2=0x7fbec41562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 --2- 172.21.15.194:0/1933697689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbebc009870 tx=0x7fbebc02b980 comp rx=0 tx=0).stop 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 -- 172.21.15.194:0/1933697689 shutdown_connections 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 --2- 172.21.15.194:0/1933697689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec41562d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 --2- 172.21.15.194:0/1933697689 >> v2:172.21.15.196:3300/0 conn(0x7fbec4152f80 0x7fbec40c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 -- 172.21.15.194:0/1933697689 >> 172.21.15.194:0/1933697689 conn(0x7fbec40acb70 msgr2=0x7fbec40acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 -- 172.21.15.194:0/1933697689 shutdown_connections 2024-03-07T10:21:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.520+0000 7fbeca200640 1 -- 172.21.15.194:0/1933697689 wait complete. 2024-03-07T10:21:52.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.521+0000 7fbeca200640 1 Processor -- start 2024-03-07T10:21:52.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 -- start start 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec406d5a0 0x7fbec4157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec40b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec406d080 con 0x7fbec4152f80 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec4153360 con 0x7fbec406d5a0 2024-03-07T10:21:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.522+0000 7fbeca200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec406d200 con 0x7fbec4155e40 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42420/0 (socket says 172.21.15.194:42420) 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 -- 172.21.15.194:0/2127203522 learned_addr learned my addr 172.21.15.194:0/2127203522 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec3400640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec406d5a0 0x7fbec4157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec3e00640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec40b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 -- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 msgr2=0x7fbec40b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec40b03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 -- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec406d5a0 msgr2=0x7fbec4157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec406d5a0 0x7fbec4157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.523+0000 7fbec2a00640 1 -- 172.21.15.194:0/2127203522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40bf150 con 0x7fbec4152f80 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbec2a00640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c3f0 tx=0x7fbeac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac0052d0 con 0x7fbec4152f80 2024-03-07T10:21:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeac005490 con 0x7fbec4152f80 2024-03-07T10:21:52.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeac007260 con 0x7fbec4152f80 2024-03-07T10:21:52.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec40c1c60 con 0x7fbec4152f80 2024-03-07T10:21:52.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.524+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec41ef210 con 0x7fbec4152f80 2024-03-07T10:21:52.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.525+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec41ef410 con 0x7fbec4152f80 2024-03-07T10:21:52.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.526+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbeac007400 con 0x7fbec4152f80 2024-03-07T10:21:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.527+0000 7fbebb400640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 0x7fbea006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.528+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbeac0899f0 con 0x7fbec4152f80 2024-03-07T10:21:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.528+0000 7fbec3400640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 0x7fbea006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.529+0000 7fbec3400640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 0x7fbea006d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbec414e660 tx=0x7fbeb400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.531+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbec41ef410 con 0x7fbec4152f80 2024-03-07T10:21:52.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.722+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbec4068880 con 0x7fbec4152f80 2024-03-07T10:21:52.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.723+0000 7fbebb400640 1 -- 172.21.15.194:0/2127203522 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fbeac058560 con 0x7fbec4152f80 2024-03-07T10:21:52.725 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 msgr2=0x7fbea006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 0x7fbea006d990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbec414e660 tx=0x7fbeb400b040 comp rx=0 tx=0).stop 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 msgr2=0x7fbec41551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00c3f0 tx=0x7fbeac00c8b0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 shutdown_connections 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbea006b4d0 0x7fbea006d990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.728 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbec4155e40 0x7fbec40b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbec4152f80 0x7fbec41551c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.725+0000 7fbeca200640 1 --2- 172.21.15.194:0/2127203522 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbec406d5a0 0x7fbec4157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.726+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 >> 172.21.15.194:0/2127203522 conn(0x7fbec40acb70 msgr2=0x7fbec40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:52.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.726+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 shutdown_connections 2024-03-07T10:21:52.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.726+0000 7fbeca200640 1 -- 172.21.15.194:0/2127203522 wait complete. 2024-03-07T10:21:52.746 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:52.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.952+0000 7fbd7ea00640 1 Processor -- start 2024-03-07T10:21:52.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.952+0000 7fbd7ea00640 1 -- start start 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd78150af0 0x7fbd78157610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7ea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbd780c8770 0x7fbd78153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7ea00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd780a80b0 con 0x7fbd78153a60 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd780a7e60 con 0x7fbd78150af0 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7ea00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd78156b30 con 0x7fbd780c8770 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd78150af0 0x7fbd78157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd78150af0 0x7fbd78157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42432/0 (socket says 172.21.15.194:42432) 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7d600640 1 -- 172.21.15.194:0/2784999420 learned_addr learned my addr 172.21.15.194:0/2784999420 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:52.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.954+0000 7fbd7d600640 1 -- 172.21.15.194:0/2784999420 >> v2:172.21.15.196:3300/0 conn(0x7fbd780c8770 msgr2=0x7fbd78153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.955+0000 7fbd7d600640 1 --2- 172.21.15.194:0/2784999420 >> v2:172.21.15.196:3300/0 conn(0x7fbd780c8770 0x7fbd78153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.955+0000 7fbd7d600640 1 -- 172.21.15.194:0/2784999420 >> v1:172.21.15.196:6789/0 conn(0x7fbd78153a60 legacy=0x7fbd780c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:52.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.955+0000 7fbd7d600640 1 -- 172.21.15.194:0/2784999420 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78156e10 con 0x7fbd78150af0 2024-03-07T10:21:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd7d600640 1 --2- 172.21.15.194:0/2784999420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150af0 0x7fbd78157610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd78157b50 tx=0x7fbd6c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e14e5e1c3ad27c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd77e00640 1 -- 172.21.15.194:0/2784999420 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c02e070 con 0x7fbd78150af0 2024-03-07T10:21:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd77e00640 1 -- 172.21.15.194:0/2784999420 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c037070 con 0x7fbd78150af0 2024-03-07T10:21:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd77e00640 1 -- 172.21.15.194:0/2784999420 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c031a00 con 0x7fbd78150af0 2024-03-07T10:21:52.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd7ea00640 1 -- 172.21.15.194:0/2784999420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150af0 msgr2=0x7fbd78157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.956+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/2784999420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150af0 0x7fbd78157610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbd78157b50 tx=0x7fbd6c02b880 comp rx=0 tx=0).stop 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 -- 172.21.15.194:0/2784999420 shutdown_connections 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/2784999420 >> v2:172.21.15.196:3300/0 conn(0x7fbd780c8770 0x7fbd78153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/2784999420 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78150af0 0x7fbd78157610 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 -- 172.21.15.194:0/2784999420 >> 172.21.15.194:0/2784999420 conn(0x7fbd7806d290 msgr2=0x7fbd7806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 -- 172.21.15.194:0/2784999420 shutdown_connections 2024-03-07T10:21:52.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.957+0000 7fbd7ea00640 1 -- 172.21.15.194:0/2784999420 wait complete. 2024-03-07T10:21:52.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.959+0000 7fbd7ea00640 1 Processor -- start 2024-03-07T10:21:52.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.960+0000 7fbd7ea00640 1 -- start start 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd78150af0 0x7fbd781ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 0x7fbd781eb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780c9350 con 0x7fbd78153a60 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd78150ed0 con 0x7fbd7806ca10 2024-03-07T10:21:52.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7ea00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd780c94d0 con 0x7fbd78150af0 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42448/0 (socket says 172.21.15.194:42448) 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 -- 172.21.15.194:0/3855301596 learned_addr learned my addr 172.21.15.194:0/3855301596 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7d600640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd78150af0 0x7fbd781ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7e000640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 0x7fbd781eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 -- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd78150af0 msgr2=0x7fbd781ef0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd78150af0 0x7fbd781ef0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 -- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 msgr2=0x7fbd781eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 0x7fbd781eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7cc00640 1 -- 172.21.15.194:0/3855301596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7806b9f0 con 0x7fbd78153a60 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.962+0000 7fbd7e000640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 0x7fbd781eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:52.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd7cc00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b4a0 tx=0x7fbd6400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64014070 con 0x7fbd78153a60 2024-03-07T10:21:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64010610 con 0x7fbd78153a60 2024-03-07T10:21:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64010a00 con 0x7fbd78153a60 2024-03-07T10:21:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd7806bcd0 con 0x7fbd78153a60 2024-03-07T10:21:52.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.963+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd78147b60 con 0x7fbd78153a60 2024-03-07T10:21:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.964+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd78075600 con 0x7fbd78153a60 2024-03-07T10:21:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.965+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbd64017070 con 0x7fbd78153a60 2024-03-07T10:21:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.966+0000 7fbd75600640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.966+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbd64089fd0 con 0x7fbd78153a60 2024-03-07T10:21:52.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.967+0000 7fbd7d600640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:52.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.968+0000 7fbd7d600640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c036000 tx=0x7fbd6c03d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:52.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:52.975+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbd64058aa0 con 0x7fbd78153a60 2024-03-07T10:21:53.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.171+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fbd780a7c40 con 0x7fbd78153a60 2024-03-07T10:21:53.175 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.172+0000 7fbd75600640 1 -- 172.21.15.194:0/3855301596 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7fbd640583a0 con 0x7fbd78153a60 2024-03-07T10:21:53.175 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:53.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.174+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 msgr2=0x7fbd5806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.177 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.174+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c036000 tx=0x7fbd6c03d040 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 msgr2=0x7fbd78147620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400b4a0 tx=0x7fbd6400b960 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 shutdown_connections 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbd5806b4d0 0x7fbd5806d990 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbd7806ca10 0x7fbd781eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd78153a60 0x7fbd78147620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 --2- 172.21.15.194:0/3855301596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbd78150af0 0x7fbd781ef0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 >> 172.21.15.194:0/3855301596 conn(0x7fbd7806d290 msgr2=0x7fbd780accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 shutdown_connections 2024-03-07T10:21:53.178 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.175+0000 7fbd7ea00640 1 -- 172.21.15.194:0/3855301596 wait complete. 2024-03-07T10:21:53.195 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:53.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.390+0000 7f5279000640 1 Processor -- start 2024-03-07T10:21:53.393 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.390+0000 7f5279000640 1 -- start start 2024-03-07T10:21:53.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5279000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5274150b70 0x7f52740a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5279000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274156c20 0x7f527406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5279000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5274153980 con 0x7f52740a9a10 2024-03-07T10:21:53.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5279000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527406e550 con 0x7f5274150b70 2024-03-07T10:21:53.395 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5279000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5274153c60 con 0x7f5274156c20 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5271e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5274150b70 0x7f52740a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5271e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5274150b70 0x7f52740a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42452/0 (socket says 172.21.15.194:42452) 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5271e00640 1 -- 172.21.15.194:0/3294867941 learned_addr learned my addr 172.21.15.194:0/3294867941 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.392+0000 7f5271400640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274156c20 0x7f527406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.393+0000 7f5271e00640 1 -- 172.21.15.194:0/3294867941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274156c20 msgr2=0x7f527406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.393+0000 7f5271e00640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274156c20 0x7f527406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.393+0000 7f5271e00640 1 -- 172.21.15.194:0/3294867941 >> v1:172.21.15.196:6789/0 conn(0x7f52740a9a10 legacy=0x7f527406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.396 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.393+0000 7f5271e00640 1 -- 172.21.15.194:0/3294867941 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274153f40 con 0x7f5274150b70 2024-03-07T10:21:53.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.394+0000 7f5271e00640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5274150b70 0x7f52740a94d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f526402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6a13f868e2a137 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.394+0000 7f5270a00640 1 -- 172.21.15.194:0/3294867941 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264035020 con 0x7f5274150b70 2024-03-07T10:21:53.397 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.394+0000 7f5270a00640 1 -- 172.21.15.194:0/3294867941 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5264031640 con 0x7f5274150b70 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.394+0000 7f5270a00640 1 -- 172.21.15.194:0/3294867941 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526402d040 con 0x7f5274150b70 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 -- 172.21.15.194:0/3294867941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5274150b70 msgr2=0x7f52740a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5274150b70 0x7f52740a94d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f5264009870 tx=0x7f526402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 -- 172.21.15.194:0/3294867941 shutdown_connections 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274156c20 0x7f527406d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 --2- 172.21.15.194:0/3294867941 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5274150b70 0x7f52740a94d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 -- 172.21.15.194:0/3294867941 >> 172.21.15.194:0/3294867941 conn(0x7f527406b840 msgr2=0x7f52740c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 -- 172.21.15.194:0/3294867941 shutdown_connections 2024-03-07T10:21:53.398 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.395+0000 7f5279000640 1 -- 172.21.15.194:0/3294867941 wait complete. 2024-03-07T10:21:53.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.396+0000 7f5279000640 1 Processor -- start 2024-03-07T10:21:53.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 -- start start 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274150b70 0x7f5274155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5274156c20 0x7f52741ef2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5274153630 con 0x7f52740a9a10 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52740c7a30 con 0x7f5274156c20 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.397+0000 7f5279000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52740ac460 con 0x7f5274150b70 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42462/0 (socket says 172.21.15.194:42462) 2024-03-07T10:21:53.400 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 -- 172.21.15.194:0/86363998 learned_addr learned my addr 172.21.15.194:0/86363998 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:53.401 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 -- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274150b70 msgr2=0x7f5274155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274150b70 0x7f5274155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 -- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5274156c20 msgr2=0x7f52741ef2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5274156c20 0x7f52741ef2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 -- 172.21.15.194:0/86363998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5274072710 con 0x7f52740a9a10 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.398+0000 7f5271e00640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f526402b930 tx=0x7f52640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.399+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264040070 con 0x7f52740a9a10 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.399+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526403e070 con 0x7f52740a9a10 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.399+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264035040 con 0x7f52740a9a10 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.399+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52740729f0 con 0x7f52740a9a10 2024-03-07T10:21:53.402 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.399+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5274155ff0 con 0x7f52740a9a10 2024-03-07T10:21:53.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.400+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5274068170 con 0x7f52740a9a10 2024-03-07T10:21:53.403 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.401+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5264038020 con 0x7f52740a9a10 2024-03-07T10:21:53.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.402+0000 7f526a000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.404 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.402+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f52640abff0 con 0x7f52740a9a10 2024-03-07T10:21:53.405 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.403+0000 7f5271400640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.406 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.404+0000 7f5271400640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 0x7f525406d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52740c1490 tx=0x7f5260008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.407+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f526407aac0 con 0x7f52740a9a10 2024-03-07T10:21:53.701 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.699+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f527406cd20 con 0x7f52740a9a10 2024-03-07T10:21:53.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.700+0000 7f526a000640 1 -- 172.21.15.194:0/86363998 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f526407a3c0 con 0x7f52740a9a10 2024-03-07T10:21:53.703 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:53.703 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:53.703 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 msgr2=0x7f525406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 0x7f525406d990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52740c1490 tx=0x7f5260008040 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 msgr2=0x7f52741eb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f526402b930 tx=0x7f52640046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 shutdown_connections 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f525406b4d0 0x7f525406d990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5274156c20 0x7f52741ef2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5274150b70 0x7f5274155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 --2- 172.21.15.194:0/86363998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52740a9a10 0x7f52741eb5c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 >> 172.21.15.194:0/86363998 conn(0x7f527406b840 msgr2=0x7f527414ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 shutdown_connections 2024-03-07T10:21:53.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.703+0000 7f5279000640 1 -- 172.21.15.194:0/86363998 wait complete. 2024-03-07T10:21:53.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:53.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.923+0000 7f4e89800640 1 Processor -- start 2024-03-07T10:21:53.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.923+0000 7f4e89800640 1 -- start start 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.924+0000 7f4e89800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84150b70 0x7f4e840a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.924+0000 7f4e89800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e84156c20 0x7f4e8406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.924+0000 7f4e89800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e84153980 con 0x7f4e840a9a10 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.924+0000 7f4e89800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8406e550 con 0x7f4e84156c20 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.924+0000 7f4e89800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84153c60 con 0x7f4e84150b70 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e84156c20 0x7f4e8406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e84156c20 0x7f4e8406d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42474/0 (socket says 172.21.15.194:42474) 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 -- 172.21.15.194:0/4259223120 learned_addr learned my addr 172.21.15.194:0/4259223120 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 -- 172.21.15.194:0/4259223120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84150b70 msgr2=0x7f4e840a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e82a00640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84150b70 0x7f4e840a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84150b70 0x7f4e840a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 -- 172.21.15.194:0/4259223120 >> v1:172.21.15.196:6789/0 conn(0x7f4e840a9a10 legacy=0x7f4e8406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:53.929 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.925+0000 7f4e7be00640 1 -- 172.21.15.194:0/4259223120 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84153f40 con 0x7f4e84156c20 2024-03-07T10:21:53.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.926+0000 7f4e7be00640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e84156c20 0x7f4e8406d900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009870 tx=0x7f4e6c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52966b82d880782e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e82000640 1 -- 172.21.15.194:0/4259223120 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0317c0 con 0x7f4e84156c20 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e82000640 1 -- 172.21.15.194:0/4259223120 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6c037070 con 0x7f4e84156c20 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e82000640 1 -- 172.21.15.194:0/4259223120 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c031b80 con 0x7f4e84156c20 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 -- 172.21.15.194:0/4259223120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e84156c20 msgr2=0x7f4e8406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e84156c20 0x7f4e8406d900 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009870 tx=0x7f4e6c02b860 comp rx=0 tx=0).stop 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 -- 172.21.15.194:0/4259223120 shutdown_connections 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e84156c20 0x7f4e8406d900 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 --2- 172.21.15.194:0/4259223120 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84150b70 0x7f4e840a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.927+0000 7f4e89800640 1 -- 172.21.15.194:0/4259223120 >> 172.21.15.194:0/4259223120 conn(0x7f4e8406b840 msgr2=0x7f4e840c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.928+0000 7f4e89800640 1 -- 172.21.15.194:0/4259223120 shutdown_connections 2024-03-07T10:21:53.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.928+0000 7f4e89800640 1 -- 172.21.15.194:0/4259223120 wait complete. 2024-03-07T10:21:53.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.929+0000 7f4e89800640 1 Processor -- start 2024-03-07T10:21:53.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.929+0000 7f4e89800640 1 -- start start 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e84150b70 0x7f4e841431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84156c20 0x7f4e84143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e84153630 con 0x7f4e840a9a10 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c7a30 con 0x7f4e84150b70 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e89800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840ac460 con 0x7f4e84156c20 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e82a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e82a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42488/0 (socket says 172.21.15.194:42488) 2024-03-07T10:21:53.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.930+0000 7f4e82a00640 1 -- 172.21.15.194:0/1859105332 learned_addr learned my addr 172.21.15.194:0/1859105332 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e83400640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84156c20 0x7f4e84143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 -- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84156c20 msgr2=0x7f4e84143720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e7be00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e84150b70 0x7f4e841431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84156c20 0x7f4e84143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 -- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e84150b70 msgr2=0x7f4e841431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e84150b70 0x7f4e841431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 -- 172.21.15.194:0/1859105332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e84152d90 con 0x7f4e840a9a10 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.931+0000 7f4e82a00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c7f0 tx=0x7f4e7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.932+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74015070 con 0x7f4e840a9a10 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.932+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74004220 con 0x7f4e840a9a10 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.932+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e841440b0 con 0x7f4e840a9a10 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.932+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74007620 con 0x7f4e840a9a10 2024-03-07T10:21:53.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.932+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e841496c0 con 0x7f4e840a9a10 2024-03-07T10:21:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.933+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e84068170 con 0x7f4e840a9a10 2024-03-07T10:21:53.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.934+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4e740079d0 con 0x7f4e840a9a10 2024-03-07T10:21:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.935+0000 7f4e7aa00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 0x7f4e6006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:53.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.936+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f4e7408a840 con 0x7f4e840a9a10 2024-03-07T10:21:53.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.936+0000 7f4e7be00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 0x7f4e6006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:53.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.937+0000 7f4e7be00640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 0x7f4e6006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c036000 tx=0x7f4e6c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:53.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:53.939+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4e740593b0 con 0x7f4e840a9a10 2024-03-07T10:21:54.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.135+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e8406cd20 con 0x7f4e840a9a10 2024-03-07T10:21:54.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.137+0000 7f4e7aa00640 1 -- 172.21.15.194:0/1859105332 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7f4e74058cb0 con 0x7f4e840a9a10 2024-03-07T10:21:54.140 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:54.140 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 msgr2=0x7f4e6006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 0x7f4e6006d990 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c036000 tx=0x7f4e6c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 msgr2=0x7f4e84149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400c7f0 tx=0x7f4e7400ccb0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 shutdown_connections 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4e6006b4d0 0x7f4e6006d990 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4e84156c20 0x7f4e84143720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4e84150b70 0x7f4e841431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 --2- 172.21.15.194:0/1859105332 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e840a9a10 0x7f4e84149180 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 >> 172.21.15.194:0/1859105332 conn(0x7f4e8406b840 msgr2=0x7f4e840c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 shutdown_connections 2024-03-07T10:21:54.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.140+0000 7f4e89800640 1 -- 172.21.15.194:0/1859105332 wait complete. 2024-03-07T10:21:54.162 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:54.162 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-03-07T10:21:54.162 INFO:tasks.mds_thrash.fs.[a]:waiting for 85 secs before thrashing 2024-03-07T10:21:54.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.349+0000 7f2e7e000640 1 Processor -- start 2024-03-07T10:21:54.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.349+0000 7f2e7e000640 1 -- start start 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e78148f40 0x7f2e781539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e780c19c0 0x7f2e78153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2e78155af0 0x7f2e78155f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78073240 con 0x7f2e78148f40 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7806e000 con 0x7f2e78155af0 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e7e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e781568e0 con 0x7f2e780c19c0 2024-03-07T10:21:54.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e77400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e78148f40 0x7f2e781539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e77400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e78148f40 0x7f2e781539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42490/0 (socket says 172.21.15.194:42490) 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.350+0000 7f2e77400640 1 -- 172.21.15.194:0/555942062 learned_addr learned my addr 172.21.15.194:0/555942062 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77e00640 1 --2- 172.21.15.194:0/555942062 >> v2:172.21.15.196:3300/0 conn(0x7f2e78155af0 0x7f2e78155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e6ea00640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e780c19c0 0x7f2e78153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77400640 1 -- 172.21.15.194:0/555942062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e780c19c0 msgr2=0x7f2e78153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77400640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e780c19c0 0x7f2e78153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77400640 1 -- 172.21.15.194:0/555942062 >> v2:172.21.15.196:3300/0 conn(0x7f2e78155af0 msgr2=0x7f2e78155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77400640 1 --2- 172.21.15.194:0/555942062 >> v2:172.21.15.196:3300/0 conn(0x7f2e78155af0 0x7f2e78155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.351+0000 7f2e77400640 1 -- 172.21.15.194:0/555942062 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7806d6d0 con 0x7f2e78148f40 2024-03-07T10:21:54.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.352+0000 7f2e77400640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e78148f40 0x7f2e781539f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2e78150040 tx=0x7f2e6802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3786cbb587357f38 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.352+0000 7f2e76a00640 1 -- 172.21.15.194:0/555942062 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68035020 con 0x7f2e78148f40 2024-03-07T10:21:54.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.352+0000 7f2e76a00640 1 -- 172.21.15.194:0/555942062 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68031870 con 0x7f2e78148f40 2024-03-07T10:21:54.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.352+0000 7f2e76a00640 1 -- 172.21.15.194:0/555942062 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68031c40 con 0x7f2e78148f40 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 -- 172.21.15.194:0/555942062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e78148f40 msgr2=0x7f2e781539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e78148f40 0x7f2e781539f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2e78150040 tx=0x7f2e6802b910 comp rx=0 tx=0).stop 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 -- 172.21.15.194:0/555942062 shutdown_connections 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 --2- 172.21.15.194:0/555942062 >> v2:172.21.15.196:3300/0 conn(0x7f2e78155af0 0x7f2e78155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e780c19c0 0x7f2e78153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 --2- 172.21.15.194:0/555942062 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e78148f40 0x7f2e781539f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 -- 172.21.15.194:0/555942062 >> 172.21.15.194:0/555942062 conn(0x7f2e7806b840 msgr2=0x7f2e780c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:54.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 -- 172.21.15.194:0/555942062 shutdown_connections 2024-03-07T10:21:54.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.353+0000 7f2e7e000640 1 -- 172.21.15.194:0/555942062 wait complete. 2024-03-07T10:21:54.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.355+0000 7f2e7e000640 1 Processor -- start 2024-03-07T10:21:54.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.355+0000 7f2e7e000640 1 -- start start 2024-03-07T10:21:54.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e78148f40 0x7f2e78155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e78155af0 0x7f2e781de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78149320 con 0x7f2e780c19c0 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7806dc90 con 0x7f2e78148f40 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e7e000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7806e490 con 0x7f2e78155af0 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42500/0 (socket says 172.21.15.194:42500) 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 -- 172.21.15.194:0/169293092 learned_addr learned my addr 172.21.15.194:0/169293092 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e6ea00640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e78148f40 0x7f2e78155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 -- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e78155af0 msgr2=0x7f2e781de620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e78155af0 0x7f2e781de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 -- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e78148f40 msgr2=0x7f2e78155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e78148f40 0x7f2e78155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.356+0000 7f2e77400640 1 -- 172.21.15.194:0/169293092 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780c6820 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e77400640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e68000c00 tx=0x7f2e680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68035040 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68045480 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e780c4bb0 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68045870 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.357+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e781dc3d0 con 0x7f2e780c19c0 2024-03-07T10:21:54.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.358+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e780c1570 con 0x7f2e780c19c0 2024-03-07T10:21:54.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.360+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f2e68038020 con 0x7f2e780c19c0 2024-03-07T10:21:54.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.361+0000 7f2e6fe00640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 0x7f2e5406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.361+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2e680ac920 con 0x7f2e780c19c0 2024-03-07T10:21:54.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.362+0000 7f2e6ea00640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 0x7f2e5406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.363+0000 7f2e6ea00640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 0x7f2e5406d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e78155ac0 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.366+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2e780c1570 con 0x7f2e780c19c0 2024-03-07T10:21:54.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.561+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e78068170 con 0x7f2e780c19c0 2024-03-07T10:21:54.566 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.563+0000 7f2e6fe00640 1 -- 172.21.15.194:0/169293092 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7f2e780c6820 con 0x7f2e780c19c0 2024-03-07T10:21:54.566 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:54.566 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 msgr2=0x7f2e5406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 0x7f2e5406d9c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2e78155ac0 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 msgr2=0x7f2e781ec110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2e68000c00 tx=0x7f2e680046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 shutdown_connections 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e5406b500 0x7f2e5406d9c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e78155af0 0x7f2e781de620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e78148f40 0x7f2e78155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 --2- 172.21.15.194:0/169293092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e780c19c0 0x7f2e781ec110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 >> 172.21.15.194:0/169293092 conn(0x7f2e7806b840 msgr2=0x7f2e78147ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:54.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 shutdown_connections 2024-03-07T10:21:54.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.566+0000 7f2e7e000640 1 -- 172.21.15.194:0/169293092 wait complete. 2024-03-07T10:21:54.586 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:21:54.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:21:54.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.783+0000 7f5c99200640 1 Processor -- start 2024-03-07T10:21:54.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.783+0000 7f5c99200640 1 -- start start 2024-03-07T10:21:54.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.784+0000 7f5c99200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.784+0000 7f5c99200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5c940ab340 0x7f5c940a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.784+0000 7f5c99200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c94153760 con 0x7f5c940ab7c0 2024-03-07T10:21:54.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.784+0000 7f5c99200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9406daf0 con 0x7f5c940ab340 2024-03-07T10:21:54.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.784+0000 7f5c99200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9406dd40 con 0x7f5c9414d6e0 2024-03-07T10:21:54.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.785+0000 7f5c91e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.785+0000 7f5c91e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:57372/0 (socket says 172.21.15.194:57372) 2024-03-07T10:21:54.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.785+0000 7f5c91e00640 1 -- 172.21.15.194:0/2175106596 learned_addr learned my addr 172.21.15.194:0/2175106596 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:54.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.785+0000 7f5c89400640 1 --2- 172.21.15.194:0/2175106596 >> v2:172.21.15.196:3300/0 conn(0x7f5c940ab340 0x7f5c940a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.786+0000 7f5c91e00640 1 -- 172.21.15.194:0/2175106596 >> v2:172.21.15.196:3300/0 conn(0x7f5c940ab340 msgr2=0x7f5c940a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.786+0000 7f5c91e00640 1 --2- 172.21.15.194:0/2175106596 >> v2:172.21.15.196:3300/0 conn(0x7f5c940ab340 0x7f5c940a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.786+0000 7f5c91e00640 1 -- 172.21.15.194:0/2175106596 >> v1:172.21.15.196:6789/0 conn(0x7f5c940ab7c0 legacy=0x7f5c94156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.786+0000 7f5c91400640 1 -- 172.21.15.194:0/2175106596 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084731413 0 0) 0x7f5c94153760 con 0x7f5c940ab7c0 2024-03-07T10:21:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.786+0000 7f5c91e00640 1 -- 172.21.15.194:0/2175106596 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9406e020 con 0x7f5c9414d6e0 2024-03-07T10:21:54.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.787+0000 7f5c91e00640 1 --2- 172.21.15.194:0/2175106596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c9406dc70 tx=0x7f5c8402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e1ec7a8d52cf26 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.788+0000 7f5c91400640 1 -- 172.21.15.194:0/2175106596 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8402ca50 con 0x7f5c9414d6e0 2024-03-07T10:21:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.788+0000 7f5c91400640 1 -- 172.21.15.194:0/2175106596 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8402cbf0 con 0x7f5c9414d6e0 2024-03-07T10:21:54.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.788+0000 7f5c91400640 1 -- 172.21.15.194:0/2175106596 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c840343f0 con 0x7f5c9414d6e0 2024-03-07T10:21:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 -- 172.21.15.194:0/2175106596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 msgr2=0x7f5c9406e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 --2- 172.21.15.194:0/2175106596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c9406dc70 tx=0x7f5c8402beb0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 -- 172.21.15.194:0/2175106596 shutdown_connections 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 --2- 172.21.15.194:0/2175106596 >> v2:172.21.15.196:3300/0 conn(0x7f5c940ab340 0x7f5c940a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 --2- 172.21.15.194:0/2175106596 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c9414d6e0 0x7f5c9406e820 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 -- 172.21.15.194:0/2175106596 >> 172.21.15.194:0/2175106596 conn(0x7f5c9406b860 msgr2=0x7f5c940c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 -- 172.21.15.194:0/2175106596 shutdown_connections 2024-03-07T10:21:54.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.789+0000 7f5c99200640 1 -- 172.21.15.194:0/2175106596 wait complete. 2024-03-07T10:21:54.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.792+0000 7f5c99200640 1 Processor -- start 2024-03-07T10:21:54.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.793+0000 7f5c99200640 1 -- start start 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c940ab7c0 0x7f5c940c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c9414d6e0 0x7f5c94070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940aae10 con 0x7f5c940ab340 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940c79c0 con 0x7f5c9414d6e0 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c99200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c9406ce70 con 0x7f5c940ab7c0 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c91e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c91e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42512/0 (socket says 172.21.15.194:42512) 2024-03-07T10:21:54.798 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c91e00640 1 -- 172.21.15.194:0/1504628974 learned_addr learned my addr 172.21.15.194:0/1504628974 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c89400640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c940ab7c0 0x7f5c940c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.795+0000 7f5c92800640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c9414d6e0 0x7f5c94070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 -- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c940ab7c0 msgr2=0x7f5c940c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c940ab7c0 0x7f5c940c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 -- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c9414d6e0 msgr2=0x7f5c94070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c9414d6e0 0x7f5c94070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:54.799 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 -- 172.21.15.194:0/1504628974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94071930 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c91e00640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c84036040 tx=0x7f5c84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84009510 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c84003990 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c84003d60 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.796+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c941eb5f0 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.797+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c941ebbb0 con 0x7f5c940ab340 2024-03-07T10:21:54.800 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.798+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94154720 con 0x7f5c940ab340 2024-03-07T10:21:54.801 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.799+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5c8402ca60 con 0x7f5c940ab340 2024-03-07T10:21:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.801+0000 7f5c8aa00640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 0x7f5c7006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:54.803 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.801+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f5c840ad250 con 0x7f5c940ab340 2024-03-07T10:21:54.804 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.801+0000 7f5c89400640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 0x7f5c7006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:54.805 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.803+0000 7f5c89400640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 0x7f5c7006d9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c941e0820 tx=0x7f5c7c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:54.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:54.804+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5c94154720 con 0x7f5c940ab340 2024-03-07T10:21:55.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.031+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5c94068170 con 0x7f5c940ab340 2024-03-07T10:21:55.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.032+0000 7f5c8aa00640 1 -- 172.21.15.194:0/1504628974 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5c8407bd20 con 0x7f5c940ab340 2024-03-07T10:21:55.035 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 msgr2=0x7f5c7006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 0x7f5c7006d9c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5c941e0820 tx=0x7f5c7c009190 comp rx=0 tx=0).stop 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 msgr2=0x7f5c941463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c84036040 tx=0x7f5c84004a40 comp rx=0 tx=0).stop 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 shutdown_connections 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5c7006b500 0x7f5c7006d9c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5c9414d6e0 0x7f5c94070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5c940ab7c0 0x7f5c940c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 --2- 172.21.15.194:0/1504628974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c940ab340 0x7f5c941463a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 >> 172.21.15.194:0/1504628974 conn(0x7f5c9406b860 msgr2=0x7f5c940a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:55.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 shutdown_connections 2024-03-07T10:21:55.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.035+0000 7f5c99200640 1 -- 172.21.15.194:0/1504628974 wait complete. 2024-03-07T10:21:55.059 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:21:55.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.260+0000 7fc00f400640 1 Processor -- start 2024-03-07T10:21:55.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.260+0000 7fc00f400640 1 -- start start 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc008155cc0 0x7fc0081560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc008072f90 0x7fc008153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080c7cb0 con 0x7fc00806e360 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00f400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00806d630 con 0x7fc008155cc0 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00f400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00806d880 con 0x7fc008072f90 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc008155cc0 0x7fc0081560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc008155cc0 0x7fc0081560a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42516/0 (socket says 172.21.15.194:42516) 2024-03-07T10:21:55.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.262+0000 7fc00ca00640 1 -- 172.21.15.194:0/3058501856 learned_addr learned my addr 172.21.15.194:0/3058501856 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:55.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.263+0000 7fc007e00640 1 --2- 172.21.15.194:0/3058501856 >> v2:172.21.15.196:3300/0 conn(0x7fc008072f90 0x7fc008153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.263+0000 7fc00ca00640 1 -- 172.21.15.194:0/3058501856 >> v2:172.21.15.196:3300/0 conn(0x7fc008072f90 msgr2=0x7fc008153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:55.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.263+0000 7fc00ca00640 1 --2- 172.21.15.194:0/3058501856 >> v2:172.21.15.196:3300/0 conn(0x7fc008072f90 0x7fc008153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.263+0000 7fc00ca00640 1 -- 172.21.15.194:0/3058501856 >> v1:172.21.15.196:6789/0 conn(0x7fc00806e360 legacy=0x7fc008148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.266 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.263+0000 7fc00ca00640 1 -- 172.21.15.194:0/3058501856 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00806db60 con 0x7fc008155cc0 2024-03-07T10:21:55.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.265+0000 7fc00ca00640 1 --2- 172.21.15.194:0/3058501856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc0081560a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc00806bfe0 tx=0x7fbffc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a9c7e1b05cd390 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.265+0000 7fc007400640 1 -- 172.21.15.194:0/3058501856 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc035020 con 0x7fc008155cc0 2024-03-07T10:21:55.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.265+0000 7fc007400640 1 -- 172.21.15.194:0/3058501856 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc031870 con 0x7fc008155cc0 2024-03-07T10:21:55.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.265+0000 7fc007400640 1 -- 172.21.15.194:0/3058501856 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc031c40 con 0x7fc008155cc0 2024-03-07T10:21:55.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 -- 172.21.15.194:0/3058501856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 msgr2=0x7fc0081560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 --2- 172.21.15.194:0/3058501856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc0081560a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc00806bfe0 tx=0x7fbffc02b910 comp rx=0 tx=0).stop 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 -- 172.21.15.194:0/3058501856 shutdown_connections 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 --2- 172.21.15.194:0/3058501856 >> v2:172.21.15.196:3300/0 conn(0x7fc008072f90 0x7fc008153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 --2- 172.21.15.194:0/3058501856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc0081560a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 -- 172.21.15.194:0/3058501856 >> 172.21.15.194:0/3058501856 conn(0x7fc00806b860 msgr2=0x7fc0080c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 -- 172.21.15.194:0/3058501856 shutdown_connections 2024-03-07T10:21:55.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.266+0000 7fc00f400640 1 -- 172.21.15.194:0/3058501856 wait complete. 2024-03-07T10:21:55.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.269+0000 7fc00f400640 1 Processor -- start 2024-03-07T10:21:55.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.269+0000 7fc00f400640 1 -- start start 2024-03-07T10:21:55.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc00806e360 0x7fc008150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0080c5c70 0x7fc00814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c7a90 con 0x7fc008155cc0 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c7910 con 0x7fc0080c5c70 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.270+0000 7fc00f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081565e0 con 0x7fc00806e360 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42518/0 (socket says 172.21.15.194:42518) 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 -- 172.21.15.194:0/3872675779 learned_addr learned my addr 172.21.15.194:0/3872675779 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc00ca00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc00806e360 0x7fc008150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc00d400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0080c5c70 0x7fc00814ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 -- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc00806e360 msgr2=0x7fc008150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc00806e360 0x7fc008150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 -- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0080c5c70 msgr2=0x7fc00814ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0080c5c70 0x7fc00814ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 -- 172.21.15.194:0/3872675779 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0081ef660 con 0x7fc008155cc0 2024-03-07T10:21:55.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.271+0000 7fc007e00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d800 tx=0x7fbff400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.272+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400b6c0 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.272+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff4019070 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.272+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400ba80 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.272+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0080c6600 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.272+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc008152a50 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.273+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc008068170 con 0x7fc008155cc0 2024-03-07T10:21:55.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.274+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbff400bc20 con 0x7fc008155cc0 2024-03-07T10:21:55.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.275+0000 7fc004c00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 0x7fbfe806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.275+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7fbff408aa90 con 0x7fc008155cc0 2024-03-07T10:21:55.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.275+0000 7fc00ca00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 0x7fbfe806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.277+0000 7fc00ca00640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 0x7fbfe806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbffc036000 tx=0x7fbffc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.280+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbff4059560 con 0x7fc008155cc0 2024-03-07T10:21:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.474+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0080c7060 con 0x7fc008155cc0 2024-03-07T10:21:55.477 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.475+0000 7fc004c00640 1 -- 172.21.15.194:0/3872675779 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7fbff4058e60 con 0x7fc008155cc0 2024-03-07T10:21:55.478 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 msgr2=0x7fbfe806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 0x7fbfe806d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbffc036000 tx=0x7fbffc03c040 comp rx=0 tx=0).stop 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 msgr2=0x7fc008151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d800 tx=0x7fbff400dcc0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 shutdown_connections 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbfe806b4d0 0x7fbfe806d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc0080c5c70 0x7fc00814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc008155cc0 0x7fc008151220 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.480 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 --2- 172.21.15.194:0/3872675779 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc00806e360 0x7fc008150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 >> 172.21.15.194:0/3872675779 conn(0x7fc00806b860 msgr2=0x7fc0080c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 shutdown_connections 2024-03-07T10:21:55.481 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.477+0000 7fc00f400640 1 -- 172.21.15.194:0/3872675779 wait complete. 2024-03-07T10:21:55.497 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:21:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.702+0000 7f9e01c00640 1 Processor -- start 2024-03-07T10:21:55.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.702+0000 7f9e01c00640 1 -- start start 2024-03-07T10:21:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.703+0000 7f9e01c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9e01c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9dfc0c5a30 0x7f9dfc0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9e01c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0c9410 con 0x7f9dfc152db0 2024-03-07T10:21:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9e01c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0cbcf0 con 0x7f9dfc0c5a30 2024-03-07T10:21:55.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9e01c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc153190 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9df2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9df2000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:57396/0 (socket says 172.21.15.194:57396) 2024-03-07T10:21:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9df2000640 1 -- 172.21.15.194:0/4235317689 learned_addr learned my addr 172.21.15.194:0/4235317689 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:55.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.704+0000 7f9dfb400640 1 --2- 172.21.15.194:0/4235317689 >> v2:172.21.15.196:3300/0 conn(0x7f9dfc0c5a30 0x7f9dfc0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.705+0000 7f9df2000640 1 -- 172.21.15.194:0/4235317689 >> v2:172.21.15.196:3300/0 conn(0x7f9dfc0c5a30 msgr2=0x7f9dfc0c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.705+0000 7f9df2000640 1 --2- 172.21.15.194:0/4235317689 >> v2:172.21.15.196:3300/0 conn(0x7f9dfc0c5a30 0x7f9dfc0c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.705+0000 7f9df2000640 1 -- 172.21.15.194:0/4235317689 >> v1:172.21.15.196:6789/0 conn(0x7f9dfc152db0 legacy=0x7f9dfc156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.705+0000 7f9df2000640 1 -- 172.21.15.194:0/4235317689 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0cb730 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.706+0000 7f9df2000640 1 --2- 172.21.15.194:0/4235317689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b943197ce377be1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9dfa000640 1 -- 172.21.15.194:0/4235317689 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4035020 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9dfa000640 1 -- 172.21.15.194:0/4235317689 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de4031640 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9dfa000640 1 -- 172.21.15.194:0/4235317689 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de402d040 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 -- 172.21.15.194:0/4235317689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 msgr2=0x7f9dfc159640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.709 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 --2- 172.21.15.194:0/4235317689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 -- 172.21.15.194:0/4235317689 shutdown_connections 2024-03-07T10:21:55.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 --2- 172.21.15.194:0/4235317689 >> v2:172.21.15.196:3300/0 conn(0x7f9dfc0c5a30 0x7f9dfc0c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 --2- 172.21.15.194:0/4235317689 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc0c8fb0 0x7f9dfc159640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.707+0000 7f9e01c00640 1 -- 172.21.15.194:0/4235317689 >> 172.21.15.194:0/4235317689 conn(0x7f9dfc066fd0 msgr2=0x7f9dfc0673e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.708+0000 7f9e01c00640 1 -- 172.21.15.194:0/4235317689 shutdown_connections 2024-03-07T10:21:55.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.708+0000 7f9e01c00640 1 -- 172.21.15.194:0/4235317689 wait complete. 2024-03-07T10:21:55.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.710+0000 7f9e01c00640 1 Processor -- start 2024-03-07T10:21:55.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.710+0000 7f9e01c00640 1 -- start start 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dfc0c5a30 0x7f9dfc151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc152db0 0x7f9dfc153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc159120 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc158e40 con 0x7f9dfc0c5a30 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9e01c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc06d940 con 0x7f9dfc152db0 2024-03-07T10:21:55.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9df2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9df2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42528/0 (socket says 172.21.15.194:42528) 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.711+0000 7f9df2000640 1 -- 172.21.15.194:0/1564125241 learned_addr learned my addr 172.21.15.194:0/1564125241 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9dfaa00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dfc0c5a30 0x7f9dfc151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9dfb400640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc152db0 0x7f9dfc153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 -- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc152db0 msgr2=0x7f9dfc153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc152db0 0x7f9dfc153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 -- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dfc0c5a30 msgr2=0x7f9dfc151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dfc0c5a30 0x7f9dfc151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 -- 172.21.15.194:0/1564125241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc156e30 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df2000640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9de402b930 tx=0x7f9de40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.712+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4040070 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.713+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de403e070 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.713+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4035040 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.713+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc156b50 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.713+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc157420 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.714+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc068170 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.716+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9de4038020 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.717+0000 7f9df3400640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 0x7f9dd806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:55.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.717+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9de40abfd0 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.718+0000 7f9dfaa00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 0x7f9dd806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:55.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.719+0000 7f9dfaa00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 0x7f9dd806d9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dec001d40 tx=0x7f9dec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:55.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.722+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9de407a990 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.920+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f9dfc14efc0 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.920+0000 7f9df3400640 1 -- 172.21.15.194:0/1564125241 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f9de407a290 con 0x7f9dfc0c8fb0 2024-03-07T10:21:55.923 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 msgr2=0x7f9dd806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 0x7f9dd806d9c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9dec001d40 tx=0x7f9dec009040 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 msgr2=0x7f9dfc151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9de402b930 tx=0x7f9de40046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 shutdown_connections 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9dd806b500 0x7f9dd806d9c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9dfc152db0 0x7f9dfc153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dfc0c8fb0 0x7f9dfc151d50 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 --2- 172.21.15.194:0/1564125241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9dfc0c5a30 0x7f9dfc151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 >> 172.21.15.194:0/1564125241 conn(0x7f9dfc066fd0 msgr2=0x7f9dfc14df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:55.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 shutdown_connections 2024-03-07T10:21:55.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:55.923+0000 7f9e01c00640 1 -- 172.21.15.194:0/1564125241 wait complete. 2024-03-07T10:21:55.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:21:56.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.149+0000 7f8c07600640 1 Processor -- start 2024-03-07T10:21:56.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.150+0000 7f8c07600640 1 -- start start 2024-03-07T10:21:56.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c07600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c00155cc0 0x7f8c001560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c07600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8c00072f90 0x7f8c00153950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c07600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000c7cb0 con 0x7f8c0006e360 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c07600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0006d630 con 0x7f8c00155cc0 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c07600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0006d880 con 0x7f8c00072f90 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c04c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c00155cc0 0x7f8c001560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c05600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8c0006e360 0x7f8c00148ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42164/0 (socket says 172.21.15.194:42164) 2024-03-07T10:21:56.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.151+0000 7f8c05600640 1 -- 172.21.15.194:0/3280165671 learned_addr learned my addr 172.21.15.194:0/3280165671 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.152+0000 7f8bf7e00640 1 --2- 172.21.15.194:0/3280165671 >> v2:172.21.15.196:3300/0 conn(0x7f8c00072f90 0x7f8c00153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.152+0000 7f8c04c00640 1 -- 172.21.15.194:0/3280165671 >> v2:172.21.15.196:3300/0 conn(0x7f8c00072f90 msgr2=0x7f8c00153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.152+0000 7f8c04c00640 1 --2- 172.21.15.194:0/3280165671 >> v2:172.21.15.196:3300/0 conn(0x7f8c00072f90 0x7f8c00153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.152+0000 7f8c04c00640 1 -- 172.21.15.194:0/3280165671 >> v1:172.21.15.194:6789/0 conn(0x7f8c0006e360 legacy=0x7f8c00148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.152+0000 7f8c04c00640 1 -- 172.21.15.194:0/3280165671 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0006db60 con 0x7f8c00155cc0 2024-03-07T10:21:56.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.153+0000 7f8c04c00640 1 --2- 172.21.15.194:0/3280165671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c00155cc0 0x7f8c001560a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006bfe0 tx=0x7f8bf002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e1e4b221538886 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.153+0000 7f8bffe00640 1 -- 172.21.15.194:0/3280165671 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf003b070 con 0x7f8c00155cc0 2024-03-07T10:21:56.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.153+0000 7f8bffe00640 1 -- 172.21.15.194:0/3280165671 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf002ee00 con 0x7f8c00155cc0 2024-03-07T10:21:56.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.153+0000 7f8bffe00640 1 -- 172.21.15.194:0/3280165671 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0036660 con 0x7f8c00155cc0 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 -- 172.21.15.194:0/3280165671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c00155cc0 msgr2=0x7f8c001560a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 --2- 172.21.15.194:0/3280165671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c00155cc0 0x7f8c001560a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8c0006bfe0 tx=0x7f8bf002e050 comp rx=0 tx=0).stop 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 -- 172.21.15.194:0/3280165671 shutdown_connections 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 --2- 172.21.15.194:0/3280165671 >> v2:172.21.15.196:3300/0 conn(0x7f8c00072f90 0x7f8c00153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 --2- 172.21.15.194:0/3280165671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c00155cc0 0x7f8c001560a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 -- 172.21.15.194:0/3280165671 >> 172.21.15.194:0/3280165671 conn(0x7f8c0006b860 msgr2=0x7f8c000c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 -- 172.21.15.194:0/3280165671 shutdown_connections 2024-03-07T10:21:56.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.154+0000 7f8c07600640 1 -- 172.21.15.194:0/3280165671 wait complete. 2024-03-07T10:21:56.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.156+0000 7f8c07600640 1 Processor -- start 2024-03-07T10:21:56.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.156+0000 7f8c07600640 1 -- start start 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c00155cc0 0x7f8c000aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c001440a0 0x7f8c00142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000c7a90 con 0x7f8c0006e360 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c000c7910 con 0x7f8c001440a0 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c07600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c001565e0 con 0x7f8c00155cc0 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42534/0 (socket says 172.21.15.194:42534) 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 -- 172.21.15.194:0/3482742795 learned_addr learned my addr 172.21.15.194:0/3482742795 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8bf7e00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c00155cc0 0x7f8c000aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 -- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c00155cc0 msgr2=0x7f8c000aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c00155cc0 0x7f8c000aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 -- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c001440a0 msgr2=0x7f8c00142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c05600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c001440a0 0x7f8c00142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c001440a0 0x7f8c00142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.157+0000 7f8c04c00640 1 -- 172.21.15.194:0/3482742795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00144bd0 con 0x7f8c0006e360 2024-03-07T10:21:56.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8c04c00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009e80 tx=0x7f8bf0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf003b070 con 0x7f8c0006e360 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf003f550 con 0x7f8c0006e360 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf003f940 con 0x7f8c0006e360 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c00144610 con 0x7f8c0006e360 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.158+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c000c4d10 con 0x7f8c0006e360 2024-03-07T10:21:56.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.160+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c00068170 con 0x7f8c0006e360 2024-03-07T10:21:56.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.160+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f8bf0048020 con 0x7f8c0006e360 2024-03-07T10:21:56.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.161+0000 7f8bfd600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 0x7f8bdc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.161+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f8bf00ac0c0 con 0x7f8c0006e360 2024-03-07T10:21:56.164 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.162+0000 7f8bf7e00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 0x7f8bdc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.163+0000 7f8bf7e00640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 0x7f8bdc06d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c00153250 tx=0x7f8be8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.172 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.170+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c00144bd0 con 0x7f8c0006e360 2024-03-07T10:21:56.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.371+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c00153280 con 0x7f8c0006e360 2024-03-07T10:21:56.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.372+0000 7f8bfd600640 1 -- 172.21.15.194:0/3482742795 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) v1 ==== 99+0+11 (secure 0 0 0) 0x7f8bf007ac30 con 0x7f8c0006e360 2024-03-07T10:21:56.375 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 msgr2=0x7f8bdc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 0x7f8bdc06d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8c00153250 tx=0x7f8be8008040 comp rx=0 tx=0).stop 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 msgr2=0x7f8c000ab930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009e80 tx=0x7f8bf0004ab0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 shutdown_connections 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bdc06b500 0x7f8bdc06d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c001440a0 0x7f8c00142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c00155cc0 0x7f8c000aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 --2- 172.21.15.194:0/3482742795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c0006e360 0x7f8c000ab930 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 >> 172.21.15.194:0/3482742795 conn(0x7f8c0006b860 msgr2=0x7f8c00070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.375+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 shutdown_connections 2024-03-07T10:21:56.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.376+0000 7f8c07600640 1 -- 172.21.15.194:0/3482742795 wait complete. 2024-03-07T10:21:56.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:21:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.594+0000 7f2e60200640 1 Processor -- start 2024-03-07T10:21:56.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.595+0000 7f2e60200640 1 -- start start 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e60200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e5806d5a0 0x7f2e580c6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e60200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581562d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e60200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e580ad690 con 0x7f2e58152f80 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e60200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e580c8f80 con 0x7f2e5806d5a0 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e60200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e580ad970 con 0x7f2e58155e40 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e5ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e5806d5a0 0x7f2e580c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e5ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2e5806d5a0 0x7f2e580c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42536/0 (socket says 172.21.15.194:42536) 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.596+0000 7f2e5ce00640 1 -- 172.21.15.194:0/2191732778 learned_addr learned my addr 172.21.15.194:0/2191732778 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.597+0000 7f2e5e200640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.597+0000 7f2e5ce00640 1 -- 172.21.15.194:0/2191732778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 msgr2=0x7f2e581562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.597+0000 7f2e5ce00640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.597+0000 7f2e5ce00640 1 -- 172.21.15.194:0/2191732778 >> v1:172.21.15.196:6789/0 conn(0x7f2e58152f80 legacy=0x7f2e5806c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:56.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.597+0000 7f2e5ce00640 1 -- 172.21.15.194:0/2191732778 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580c5a00 con 0x7f2e5806d5a0 2024-03-07T10:21:56.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.598+0000 7f2e5ce00640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e5806d5a0 0x7f2e580c6170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009870 tx=0x7f2e4402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39fdf819b9894f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.598+0000 7f2e57e00640 1 -- 172.21.15.194:0/2191732778 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44035020 con 0x7f2e5806d5a0 2024-03-07T10:21:56.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.598+0000 7f2e57e00640 1 -- 172.21.15.194:0/2191732778 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44031640 con 0x7f2e5806d5a0 2024-03-07T10:21:56.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.598+0000 7f2e57e00640 1 -- 172.21.15.194:0/2191732778 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4402d040 con 0x7f2e5806d5a0 2024-03-07T10:21:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 -- 172.21.15.194:0/2191732778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e5806d5a0 msgr2=0x7f2e580c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e5806d5a0 0x7f2e580c6170 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2e44009870 tx=0x7f2e4402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 -- 172.21.15.194:0/2191732778 shutdown_connections 2024-03-07T10:21:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 --2- 172.21.15.194:0/2191732778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e5806d5a0 0x7f2e580c6170 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 -- 172.21.15.194:0/2191732778 >> 172.21.15.194:0/2191732778 conn(0x7f2e580acb70 msgr2=0x7f2e580acf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.599+0000 7f2e60200640 1 -- 172.21.15.194:0/2191732778 shutdown_connections 2024-03-07T10:21:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.600+0000 7f2e60200640 1 -- 172.21.15.194:0/2191732778 wait complete. 2024-03-07T10:21:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.602+0000 7f2e60200640 1 Processor -- start 2024-03-07T10:21:56.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.602+0000 7f2e60200640 1 -- start start 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 0x7f2e580b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581ee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5806d080 con 0x7f2e58152f80 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58153360 con 0x7f2e5806d5a0 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e60200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5806d200 con 0x7f2e58155e40 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42540/0 (socket says 172.21.15.194:42540) 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5ce00640 1 -- 172.21.15.194:0/3429247880 learned_addr learned my addr 172.21.15.194:0/3429247880 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:56.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5d800640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 0x7f2e580b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5ce00640 1 -- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 msgr2=0x7f2e581ee5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.604+0000 7f2e5e200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581ee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5ce00640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581ee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5ce00640 1 -- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 msgr2=0x7f2e580b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5ce00640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 0x7f2e580b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5ce00640 1 -- 172.21.15.194:0/3429247880 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580c1700 con 0x7f2e58152f80 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5d800640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 0x7f2e580b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e5ce00640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2e4402b930 tx=0x7f2e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44035040 con 0x7f2e58152f80 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e44039c10 con 0x7f2e58152f80 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e580c19e0 con 0x7f2e58152f80 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e44045480 con 0x7f2e58152f80 2024-03-07T10:21:56.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.605+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e581ef000 con 0x7f2e58152f80 2024-03-07T10:21:56.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.607+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58068880 con 0x7f2e58152f80 2024-03-07T10:21:56.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.607+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f2e44038020 con 0x7f2e58152f80 2024-03-07T10:21:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.609+0000 7f2e55600640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 0x7f2e3806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:56.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.609+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f2e440ac590 con 0x7f2e58152f80 2024-03-07T10:21:56.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.610+0000 7f2e5d800640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 0x7f2e3806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:56.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.611+0000 7f2e5d800640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 0x7f2e3806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c003eb0 tx=0x7f2e4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:56.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.613+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2e44031610 con 0x7f2e58152f80 2024-03-07T10:21:56.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.808+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f2e5806b080 con 0x7f2e58152f80 2024-03-07T10:21:56.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.809+0000 7f2e55600640 1 -- 172.21.15.194:0/3429247880 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) v1 ==== 95+0+11 (secure 0 0 0) 0x7f2e4407b060 con 0x7f2e58152f80 2024-03-07T10:21:56.812 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 msgr2=0x7f2e3806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 0x7f2e3806d990 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c003eb0 tx=0x7f2e4c009040 comp rx=0 tx=0).stop 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 msgr2=0x7f2e580bf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f2e4402b930 tx=0x7f2e440046c0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 shutdown_connections 2024-03-07T10:21:56.814 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2e3806b4d0 0x7f2e3806d990 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2e58155e40 0x7f2e581ee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e58152f80 0x7f2e580bf5c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 --2- 172.21.15.194:0/3429247880 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2e5806d5a0 0x7f2e580b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.811+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 >> 172.21.15.194:0/3429247880 conn(0x7f2e580acb70 msgr2=0x7f2e5814fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.812+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 shutdown_connections 2024-03-07T10:21:56.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:56.812+0000 7f2e60200640 1 -- 172.21.15.194:0/3429247880 wait complete. 2024-03-07T10:21:56.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:21:57.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.032+0000 7f6590c00640 1 Processor -- start 2024-03-07T10:21:57.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.032+0000 7f6590c00640 1 -- start start 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6590c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f658c150b70 0x7f658c0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6590c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c153980 con 0x7f658c156c20 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6590c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c153c60 con 0x7f658c0a9a10 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6590c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c153f40 con 0x7f658c150b70 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6589e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f658c150b70 0x7f658c0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6583e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f658c156c20 0x7f658c06d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42174/0 (socket says 172.21.15.194:42174) 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6589e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f658c150b70 0x7f658c0a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42548/0 (socket says 172.21.15.194:42548) 2024-03-07T10:21:57.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.034+0000 7f6583e00640 1 -- 172.21.15.194:0/365092385 learned_addr learned my addr 172.21.15.194:0/365092385 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:21:57.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.035+0000 7f6589e00640 1 -- 172.21.15.194:0/365092385 >> v1:172.21.15.196:6789/0 conn(0x7f658c0a9a10 legacy=0x7f658c15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.035+0000 7f6589e00640 1 -- 172.21.15.194:0/365092385 >> v1:172.21.15.194:6789/0 conn(0x7f658c156c20 legacy=0x7f658c06d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.035+0000 7f6589e00640 1 -- 172.21.15.194:0/365092385 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c154220 con 0x7f658c150b70 2024-03-07T10:21:57.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.035+0000 7f6589400640 1 -- 172.21.15.194:0/365092385 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069487061 0 0) 0x7f658c153980 con 0x7f658c156c20 2024-03-07T10:21:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.036+0000 7f6589e00640 1 --2- 172.21.15.194:0/365092385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c150b70 0x7f658c0a94d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b709c390e7eb146 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.036+0000 7f6589400640 1 -- 172.21.15.194:0/365092385 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c035020 con 0x7f658c150b70 2024-03-07T10:21:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.036+0000 7f6589400640 1 -- 172.21.15.194:0/365092385 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c031830 con 0x7f658c150b70 2024-03-07T10:21:57.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.036+0000 7f6589400640 1 -- 172.21.15.194:0/365092385 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c031c00 con 0x7f658c150b70 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 -- 172.21.15.194:0/365092385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c150b70 msgr2=0x7f658c0a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 --2- 172.21.15.194:0/365092385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c150b70 0x7f658c0a94d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b8d0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 -- 172.21.15.194:0/365092385 shutdown_connections 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 --2- 172.21.15.194:0/365092385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c150b70 0x7f658c0a94d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 -- 172.21.15.194:0/365092385 >> 172.21.15.194:0/365092385 conn(0x7f658c06b840 msgr2=0x7f658c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 -- 172.21.15.194:0/365092385 shutdown_connections 2024-03-07T10:21:57.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.037+0000 7f6590c00640 1 -- 172.21.15.194:0/365092385 wait complete. 2024-03-07T10:21:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.040+0000 7f6590c00640 1 Processor -- start 2024-03-07T10:21:57.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.040+0000 7f6590c00640 1 -- start start 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 0x7f658c154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f658c150b70 0x7f658c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0ac460 con 0x7f658c156c20 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c153630 con 0x7f658c0a9a10 2024-03-07T10:21:57.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.041+0000 7f6590c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c153240 con 0x7f658c150b70 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42558/0 (socket says 172.21.15.194:42558) 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 -- 172.21.15.194:0/3576088949 learned_addr learned my addr 172.21.15.194:0/3576088949 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f6589e00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 0x7f658c154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f6583e00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f658c150b70 0x7f658c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 -- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f658c150b70 msgr2=0x7f658c151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f658c150b70 0x7f658c151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 -- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 msgr2=0x7f658c154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 0x7f658c154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 -- 172.21.15.194:0/3576088949 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c1ef620 con 0x7f658c156c20 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f6589e00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 0x7f658c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.042+0000 7f658a800640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f658400c6b0 tx=0x7f658400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.043+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584003b70 con 0x7f658c156c20 2024-03-07T10:21:57.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.043+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584003d30 con 0x7f658c156c20 2024-03-07T10:21:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.043+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c152ed0 con 0x7f658c156c20 2024-03-07T10:21:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.043+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584005310 con 0x7f658c156c20 2024-03-07T10:21:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.043+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c1524f0 con 0x7f658c156c20 2024-03-07T10:21:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.044+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c06d5b0 con 0x7f658c156c20 2024-03-07T10:21:57.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.045+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f65840054b0 con 0x7f658c156c20 2024-03-07T10:21:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.046+0000 7f6582000640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 0x7f656806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.048 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.046+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f658408a430 con 0x7f658c156c20 2024-03-07T10:21:57.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.047+0000 7f6589e00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 0x7f656806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.048+0000 7f6589e00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 0x7f656806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f657c036000 tx=0x7f657c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.050+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f658c06d5b0 con 0x7f658c156c20 2024-03-07T10:21:57.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.286+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f658c068170 con 0x7f658c156c20 2024-03-07T10:21:57.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.287+0000 7f6582000640 1 -- 172.21.15.194:0/3576088949 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f6584058f00 con 0x7f658c156c20 2024-03-07T10:21:57.289 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:57.290 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:21:57.290 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:21:57.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.289+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 msgr2=0x7f656806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.289+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 0x7f656806d990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f657c036000 tx=0x7f657c008030 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.289+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 msgr2=0x7f658c1eec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.289+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f658400c6b0 tx=0x7f658400cb70 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 shutdown_connections 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f656806b4d0 0x7f656806d990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f658c156c20 0x7f658c1eec30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f658c150b70 0x7f658c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 --2- 172.21.15.194:0/3576088949 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f658c0a9a10 0x7f658c154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 >> 172.21.15.194:0/3576088949 conn(0x7f658c06b840 msgr2=0x7f658c06d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 shutdown_connections 2024-03-07T10:21:57.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.290+0000 7f6590c00640 1 -- 172.21.15.194:0/3576088949 wait complete. 2024-03-07T10:21:57.312 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:21:57.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.505+0000 7f0c01e00640 1 Processor -- start 2024-03-07T10:21:57.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.505+0000 7f0c01e00640 1 -- start start 2024-03-07T10:21:57.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.506+0000 7f0c01e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.506+0000 7f0c01e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0bfc1549f0 0x7f0bfc0c8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.506+0000 7f0c01e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bfc0c6ef0 con 0x7f0bfc154e70 2024-03-07T10:21:57.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.506+0000 7f0c01e00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bfc157700 con 0x7f0bfc1549f0 2024-03-07T10:21:57.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.506+0000 7f0c01e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc0c7190 con 0x7f0bfc071340 2024-03-07T10:21:57.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.507+0000 7f0bfaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.507+0000 7f0bfaa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:57448/0 (socket says 172.21.15.194:57448) 2024-03-07T10:21:57.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.507+0000 7f0bfaa00640 1 -- 172.21.15.194:0/2943366257 learned_addr learned my addr 172.21.15.194:0/2943366257 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:57.510 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.507+0000 7f0bfa000640 1 --2- 172.21.15.194:0/2943366257 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc1549f0 0x7f0bfc0c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.508+0000 7f0bfaa00640 1 -- 172.21.15.194:0/2943366257 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc1549f0 msgr2=0x7f0bfc0c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:21:57.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.508+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/2943366257 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc1549f0 0x7f0bfc0c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.508+0000 7f0bfaa00640 1 -- 172.21.15.194:0/2943366257 >> v1:172.21.15.196:6789/0 conn(0x7f0bfc154e70 legacy=0x7f0bfc156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.508+0000 7f0bf9600640 1 -- 172.21.15.194:0/2943366257 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126754803 0 0) 0x7f0bfc0c6ef0 con 0x7f0bfc154e70 2024-03-07T10:21:57.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.508+0000 7f0bfaa00640 1 -- 172.21.15.194:0/2943366257 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0c7470 con 0x7f0bfc071340 2024-03-07T10:21:57.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.510+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/2943366257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2147fc1474cdbf37 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0bf9600640 1 -- 172.21.15.194:0/2943366257 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec035020 con 0x7f0bfc071340 2024-03-07T10:21:57.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0bf9600640 1 -- 172.21.15.194:0/2943366257 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bec031640 con 0x7f0bfc071340 2024-03-07T10:21:57.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0bf9600640 1 -- 172.21.15.194:0/2943366257 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bec02d040 con 0x7f0bfc071340 2024-03-07T10:21:57.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 -- 172.21.15.194:0/2943366257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 msgr2=0x7f0bfc0c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 --2- 172.21.15.194:0/2943366257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0bec009870 tx=0x7f0bec02b8f0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 -- 172.21.15.194:0/2943366257 shutdown_connections 2024-03-07T10:21:57.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 --2- 172.21.15.194:0/2943366257 >> v2:172.21.15.196:3300/0 conn(0x7f0bfc1549f0 0x7f0bfc0c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 --2- 172.21.15.194:0/2943366257 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc0c7990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.511+0000 7f0c01e00640 1 -- 172.21.15.194:0/2943366257 >> 172.21.15.194:0/2943366257 conn(0x7f0bfc0c8f50 msgr2=0x7f0bfc0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:57.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.512+0000 7f0c01e00640 1 -- 172.21.15.194:0/2943366257 shutdown_connections 2024-03-07T10:21:57.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.512+0000 7f0c01e00640 1 -- 172.21.15.194:0/2943366257 wait complete. 2024-03-07T10:21:57.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.514+0000 7f0c01e00640 1 Processor -- start 2024-03-07T10:21:57.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.514+0000 7f0c01e00640 1 -- start start 2024-03-07T10:21:57.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc1ec920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc154e70 0x7f0bfc148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc1538a0 con 0x7f0bfc1549f0 2024-03-07T10:21:57.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc153720 con 0x7f0bfc154e70 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0c01e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bfc157300 con 0x7f0bfc071340 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0bfa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0bfa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:42566/0 (socket says 172.21.15.194:42566) 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.516+0000 7f0bfa000640 1 -- 172.21.15.194:0/3059824985 learned_addr learned my addr 172.21.15.194:0/3059824985 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc1ec920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfb400640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc154e70 0x7f0bfc148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 -- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 msgr2=0x7f0bfc1ec920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc1ec920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 -- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc154e70 msgr2=0x7f0bfc148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc154e70 0x7f0bfc148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 -- 172.21.15.194:0/3059824985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bfc0bfc90 con 0x7f0bfc1549f0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc1ec920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bfa000640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0be800e9b0 tx=0x7f0be800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be8017070 con 0x7f0bfc1549f0 2024-03-07T10:21:57.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be800c9a0 con 0x7f0bfc1549f0 2024-03-07T10:21:57.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bfc0c8260 con 0x7f0bfc1549f0 2024-03-07T10:21:57.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.517+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be800cd90 con 0x7f0bfc1549f0 2024-03-07T10:21:57.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.518+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bfc1ed260 con 0x7f0bfc1549f0 2024-03-07T10:21:57.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.519+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bfc068170 con 0x7f0bfc1549f0 2024-03-07T10:21:57.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.520+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0be801a070 con 0x7f0bfc1549f0 2024-03-07T10:21:57.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.521+0000 7f0bf3400640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 0x7f0bdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:21:57.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.521+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f0be808a5f0 con 0x7f0bfc1549f0 2024-03-07T10:21:57.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.522+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 0x7f0bdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:21:57.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.523+0000 7f0bfaa00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 0x7f0bdc06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bec036000 tx=0x7f0bec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:21:57.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.526+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0be80590c0 con 0x7f0bfc1549f0 2024-03-07T10:21:57.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.722+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bfc0c8040 con 0x7f0bfc1549f0 2024-03-07T10:21:57.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.724+0000 7f0bf3400640 1 -- 172.21.15.194:0/3059824985 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+20641 (secure 0 0 0) 0x7f0be80589c0 con 0x7f0bfc1549f0 2024-03-07T10:21:57.727 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:21:57.727 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:21:39.555962+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 msgr2=0x7f0bdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 0x7f0bdc06d990 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0bec036000 tx=0x7f0bec008030 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 msgr2=0x7f0bfc0c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0be800e9b0 tx=0x7f0be800ee70 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 shutdown_connections 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0bdc06b4d0 0x7f0bdc06d990 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0bfc154e70 0x7f0bfc148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0bfc1549f0 0x7f0bfc0c43f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 --2- 172.21.15.194:0/3059824985 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0bfc071340 0x7f0bfc1ec920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:21:57.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 >> 172.21.15.194:0/3059824985 conn(0x7f0bfc0c8f50 msgr2=0x7f0bfc156bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:21:57.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 shutdown_connections 2024-03-07T10:21:57.731 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:21:57.727+0000 7f0c01e00640 1 -- 172.21.15.194:0/3059824985 wait complete. 2024-03-07T10:21:57.749 DEBUG:tasks.mds_thrash:Yielding 2024-03-07T10:21:57.750 INFO:teuthology.run_tasks:Running task workunit... 2024-03-07T10:21:57.762 INFO:tasks.workunit:Pulling workunits from ref 8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:21:57.762 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-07T10:21:57.763 INFO:tasks.workunit:timeout=3h 2024-03-07T10:21:57.763 INFO:tasks.workunit:cleanup=True 2024-03-07T10:21:57.763 DEBUG:teuthology.orchestra.run.smithi194:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:57.763 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-03-07T10:21:57.763 INFO:tasks.mds_thrash.fs.[b]:waiting for 42 secs before thrashing 2024-03-07T10:21:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:57.815 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-07T10:21:57.815 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 29h/41d Inode: 1 Links: 2 2024-03-07T10:21:57.815 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:21:57.815 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-07T10:21:57.816 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-07T10:21:57.816 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-03-07 10:20:58.153608183 +0000 2024-03-07T10:21:57.816 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-03-07 10:21:38.602286539 +0000 2024-03-07T10:21:57.816 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-03-07 10:20:58.153608183 +0000 2024-03-07T10:21:57.816 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-07T10:21:57.816 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-07T10:21:57.915 DEBUG:teuthology.orchestra.run.smithi196:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Device: 28h/40d Inode: 1 Links: 2 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-07T10:21:57.969 INFO:teuthology.orchestra.run.smithi196.stdout:Modify: 2024-03-07 10:21:09.301777705 +0000 2024-03-07T10:21:57.970 INFO:teuthology.orchestra.run.smithi196.stdout:Change: 2024-03-07 10:21:42.660302012 +0000 2024-03-07T10:21:57.970 INFO:teuthology.orchestra.run.smithi196.stdout: Birth: 2024-03-07 10:21:09.301777705 +0000 2024-03-07T10:21:57.970 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-07T10:21:57.970 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-07T10:21:58.064 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:21:58.064 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 8b896a9e145796119f0451201dc4d53ddac97db0 2024-03-07T10:21:58.118 INFO:tasks.workunit.client.1.smithi196.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-07T10:21:58.121 INFO:tasks.workunit.client.0.smithi194.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-07T10:22:18.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:22:18.095 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:22:39.764 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:39.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.951+0000 7f575ec00640 1 Processor -- start 2024-03-07T10:22:39.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.951+0000 7f575ec00640 1 -- start start 2024-03-07T10:22:39.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f57580c2690 0x7f57580c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57580c2df0 0x7f57580c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57580c33b0 con 0x7f5758150a90 2024-03-07T10:22:39.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5758072b50 con 0x7f57580c2690 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758150e70 con 0x7f57580c2df0 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575d800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5758150a90 0x7f57580c3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33178/0 (socket says 172.21.15.194:33178) 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575d800640 1 -- 172.21.15.194:0/501147714 learned_addr learned my addr 172.21.15.194:0/501147714 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.952+0000 7f575ce00640 1 --2- 172.21.15.194:0/501147714 >> v2:172.21.15.194:3300/0 conn(0x7f57580c2690 0x7f57580c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.953+0000 7f575e200640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57580c2df0 0x7f57580c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.953+0000 7f575ce00640 1 -- 172.21.15.194:0/501147714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57580c2df0 msgr2=0x7f57580c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.953+0000 7f575ce00640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57580c2df0 0x7f57580c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.953+0000 7f575ce00640 1 -- 172.21.15.194:0/501147714 >> v1:172.21.15.194:6789/0 conn(0x7f5758150a90 legacy=0x7f57580c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:39.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.953+0000 7f575ce00640 1 -- 172.21.15.194:0/501147714 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5758072d80 con 0x7f57580c2690 2024-03-07T10:22:39.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.954+0000 7f575ce00640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57580c16d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f57480097a0 tx=0x7f574802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d5aea6b224acd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:39.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f5757e00640 1 -- 172.21.15.194:0/501147714 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748035020 con 0x7f57580c2690 2024-03-07T10:22:39.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f5757e00640 1 -- 172.21.15.194:0/501147714 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748031810 con 0x7f57580c2690 2024-03-07T10:22:39.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f5757e00640 1 -- 172.21.15.194:0/501147714 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748031be0 con 0x7f57580c2690 2024-03-07T10:22:39.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f575ec00640 1 -- 172.21.15.194:0/501147714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 msgr2=0x7f57580c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:39.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f575ec00640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57580c16d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f57480097a0 tx=0x7f574802b8b0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.955+0000 7f575ec00640 1 -- 172.21.15.194:0/501147714 shutdown_connections 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.956+0000 7f575ec00640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f57580c2df0 0x7f57580c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.956+0000 7f575ec00640 1 --2- 172.21.15.194:0/501147714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57580c16d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.956+0000 7f575ec00640 1 -- 172.21.15.194:0/501147714 >> 172.21.15.194:0/501147714 conn(0x7f57580c70f0 msgr2=0x7f57580c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.956+0000 7f575ec00640 1 -- 172.21.15.194:0/501147714 shutdown_connections 2024-03-07T10:22:39.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.956+0000 7f575ec00640 1 -- 172.21.15.194:0/501147714 wait complete. 2024-03-07T10:22:39.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.957+0000 7f575ec00640 1 Processor -- start 2024-03-07T10:22:39.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.958+0000 7f575ec00640 1 -- start start 2024-03-07T10:22:39.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.958+0000 7f575ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57580c2df0 0x7f57580ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5758150a90 0x7f57580abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758073340 con 0x7f57580c2690 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5758071cf0 con 0x7f57580c2df0 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57580c4300 con 0x7f5758150a90 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40668/0 (socket says 172.21.15.194:40668) 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 -- 172.21.15.194:0/3415436690 learned_addr learned my addr 172.21.15.194:0/3415436690 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575e200640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5758150a90 0x7f57580abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575ce00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57580c2df0 0x7f57580ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 -- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5758150a90 msgr2=0x7f57580abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5758150a90 0x7f57580abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 -- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57580c2df0 msgr2=0x7f57580ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57580c2df0 0x7f57580ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.959+0000 7f575d800640 1 -- 172.21.15.194:0/3415436690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57581dec80 con 0x7f57580c2690 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f575d800640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c3c0 tx=0x7f574c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c017070 con 0x7f57580c2690 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c005ce0 con 0x7f57580c2690 2024-03-07T10:22:39.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c0072f0 con 0x7f57580c2690 2024-03-07T10:22:39.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57580a83c0 con 0x7f57580c2690 2024-03-07T10:22:39.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.960+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57581de760 con 0x7f57580c2690 2024-03-07T10:22:39.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.962+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5758068170 con 0x7f57580c2690 2024-03-07T10:22:39.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.964+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f574c01a070 con 0x7f57580c2690 2024-03-07T10:22:39.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.965+0000 7f5755600640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 0x7f573c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:39.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.966+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f574c089830 con 0x7f57580c2690 2024-03-07T10:22:39.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.966+0000 7f575ce00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 0x7f573c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:39.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.967+0000 7f575ce00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 0x7f573c06d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5748036000 tx=0x7f5748008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:39.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:39.971+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f574c057d50 con 0x7f57580c2690 2024-03-07T10:22:40.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.223+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57580a5d50 con 0x7f57580c2690 2024-03-07T10:22:40.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.224+0000 7f5755600640 1 -- 172.21.15.194:0/3415436690 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f574c05bdf0 con 0x7f57580c2690 2024-03-07T10:22:40.226 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:40.226 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:40.226 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 msgr2=0x7f573c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 0x7f573c06d9c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5748036000 tx=0x7f5748008030 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 msgr2=0x7f57581e1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f574c00c3c0 tx=0x7f574c00c880 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 shutdown_connections 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f573c06b500 0x7f573c06d9c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5758150a90 0x7f57580abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f57580c2df0 0x7f57580ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 --2- 172.21.15.194:0/3415436690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57580c2690 0x7f57581e1f40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 >> 172.21.15.194:0/3415436690 conn(0x7f57580c70f0 msgr2=0x7f575814e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 shutdown_connections 2024-03-07T10:22:40.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.227+0000 7f575ec00640 1 -- 172.21.15.194:0/3415436690 wait complete. 2024-03-07T10:22:40.245 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-03-07T10:22:40.245 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-07T10:22:40.245 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:22:40.262 INFO:tasks.ceph.mds.c:Stopped 2024-03-07T10:22:40.262 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:40.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.489+0000 7f00db000640 1 Processor -- start 2024-03-07T10:22:40.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.489+0000 7f00db000640 1 -- start start 2024-03-07T10:22:40.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.490+0000 7f00db000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 0x7f00d40c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.490+0000 7f00db000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f00d4157080 0x7f00d415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00db000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d406c4b0 con 0x7f00d40c4870 2024-03-07T10:22:40.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00db000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d406b870 con 0x7f00d4157080 2024-03-07T10:22:40.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00db000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d406b220 con 0x7f00d4150b90 2024-03-07T10:22:40.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00d9200640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f00d40c4870 0x7f00d4156970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:38966/0 (socket says 172.21.15.194:38966) 2024-03-07T10:22:40.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00d9200640 1 -- 172.21.15.194:0/2902474153 learned_addr learned my addr 172.21.15.194:0/2902474153 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:40.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00d9c00640 1 --2- 172.21.15.194:0/2902474153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 0x7f00d40c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:40.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.491+0000 7f00da600640 1 --2- 172.21.15.194:0/2902474153 >> v2:172.21.15.196:3300/0 conn(0x7f00d4157080 0x7f00d415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:40.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.492+0000 7f00d9c00640 1 -- 172.21.15.194:0/2902474153 >> v2:172.21.15.196:3300/0 conn(0x7f00d4157080 msgr2=0x7f00d415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:40.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.492+0000 7f00d9c00640 1 --2- 172.21.15.194:0/2902474153 >> v2:172.21.15.196:3300/0 conn(0x7f00d4157080 0x7f00d415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.492+0000 7f00d9c00640 1 -- 172.21.15.194:0/2902474153 >> v1:172.21.15.196:6789/0 conn(0x7f00d40c4870 legacy=0x7f00d4156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.492+0000 7f00d9c00640 1 -- 172.21.15.194:0/2902474153 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d406b500 con 0x7f00d4150b90 2024-03-07T10:22:40.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.494+0000 7f00d9c00640 1 --2- 172.21.15.194:0/2902474153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 0x7f00d40c28b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00c80097a0 tx=0x7f00c802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa4773f5c915a6e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.494+0000 7f00d3e00640 1 -- 172.21.15.194:0/2902474153 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8031780 con 0x7f00d4150b90 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.494+0000 7f00d3e00640 1 -- 172.21.15.194:0/2902474153 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8037070 con 0x7f00d4150b90 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.494+0000 7f00d3e00640 1 -- 172.21.15.194:0/2902474153 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8031b40 con 0x7f00d4150b90 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 -- 172.21.15.194:0/2902474153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 msgr2=0x7f00d40c28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 --2- 172.21.15.194:0/2902474153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 0x7f00d40c28b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00c80097a0 tx=0x7f00c802b820 comp rx=0 tx=0).stop 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 -- 172.21.15.194:0/2902474153 shutdown_connections 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 --2- 172.21.15.194:0/2902474153 >> v2:172.21.15.196:3300/0 conn(0x7f00d4157080 0x7f00d415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 --2- 172.21.15.194:0/2902474153 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d4150b90 0x7f00d40c28b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 -- 172.21.15.194:0/2902474153 >> 172.21.15.194:0/2902474153 conn(0x7f00d40a94d0 msgr2=0x7f00d40a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 -- 172.21.15.194:0/2902474153 shutdown_connections 2024-03-07T10:22:40.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.495+0000 7f00db000640 1 -- 172.21.15.194:0/2902474153 wait complete. 2024-03-07T10:22:40.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.497+0000 7f00db000640 1 Processor -- start 2024-03-07T10:22:40.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.497+0000 7f00db000640 1 -- start start 2024-03-07T10:22:40.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d40c4870 0x7f00d41e9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00d4150b90 0x7f00d4151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d406c250 con 0x7f00d4157080 2024-03-07T10:22:40.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d406c0d0 con 0x7f00d4150b90 2024-03-07T10:22:40.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.498+0000 7f00db000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d406bd00 con 0x7f00d40c4870 2024-03-07T10:22:40.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:40.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40676/0 (socket says 172.21.15.194:40676) 2024-03-07T10:22:40.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 -- 172.21.15.194:0/2209998025 learned_addr learned my addr 172.21.15.194:0/2209998025 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:40.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 -- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d40c4870 msgr2=0x7f00d41e9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d40c4870 0x7f00d41e9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 -- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00d4150b90 msgr2=0x7f00d4151f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00d4150b90 0x7f00d4151f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 -- 172.21.15.194:0/2209998025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4156d00 con 0x7f00d4157080 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.499+0000 7f00da600640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efc0 tx=0x7f00cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.500+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc018020 con 0x7f00d4157080 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.500+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc014480 con 0x7f00d4157080 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.500+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc014870 con 0x7f00d4157080 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.500+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4154840 con 0x7f00d4157080 2024-03-07T10:22:40.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.500+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d4156a20 con 0x7f00d4157080 2024-03-07T10:22:40.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.501+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d4068880 con 0x7f00d4157080 2024-03-07T10:22:40.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.502+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f00cc005d10 con 0x7f00d4157080 2024-03-07T10:22:40.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.503+0000 7f00d1600640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 0x7f00b406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:40.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.503+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f00cc08b0b0 con 0x7f00d4157080 2024-03-07T10:22:40.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.504+0000 7f00d9c00640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 0x7f00b406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:40.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.505+0000 7f00d9c00640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 0x7f00b406d9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00c8036000 tx=0x7f00c8030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:40.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.507+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f00cc022070 con 0x7f00d4157080 2024-03-07T10:22:40.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.764+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00d40c1e10 con 0x7f00d4157080 2024-03-07T10:22:40.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.765+0000 7f00d1600640 1 -- 172.21.15.194:0/2209998025 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f00cc010040 con 0x7f00d4157080 2024-03-07T10:22:40.766 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:40.766 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:40.766 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 msgr2=0x7f00b406d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 0x7f00b406d9e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00c8036000 tx=0x7f00c8030000 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 msgr2=0x7f00d40c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00efc0 tx=0x7f00cc00c490 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 shutdown_connections 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f00b406b520 0x7f00b406d9e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00d4157080 0x7f00d40c6820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f00d4150b90 0x7f00d4151f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 --2- 172.21.15.194:0/2209998025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f00d40c4870 0x7f00d41e9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 >> 172.21.15.194:0/2209998025 conn(0x7f00d40a94d0 msgr2=0x7f00d40c2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:40.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 shutdown_connections 2024-03-07T10:22:40.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:40.768+0000 7f00db000640 1 -- 172.21.15.194:0/2209998025 wait complete. 2024-03-07T10:22:40.791 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-03-07T10:22:42.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:42.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.974+0000 7f430ac00640 1 Processor -- start 2024-03-07T10:22:42.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.974+0000 7f430ac00640 1 -- start start 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f430ac00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4304071a80 0x7f4304072e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f430ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4304156390 con 0x7f4304072a90 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f430ac00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43040c3a90 con 0x7f43040c31c0 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f430ac00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43040c3d70 con 0x7f4304071a80 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f4309800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4304072a90 0x7f430406c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33180/0 (socket says 172.21.15.194:33180) 2024-03-07T10:22:42.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f4309800640 1 -- 172.21.15.194:0/1844592216 learned_addr learned my addr 172.21.15.194:0/1844592216 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:42.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f430a200640 1 --2- 172.21.15.194:0/1844592216 >> v2:172.21.15.196:3300/0 conn(0x7f4304071a80 0x7f4304072e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890936457 0 0) 0x7f4304156390 con 0x7f4304072a90 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.976+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ec003520 con 0x7f4304072a90 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900903038 0 0) 0x7f42ec003520 con 0x7f4304072a90 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 >> v2:172.21.15.196:3300/0 conn(0x7f4304071a80 msgr2=0x7f4304072e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 --2- 172.21.15.194:0/1844592216 >> v2:172.21.15.196:3300/0 conn(0x7f4304071a80 0x7f4304072e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 >> v1:172.21.15.196:6789/0 conn(0x7f43040c31c0 legacy=0x7f4304152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304156630 con 0x7f4304072a90 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f42f8001670 con 0x7f4304072a90 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 >> v1:172.21.15.194:6789/0 conn(0x7f4304072a90 legacy=0x7f430406c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 0x7f42ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0051c0 0x7f42ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43040c3d70 con 0x7f42ec0039b0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec00c060 con 0x7f42ec0051c0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec00c260 con 0x7f42ec004800 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4309800640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 0x7f42ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f430a200640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0051c0 0x7f42ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.977+0000 7f4308e00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f4309800640 1 -- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42ec004800 msgr2=0x7f42ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f4309800640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f42ec004800 0x7f42ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f4309800640 1 -- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0051c0 msgr2=0x7f42ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f4309800640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0051c0 0x7f42ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f4309800640 1 -- 172.21.15.194:0/1844592216 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec003520 con 0x7f42ec0039b0 2024-03-07T10:22:42.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.978+0000 7f430a200640 1 -- 172.21.15.194:0/1844592216 reap_dead start 2024-03-07T10:22:42.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.979+0000 7f4309800640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 0x7f42ec003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c240 tx=0x7f42ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4a423e6d5d4ae52 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:42.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.979+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8007cf0 con 0x7f42ec0039b0 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.979+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8030070 con 0x7f42ec0039b0 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.979+0000 7f4303e00640 1 -- 172.21.15.194:0/1844592216 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8005d70 con 0x7f42ec0039b0 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 -- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 msgr2=0x7f42ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 0x7f42ec003dd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c240 tx=0x7f42ec005830 comp rx=0 tx=0).stop 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 -- 172.21.15.194:0/1844592216 shutdown_connections 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 --2- 172.21.15.194:0/1844592216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42ec0039b0 0x7f42ec003dd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 -- 172.21.15.194:0/1844592216 >> 172.21.15.194:0/1844592216 conn(0x7f43040c4090 msgr2=0x7f43040c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 -- 172.21.15.194:0/1844592216 shutdown_connections 2024-03-07T10:22:42.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.980+0000 7f430ac00640 1 -- 172.21.15.194:0/1844592216 wait complete. 2024-03-07T10:22:42.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.982+0000 7f430ac00640 1 Processor -- start 2024-03-07T10:22:42.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.982+0000 7f430ac00640 1 -- start start 2024-03-07T10:22:42.986 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0039b0 0x7f43041ebb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43041e8f30 0x7f4304153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4304073200 con 0x7f4304154860 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4304073080 con 0x7f42ec0039b0 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430ac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430406c090 con 0x7f43041e8f30 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f4308e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f4308e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40698/0 (socket says 172.21.15.194:40698) 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f4308e00640 1 -- 172.21.15.194:0/858763829 learned_addr learned my addr 172.21.15.194:0/858763829 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f430a200640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43041e8f30 0x7f4304153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.983+0000 7f4309800640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0039b0 0x7f43041ebb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 -- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43041e8f30 msgr2=0x7f4304153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43041e8f30 0x7f4304153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 -- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0039b0 msgr2=0x7f43041ebb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0039b0 0x7f43041ebb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:42.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 -- 172.21.15.194:0/858763829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43041eb060 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4308e00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e4e0 tx=0x7f42f000e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f00052e0 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0018070 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43041ef070 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0003810 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.984+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43041ef350 con 0x7f4304154860 2024-03-07T10:22:42.988 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.986+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43040675a0 con 0x7f4304154860 2024-03-07T10:22:42.989 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.987+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f42f00039b0 con 0x7f4304154860 2024-03-07T10:22:42.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.988+0000 7f4301600640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 0x7f42e406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:42.990 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.988+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f42f008a210 con 0x7f4304154860 2024-03-07T10:22:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.988+0000 7f4309800640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 0x7f42e406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:42.991 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.989+0000 7f4309800640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 0x7f42e406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42f8034000 tx=0x7f42f8039040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:42.995 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:42.993+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f42f0058bc0 con 0x7f4304154860 2024-03-07T10:22:43.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.276+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43040c6df0 con 0x7f4304154860 2024-03-07T10:22:43.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.277+0000 7f4301600640 1 -- 172.21.15.194:0/858763829 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f42f00584c0 con 0x7f4304154860 2024-03-07T10:22:43.279 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:43.280 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:43.280 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:43.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.279+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 msgr2=0x7f42e406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:43.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.279+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 0x7f42e406d990 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f42f8034000 tx=0x7f42f8039040 comp rx=0 tx=0).stop 2024-03-07T10:22:43.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 msgr2=0x7f43040c0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42f000e4e0 tx=0x7f42f000e9a0 comp rx=0 tx=0).stop 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 shutdown_connections 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f42e406b4d0 0x7f42e406d990 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f43041e8f30 0x7f4304153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4304154860 0x7f43040c0c30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 --2- 172.21.15.194:0/858763829 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f42ec0039b0 0x7f43041ebb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 >> 172.21.15.194:0/858763829 conn(0x7f43040c4090 msgr2=0x7f43041554a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 shutdown_connections 2024-03-07T10:22:43.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:43.280+0000 7f430ac00640 1 -- 172.21.15.194:0/858763829 wait complete. 2024-03-07T10:22:43.300 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-03-07T10:22:45.301 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.537+0000 7f6b8b200640 1 Processor -- start 2024-03-07T10:22:45.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.537+0000 7f6b8b200640 1 -- start start 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6b84159a30 0x7f6b840c3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6b840c2050 0x7f6b8415d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8415d040 con 0x7f6b84157060 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8406d920 con 0x7f6b840c2050 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8406dc00 con 0x7f6b84159a30 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b89e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6b84157060 0x7f6b840c3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33190/0 (socket says 172.21.15.194:33190) 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b89e00640 1 -- 172.21.15.194:0/3686884413 learned_addr learned my addr 172.21.15.194:0/3686884413 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b89400640 1 --2- 172.21.15.194:0/3686884413 >> v2:172.21.15.196:3300/0 conn(0x7f6b84159a30 0x7f6b840c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.538+0000 7f6b8a800640 1 --2- 172.21.15.194:0/3686884413 >> v2:172.21.15.194:3300/0 conn(0x7f6b840c2050 0x7f6b8415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.539+0000 7f6b8a800640 1 -- 172.21.15.194:0/3686884413 >> v2:172.21.15.196:3300/0 conn(0x7f6b84159a30 msgr2=0x7f6b840c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:45.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.539+0000 7f6b8a800640 1 --2- 172.21.15.194:0/3686884413 >> v2:172.21.15.196:3300/0 conn(0x7f6b84159a30 0x7f6b840c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.539+0000 7f6b8a800640 1 -- 172.21.15.194:0/3686884413 >> v1:172.21.15.194:6789/0 conn(0x7f6b84157060 legacy=0x7f6b840c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.539+0000 7f6b8a800640 1 -- 172.21.15.194:0/3686884413 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840c1af0 con 0x7f6b840c2050 2024-03-07T10:22:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.541+0000 7f6b8a800640 1 --2- 172.21.15.194:0/3686884413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b840c2050 0x7f6b8415d520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009d90 tx=0x7f6b8002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec0ec25bc9c2698 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.541+0000 7f6b88a00640 1 -- 172.21.15.194:0/3686884413 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80039070 con 0x7f6b840c2050 2024-03-07T10:22:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.541+0000 7f6b88a00640 1 -- 172.21.15.194:0/3686884413 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8002cc70 con 0x7f6b840c2050 2024-03-07T10:22:45.543 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.541+0000 7f6b88a00640 1 -- 172.21.15.194:0/3686884413 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80034660 con 0x7f6b840c2050 2024-03-07T10:22:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 -- 172.21.15.194:0/3686884413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b840c2050 msgr2=0x7f6b8415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3686884413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b840c2050 0x7f6b8415d520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b80009d90 tx=0x7f6b8002bec0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 -- 172.21.15.194:0/3686884413 shutdown_connections 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3686884413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b840c2050 0x7f6b8415d520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3686884413 >> v2:172.21.15.196:3300/0 conn(0x7f6b84159a30 0x7f6b840c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 -- 172.21.15.194:0/3686884413 >> 172.21.15.194:0/3686884413 conn(0x7f6b840c70f0 msgr2=0x7f6b840c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 -- 172.21.15.194:0/3686884413 shutdown_connections 2024-03-07T10:22:45.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.542+0000 7f6b8b200640 1 -- 172.21.15.194:0/3686884413 wait complete. 2024-03-07T10:22:45.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.545+0000 7f6b8b200640 1 Processor -- start 2024-03-07T10:22:45.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.545+0000 7f6b8b200640 1 -- start start 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b840c2050 0x7f6b841e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b84159a30 0x7f6b841f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c4300 con 0x7f6b84157060 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c1dd0 con 0x7f6b84159a30 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.546+0000 7f6b8b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b840c4480 con 0x7f6b840c2050 2024-03-07T10:22:45.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40728/0 (socket says 172.21.15.194:40728) 2024-03-07T10:22:45.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 -- 172.21.15.194:0/3202915384 learned_addr learned my addr 172.21.15.194:0/3202915384 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:45.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b840c2050 0x7f6b841e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b8a800640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b84159a30 0x7f6b841f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 -- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b840c2050 msgr2=0x7f6b841e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b840c2050 0x7f6b841e69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 -- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b84159a30 msgr2=0x7f6b841f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b84159a30 0x7f6b841f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.547+0000 7f6b89400640 1 -- 172.21.15.194:0/3202915384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b840ac000 con 0x7f6b84157060 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b89400640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400e870 tx=0x7f6b7400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74017070 con 0x7f6b84157060 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7400c940 con 0x7f6b84157060 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7400cd30 con 0x7f6b84157060 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b840ac270 con 0x7f6b84157060 2024-03-07T10:22:45.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.548+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b840ac830 con 0x7f6b84157060 2024-03-07T10:22:45.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.550+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b840c6090 con 0x7f6b84157060 2024-03-07T10:22:45.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.552+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6b7401a070 con 0x7f6b84157060 2024-03-07T10:22:45.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.553+0000 7f6b7e000640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 0x7f6b6806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:45.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.553+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f6b7408a320 con 0x7f6b84157060 2024-03-07T10:22:45.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.553+0000 7f6b89e00640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 0x7f6b6806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:45.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.554+0000 7f6b89e00640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 0x7f6b6806d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007fd0 tx=0x7f6b78007e80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:45.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.561+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6b840c6090 con 0x7f6b84157060 2024-03-07T10:22:45.849 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.847+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b84068170 con 0x7f6b84157060 2024-03-07T10:22:45.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.847+0000 7f6b7e000640 1 -- 172.21.15.194:0/3202915384 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f6b74058840 con 0x7f6b84157060 2024-03-07T10:22:45.850 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:45.850 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:45.851 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.850+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 msgr2=0x7f6b6806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.850+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 0x7f6b6806d990 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6b78007fd0 tx=0x7f6b78007e80 comp rx=0 tx=0).stop 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.850+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 msgr2=0x7f6b841f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.850+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6b7400e870 tx=0x7f6b7400ed30 comp rx=0 tx=0).stop 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 shutdown_connections 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6b6806b4d0 0x7f6b6806d990 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6b84159a30 0x7f6b841f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b84157060 0x7f6b841f2930 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 --2- 172.21.15.194:0/3202915384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6b840c2050 0x7f6b841e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:45.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 >> 172.21.15.194:0/3202915384 conn(0x7f6b840c70f0 msgr2=0x7f6b84159090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:45.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 shutdown_connections 2024-03-07T10:22:45.854 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:45.851+0000 7f6b8b200640 1 -- 172.21.15.194:0/3202915384 wait complete. 2024-03-07T10:22:45.872 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-03-07T10:22:47.873 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:48.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.070+0000 7f9d81200640 1 Processor -- start 2024-03-07T10:22:48.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.070+0000 7f9d81200640 1 -- start start 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d81200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d81200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9d7c06e830 0x7f9d7c1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d81200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c06b120 con 0x7f9d7c152d20 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d81200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c159910 con 0x7f9d7c06e830 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d81200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c06b3c0 con 0x7f9d7c0c2b70 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d7b400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f9d7c152d20 0x7f9d7c06dd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:33202/0 (socket says 172.21.15.194:33202) 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d7b400640 1 -- 172.21.15.194:0/4246031265 learned_addr learned my addr 172.21.15.194:0/4246031265 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.072+0000 7f9d7be00640 1 --2- 172.21.15.194:0/4246031265 >> v2:172.21.15.194:3300/0 conn(0x7f9d7c06e830 0x7f9d7c1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.073+0000 7f9d7aa00640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.073+0000 7f9d7be00640 1 -- 172.21.15.194:0/4246031265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 msgr2=0x7f9d7c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:48.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.073+0000 7f9d7be00640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.073+0000 7f9d7be00640 1 -- 172.21.15.194:0/4246031265 >> v1:172.21.15.194:6789/0 conn(0x7f9d7c152d20 legacy=0x7f9d7c06dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.076 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.073+0000 7f9d7be00640 1 -- 172.21.15.194:0/4246031265 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c06b6a0 con 0x7f9d7c06e830 2024-03-07T10:22:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.074+0000 7f9d7be00640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1593d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a21415c72119378 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.075+0000 7f9d7a000640 1 -- 172.21.15.194:0/4246031265 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74039070 con 0x7f9d7c06e830 2024-03-07T10:22:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.075+0000 7f9d7a000640 1 -- 172.21.15.194:0/4246031265 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7402cc60 con 0x7f9d7c06e830 2024-03-07T10:22:48.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.075+0000 7f9d7a000640 1 -- 172.21.15.194:0/4246031265 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d74034660 con 0x7f9d7c06e830 2024-03-07T10:22:48.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 -- 172.21.15.194:0/4246031265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 msgr2=0x7f9d7c1593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1593d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009d90 tx=0x7f9d7402beb0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 -- 172.21.15.194:0/4246031265 shutdown_connections 2024-03-07T10:22:48.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1593d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 --2- 172.21.15.194:0/4246031265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 -- 172.21.15.194:0/4246031265 >> 172.21.15.194:0/4246031265 conn(0x7f9d7c0c7e10 msgr2=0x7f9d7c0c81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:48.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 -- 172.21.15.194:0/4246031265 shutdown_connections 2024-03-07T10:22:48.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.076+0000 7f9d81200640 1 -- 172.21.15.194:0/4246031265 wait complete. 2024-03-07T10:22:48.080 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.078+0000 7f9d81200640 1 Processor -- start 2024-03-07T10:22:48.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.078+0000 7f9d81200640 1 -- start start 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c1eee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d7c152d20 0x7f9d7c1ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c06e460 con 0x7f9d7c06e830 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c155520 con 0x7f9d7c152d20 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d81200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c06e5e0 con 0x7f9d7c0c2b70 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d7b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40754/0 (socket says 172.21.15.194:40754) 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d7b400640 1 -- 172.21.15.194:0/1345487325 learned_addr learned my addr 172.21.15.194:0/1345487325 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d7aa00640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c1eee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.080+0000 7f9d7be00640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d7c152d20 0x7f9d7c1ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.081+0000 7f9d7b400640 1 -- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 msgr2=0x7f9d7c1eee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.081+0000 7f9d7b400640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c1eee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.081+0000 7f9d7b400640 1 -- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d7c152d20 msgr2=0x7f9d7c1ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.081+0000 7f9d7b400640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d7c152d20 0x7f9d7c1ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.081+0000 7f9d7b400640 1 -- 172.21.15.194:0/1345487325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c156d70 con 0x7f9d7c06e830 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.082+0000 7f9d7b400640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c3c0 tx=0x7f9d6c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.082+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c017070 con 0x7f9d7c06e830 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.082+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c005ce0 con 0x7f9d7c06e830 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.082+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c007310 con 0x7f9d7c06e830 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.082+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d7c1ef4d0 con 0x7f9d7c06e830 2024-03-07T10:22:48.085 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.083+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c157310 con 0x7f9d7c06e830 2024-03-07T10:22:48.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.084+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c1ec740 con 0x7f9d7c06e830 2024-03-07T10:22:48.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.085+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9d6c01a070 con 0x7f9d7c06e830 2024-03-07T10:22:48.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.086+0000 7f9d73400640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 0x7f9d5c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:48.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.086+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f9d6c089830 con 0x7f9d7c06e830 2024-03-07T10:22:48.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.086+0000 7f9d7aa00640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 0x7f9d5c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:48.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.087+0000 7f9d7aa00640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 0x7f9d5c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c150450 tx=0x7f9d68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:48.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.090+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9d6c057cd0 con 0x7f9d7c06e830 2024-03-07T10:22:48.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:22:48.233 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:22:48.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.353+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d7c068170 con 0x7f9d7c06e830 2024-03-07T10:22:48.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.354+0000 7f9d73400640 1 -- 172.21.15.194:0/1345487325 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f9d6c05bd70 con 0x7f9d7c06e830 2024-03-07T10:22:48.359 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:48.360 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:48.360 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:48.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 msgr2=0x7f9d5c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 0x7f9d5c06d990 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c150450 tx=0x7f9d68008040 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 msgr2=0x7f9d7c1ee950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00c3c0 tx=0x7f9d6c00c880 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 shutdown_connections 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9d5c06b4d0 0x7f9d5c06d990 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9d7c152d20 0x7f9d7c1ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9d7c0c2b70 0x7f9d7c1eee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 --2- 172.21.15.194:0/1345487325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9d7c06e830 0x7f9d7c1ee950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 >> 172.21.15.194:0/1345487325 conn(0x7f9d7c0c7e10 msgr2=0x7f9d7c1deb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 shutdown_connections 2024-03-07T10:22:48.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:48.357+0000 7f9d81200640 1 -- 172.21.15.194:0/1345487325 wait complete. 2024-03-07T10:22:48.377 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-03-07T10:22:50.378 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:50.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.547+0000 7f934b200640 1 Processor -- start 2024-03-07T10:22:50.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.547+0000 7f934b200640 1 -- start start 2024-03-07T10:22:50.550 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934b200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9344150a90 0x7f93440c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93440c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934b200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93440c33b0 con 0x7f93440c4130 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934b200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9344072b50 con 0x7f9344150a90 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9344150e70 con 0x7f93440c2690 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f934a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93440c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f9349e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9344150a90 0x7f93440c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f9349e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f9344150a90 0x7f93440c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:47530/0 (socket says 172.21.15.194:47530) 2024-03-07T10:22:50.551 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.549+0000 7f9349e00640 1 -- 172.21.15.194:0/3841888623 learned_addr learned my addr 172.21.15.194:0/3841888623 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:50.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.550+0000 7f9349e00640 1 -- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 msgr2=0x7f93440c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:50.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.550+0000 7f9349e00640 1 --2- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93440c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.550+0000 7f9349e00640 1 -- 172.21.15.194:0/3841888623 >> v1:172.21.15.196:6789/0 conn(0x7f93440c4130 legacy=0x7f93440c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.550+0000 7f9349e00640 1 -- 172.21.15.194:0/3841888623 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344072d80 con 0x7f9344150a90 2024-03-07T10:22:50.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.551+0000 7f9349e00640 1 --2- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9344150a90 0x7f93440c3bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9338009870 tx=0x7f933802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ffa534836fb4372 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:50.553 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.551+0000 7f9348a00640 1 -- 172.21.15.194:0/3841888623 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338034070 con 0x7f9344150a90 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.551+0000 7f9348a00640 1 -- 172.21.15.194:0/3841888623 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9338030860 con 0x7f9344150a90 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.551+0000 7f9348a00640 1 -- 172.21.15.194:0/3841888623 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338030c70 con 0x7f9344150a90 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 -- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9344150a90 msgr2=0x7f93440c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 --2- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9344150a90 0x7f93440c3bf0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9338009870 tx=0x7f933802b9a0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 -- 172.21.15.194:0/3841888623 shutdown_connections 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 --2- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93440c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 --2- 172.21.15.194:0/3841888623 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9344150a90 0x7f93440c3bf0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 -- 172.21.15.194:0/3841888623 >> 172.21.15.194:0/3841888623 conn(0x7f93440c70f0 msgr2=0x7f93440c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 -- 172.21.15.194:0/3841888623 shutdown_connections 2024-03-07T10:22:50.554 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.552+0000 7f934b200640 1 -- 172.21.15.194:0/3841888623 wait complete. 2024-03-07T10:22:50.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.554+0000 7f934b200640 1 Processor -- start 2024-03-07T10:22:50.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.555+0000 7f934b200640 1 -- start start 2024-03-07T10:22:50.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93441ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 0x7f9344143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9344150a90 0x7f93440aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.558 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344073340 con 0x7f9344150a90 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9344071cf0 con 0x7f93440c4130 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f934b200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93440c2320 con 0x7f93440c2690 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f9349e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93441ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f9349e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93441ebd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:55266/0 (socket says 172.21.15.194:55266) 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f9349e00640 1 -- 172.21.15.194:0/1711386107 learned_addr learned my addr 172.21.15.194:0/1711386107 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.556+0000 7f9349400640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 0x7f9344143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f934a800640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9344150a90 0x7f93440aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.559 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 -- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 msgr2=0x7f93441ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93441ebd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 -- 172.21.15.194:0/1711386107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9344150a90 msgr2=0x7f93440aac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9344150a90 0x7f93440aac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 -- 172.21.15.194:0/1711386107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9344147490 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.557+0000 7f9349400640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 0x7f9344143a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f933400c390 tx=0x7f933400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.558+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334017070 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.558+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93340052d0 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.558+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334003810 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.558+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93441eb2a0 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.558+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93441ef5a0 con 0x7f93440c4130 2024-03-07T10:22:50.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.559+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9344068170 con 0x7f93440c4130 2024-03-07T10:22:50.563 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.561+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f933401a070 con 0x7f93440c4130 2024-03-07T10:22:50.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.563+0000 7f933e000640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:50.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.563+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6637+0+0 (secure 0 0 0) 0x7f93340897c0 con 0x7f93440c4130 2024-03-07T10:22:50.564 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.563+0000 7f9349e00640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:50.565 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.564+0000 7f9349e00640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 0x7f932806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f933802b9e0 tx=0x7f9338008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:50.572 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.571+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9334057ce0 con 0x7f93440c4130 2024-03-07T10:22:50.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.856+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93440c69f0 con 0x7f93440c4130 2024-03-07T10:22:50.858 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.857+0000 7f933e000640 1 -- 172.21.15.194:0/1711386107 <== mon.1 v2:172.21.15.196:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+6257 (secure 0 0 0) 0x7f933405bd80 con 0x7f93440c4130 2024-03-07T10:22:50.859 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:50.859 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:21:12.808129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4254},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4254":{"gid":4254,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":6,"addr":"172.21.15.194:6835/1436303034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1436303034},{"type":"v1","addr":"172.21.15.194:6835","nonce":1436303034}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4254,"qdb_cluster":[4254]},"id":2}]} 2024-03-07T10:22:50.859 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 15 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 msgr2=0x7f932806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 0x7f932806d990 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f933802b9e0 tx=0x7f9338008030 comp rx=0 tx=0).stop 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 msgr2=0x7f9344143a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 0x7f9344143a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f933400c390 tx=0x7f933400c850 comp rx=0 tx=0).stop 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 shutdown_connections 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f932806b4d0 0x7f932806d990 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9344150a90 0x7f93440aac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f93440c4130 0x7f9344143a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 --2- 172.21.15.194:0/1711386107 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f93440c2690 0x7f93441ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:50.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.860+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 >> 172.21.15.194:0/1711386107 conn(0x7f93440c70f0 msgr2=0x7f934414dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:50.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.861+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 shutdown_connections 2024-03-07T10:22:50.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:50.861+0000 7f934b200640 1 -- 172.21.15.194:0/1711386107 wait complete. 2024-03-07T10:22:50.880 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-03-07T10:22:52.881 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:53.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.092+0000 7feab0c00640 1 Processor -- start 2024-03-07T10:22:53.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.092+0000 7feab0c00640 1 -- start start 2024-03-07T10:22:53.095 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feab0c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feaac0b0420 0x7feaac1561a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feab0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac159570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feab0c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0c72b0 con 0x7feaac0c58d0 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feab0c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac1590e0 con 0x7feaac0b0420 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feab0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0c92b0 con 0x7feaac0c8e50 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feaabe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7feaac0c58d0 0x7feaac0c7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53396/0 (socket says 172.21.15.194:53396) 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feaabe00640 1 -- 172.21.15.194:0/1668152794 learned_addr learned my addr 172.21.15.194:0/1668152794 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.094+0000 7feaaaa00640 1 --2- 172.21.15.194:0/1668152794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaab400640 1 --2- 172.21.15.194:0/1668152794 >> v2:172.21.15.196:3300/0 conn(0x7feaac0b0420 0x7feaac1561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaaaa00640 1 -- 172.21.15.194:0/1668152794 >> v2:172.21.15.196:3300/0 conn(0x7feaac0b0420 msgr2=0x7feaac1561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:53.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaaaa00640 1 --2- 172.21.15.194:0/1668152794 >> v2:172.21.15.196:3300/0 conn(0x7feaac0b0420 0x7feaac1561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaaaa00640 1 -- 172.21.15.194:0/1668152794 >> v1:172.21.15.194:6789/0 conn(0x7feaac0c58d0 legacy=0x7feaac0c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaaaa00640 1 -- 172.21.15.194:0/1668152794 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac158d90 con 0x7feaac0c8e50 2024-03-07T10:22:53.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.095+0000 7feaaa000640 1 -- 172.21.15.194:0/1668152794 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272102105 0 0) 0x7feaac0c72b0 con 0x7feaac0c58d0 2024-03-07T10:22:53.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.097+0000 7feaaaa00640 1 --2- 172.21.15.194:0/1668152794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac159570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea980097a0 tx=0x7fea9802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9140ec7db5caf550 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.097+0000 7feaaa000640 1 -- 172.21.15.194:0/1668152794 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98035020 con 0x7feaac0c8e50 2024-03-07T10:22:53.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.097+0000 7feaaa000640 1 -- 172.21.15.194:0/1668152794 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea98031830 con 0x7feaac0c8e50 2024-03-07T10:22:53.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.097+0000 7feaaa000640 1 -- 172.21.15.194:0/1668152794 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea98031c00 con 0x7feaac0c8e50 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 -- 172.21.15.194:0/1668152794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 msgr2=0x7feaac159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 --2- 172.21.15.194:0/1668152794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac159570 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fea980097a0 tx=0x7fea9802b8d0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 -- 172.21.15.194:0/1668152794 shutdown_connections 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 --2- 172.21.15.194:0/1668152794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac159570 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 --2- 172.21.15.194:0/1668152794 >> v2:172.21.15.196:3300/0 conn(0x7feaac0b0420 0x7feaac1561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 -- 172.21.15.194:0/1668152794 >> 172.21.15.194:0/1668152794 conn(0x7feaac0671b0 msgr2=0x7feaac0675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 -- 172.21.15.194:0/1668152794 shutdown_connections 2024-03-07T10:22:53.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.098+0000 7feab0c00640 1 -- 172.21.15.194:0/1668152794 wait complete. 2024-03-07T10:22:53.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.101+0000 7feab0c00640 1 Processor -- start 2024-03-07T10:22:53.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.101+0000 7feab0c00640 1 -- start start 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.102+0000 7feab0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.102+0000 7feab0c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac0c58d0 0x7feaac1eb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.102+0000 7feab0c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.102+0000 7feab0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ad5d0 con 0x7feaac0b0420 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feab0c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ad2f0 con 0x7feaac0c58d0 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feab0c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0ad8b0 con 0x7feaac0c8e50 2024-03-07T10:22:53.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51122/0 (socket says 172.21.15.194:51122) 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaab400640 1 -- 172.21.15.194:0/148726878 learned_addr learned my addr 172.21.15.194:0/148726878 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaaaa00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac0c58d0 0x7feaac1eb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 -- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac0c58d0 msgr2=0x7feaac1eb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac0c58d0 0x7feaac1eb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 -- 172.21.15.194:0/148726878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 msgr2=0x7feaac0bf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaabe00640 1 -- 172.21.15.194:0/148726878 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac154d30 con 0x7feaac0c8e50 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.103+0000 7feaab400640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:22:53.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feaabe00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac0aee90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c700 tx=0x7feaa400cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4018070 con 0x7feaac0c8e50 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa400ce10 con 0x7feaac0c8e50 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac155010 con 0x7feaac0c8e50 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa400a880 con 0x7feaac0c8e50 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.104+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1537e0 con 0x7feaac0c8e50 2024-03-07T10:22:53.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.106+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac068170 con 0x7feaac0c8e50 2024-03-07T10:22:53.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.108+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7feaa400aa20 con 0x7feaac0c8e50 2024-03-07T10:22:53.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.109+0000 7feaa3400640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 0x7fea8c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.110+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7feaa4089a00 con 0x7feaac0c8e50 2024-03-07T10:22:53.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.110+0000 7feaab400640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 0x7fea8c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.111+0000 7feaab400640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 0x7fea8c06d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009f50 tx=0x7fea9c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.116+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7feaa4057ea0 con 0x7feaac0c8e50 2024-03-07T10:22:53.569 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.568+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaac06d610 con 0x7feaac0c8e50 2024-03-07T10:22:53.570 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.569+0000 7feaa3400640 1 -- 172.21.15.194:0/148726878 <== mon.2 v2:172.21.15.196:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+5458 (secure 0 0 0) 0x7feaa405bf40 con 0x7feaac0c8e50 2024-03-07T10:22:53.571 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:53.571 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:52.989596+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:replay","state_seq":1,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-03-07T10:22:53.571 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 16 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.572+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 msgr2=0x7fea8c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.572+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 0x7fea8c06d990 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009f50 tx=0x7fea9c009190 comp rx=0 tx=0).stop 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.572+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 msgr2=0x7feaac0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.572+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac0aee90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c700 tx=0x7feaa400cbc0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 shutdown_connections 2024-03-07T10:22:53.574 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fea8c06b4d0 0x7fea8c06d990 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feaac0c8e50 0x7feaac0aee90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feaac0c58d0 0x7feaac1eb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 --2- 172.21.15.194:0/148726878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feaac0b0420 0x7feaac0bf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 >> 172.21.15.194:0/148726878 conn(0x7feaac0671b0 msgr2=0x7feaac0c7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 shutdown_connections 2024-03-07T10:22:53.575 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.573+0000 7feab0c00640 1 -- 172.21.15.194:0/148726878 wait complete. 2024-03-07T10:22:53.599 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-03-07T10:22:53.599 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-03-07T10:22:53.600 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:53.777 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.776+0000 7fd095400640 1 Processor -- start 2024-03-07T10:22:53.778 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.776+0000 7fd095400640 1 -- start start 2024-03-07T10:22:53.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.777+0000 7fd095400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd09006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.777+0000 7fd095400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd09006de40 0x7fd09015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.777+0000 7fd095400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd090153980 con 0x7fd090150b70 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.777+0000 7fd095400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd090153c60 con 0x7fd09006de40 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.777+0000 7fd095400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153f40 con 0x7fd090156c20 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd08e800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd090150b70 0x7fd0900a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53406/0 (socket says 172.21.15.194:53406) 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd08e800640 1 -- 172.21.15.194:0/3339538347 learned_addr learned my addr 172.21.15.194:0/3339538347 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd087e00640 1 --2- 172.21.15.194:0/3339538347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd09006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd08f200640 1 --2- 172.21.15.194:0/3339538347 >> v2:172.21.15.196:3300/0 conn(0x7fd09006de40 0x7fd09015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd08de00640 1 -- 172.21.15.194:0/3339538347 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121347537 0 0) 0x7fd090153980 con 0x7fd090150b70 2024-03-07T10:22:53.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd087e00640 1 -- 172.21.15.194:0/3339538347 >> v2:172.21.15.196:3300/0 conn(0x7fd09006de40 msgr2=0x7fd09015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:53.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd087e00640 1 --2- 172.21.15.194:0/3339538347 >> v2:172.21.15.196:3300/0 conn(0x7fd09006de40 0x7fd09015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd087e00640 1 -- 172.21.15.194:0/3339538347 >> v1:172.21.15.194:6789/0 conn(0x7fd090150b70 legacy=0x7fd0900a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.781 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.778+0000 7fd087e00640 1 -- 172.21.15.194:0/3339538347 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090154220 con 0x7fd090156c20 2024-03-07T10:22:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.780+0000 7fd087e00640 1 --2- 172.21.15.194:0/3339538347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd09006d900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc75fb5599bb1b7d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.780+0000 7fd08de00640 1 -- 172.21.15.194:0/3339538347 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0780315a0 con 0x7fd090156c20 2024-03-07T10:22:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.780+0000 7fd08de00640 1 -- 172.21.15.194:0/3339538347 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd078037070 con 0x7fd090156c20 2024-03-07T10:22:53.782 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.780+0000 7fd08de00640 1 -- 172.21.15.194:0/3339538347 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078031960 con 0x7fd090156c20 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 -- 172.21.15.194:0/3339538347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 msgr2=0x7fd09006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 --2- 172.21.15.194:0/3339538347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd09006d900 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd0780097a0 tx=0x7fd07802b840 comp rx=0 tx=0).stop 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 -- 172.21.15.194:0/3339538347 shutdown_connections 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 --2- 172.21.15.194:0/3339538347 >> v2:172.21.15.196:3300/0 conn(0x7fd09006de40 0x7fd09015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 --2- 172.21.15.194:0/3339538347 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd09006d900 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.781+0000 7fd095400640 1 -- 172.21.15.194:0/3339538347 >> 172.21.15.194:0/3339538347 conn(0x7fd09006b840 msgr2=0x7fd0900c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.782+0000 7fd095400640 1 -- 172.21.15.194:0/3339538347 shutdown_connections 2024-03-07T10:22:53.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.782+0000 7fd095400640 1 -- 172.21.15.194:0/3339538347 wait complete. 2024-03-07T10:22:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.784+0000 7fd095400640 1 Processor -- start 2024-03-07T10:22:53.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.784+0000 7fd095400640 1 -- start start 2024-03-07T10:22:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.785+0000 7fd095400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.785+0000 7fd095400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd090150b70 0x7fd0900724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd095400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd090145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd095400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900a9be0 con 0x7fd09006de40 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd095400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd090153630 con 0x7fd090150b70 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd095400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900a9d60 con 0x7fd090156c20 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51134/0 (socket says 172.21.15.194:51134) 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 -- 172.21.15.194:0/2483335131 learned_addr learned my addr 172.21.15.194:0/2483335131 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd087e00640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd090150b70 0x7fd0900724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08f200640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd090145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 -- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 msgr2=0x7fd090145cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd090145cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 -- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd090150b70 msgr2=0x7fd0900724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd090150b70 0x7fd0900724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.786+0000 7fd08e800640 1 -- 172.21.15.194:0/2483335131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900c15d0 con 0x7fd09006de40 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd08e800640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c460 tx=0x7fd08000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080018070 con 0x7fd09006de40 2024-03-07T10:22:53.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd080007500 con 0x7fd09006de40 2024-03-07T10:22:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd080004a20 con 0x7fd09006de40 2024-03-07T10:22:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd090153170 con 0x7fd09006de40 2024-03-07T10:22:53.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.787+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0901527a0 con 0x7fd09006de40 2024-03-07T10:22:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.790+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd08001b070 con 0x7fd09006de40 2024-03-07T10:22:53.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.790+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd090068170 con 0x7fd09006de40 2024-03-07T10:22:53.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.791+0000 7fd086a00640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 0x7fd06c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:53.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.791+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fd0800899a0 con 0x7fd09006de40 2024-03-07T10:22:53.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.792+0000 7fd087e00640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 0x7fd06c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:53.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.792+0000 7fd087e00640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 0x7fd06c06d9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd078036000 tx=0x7fd078008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:53.796 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:53.795+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd080058490 con 0x7fd09006de40 2024-03-07T10:22:54.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.048+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd09006cd20 con 0x7fd09006de40 2024-03-07T10:22:54.050 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.049+0000 7fd086a00640 1 -- 172.21.15.194:0/2483335131 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+5462 (secure 0 0 0) 0x7fd080057d90 con 0x7fd09006de40 2024-03-07T10:22:54.050 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:54.050 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:53.024197+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":32,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-03-07T10:22:54.050 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 17 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 msgr2=0x7fd06c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 0x7fd06c06d9e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd078036000 tx=0x7fd078008030 comp rx=0 tx=0).stop 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 msgr2=0x7fd0901e74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd08000c460 tx=0x7fd08000c920 comp rx=0 tx=0).stop 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 shutdown_connections 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd06c06b520 0x7fd06c06d9e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd090156c20 0x7fd090145cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:54.053 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd090150b70 0x7fd0900724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 --2- 172.21.15.194:0/2483335131 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd09006de40 0x7fd0901e74c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 >> 172.21.15.194:0/2483335131 conn(0x7fd09006b840 msgr2=0x7fd0900c1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 shutdown_connections 2024-03-07T10:22:54.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:54.051+0000 7fd095400640 1 -- 172.21.15.194:0/2483335131 wait complete. 2024-03-07T10:22:54.069 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:20:57.593298+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 9, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4266": { "addr": "172.21.15.196:6835/1848630458", "addrs": { "addrvec": [ { "addr": "172.21.15.196:6834", "nonce": 1848630458, "type": "v2" }, { "addr": "172.21.15.196:6835", "nonce": 1848630458, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4266, "incarnation": 4, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 0, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-03-07T10:21:01.661187+0000", "qdb_cluster": [ 4266 ], "qdb_leader": 4266, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4266 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:21:08.712900+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4251": { "addr": "172.21.15.194:6833/1582324990", "addrs": { "addrvec": [ { "addr": "172.21.15.194:6832", "nonce": 1582324990, "type": "v2" }, { "addr": "172.21.15.194:6833", "nonce": 1582324990, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4251, "incarnation": 16, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:reconnect", "state_seq": 32 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-03-07T10:22:53.024197+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4251 } } } ], "standbys": [ { "addr": "172.21.15.196:6837/1953632658", "addrs": { "addrvec": [ { "addr": "172.21.15.196:6836", "nonce": 1953632658, "type": "v2" }, { "addr": "172.21.15.196:6837", "nonce": 1953632658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-03-07T10:22:56.070 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:22:56.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.290+0000 7f9bacc00640 1 Processor -- start 2024-03-07T10:22:56.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.290+0000 7f9bacc00640 1 -- start start 2024-03-07T10:22:56.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.291+0000 7f9bacc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 0x7f9ba8066eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.291+0000 7f9bacc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9ba8158cf0 0x7f9ba81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.291+0000 7f9bacc00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba8153160 con 0x7f9ba80a8df0 2024-03-07T10:22:56.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.291+0000 7f9bacc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba806f7a0 con 0x7f9ba8158cf0 2024-03-07T10:22:56.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.291+0000 7f9bacc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80c2bd0 con 0x7f9ba8152d80 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 0x7f9ba8066eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba5400640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f9ba80a8df0 0x7f9ba806c090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:54310/0 (socket says 172.21.15.194:54310) 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba5400640 1 -- 172.21.15.194:0/2538636794 learned_addr learned my addr 172.21.15.194:0/2538636794 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba6800640 1 --2- 172.21.15.194:0/2538636794 >> v2:172.21.15.194:3300/0 conn(0x7f9ba8158cf0 0x7f9ba81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba4a00640 1 -- 172.21.15.194:0/2538636794 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582244248 0 0) 0x7f9b94001110 con 0x7f9ba80a8df0 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba4a00640 1 -- 172.21.15.194:0/2538636794 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b8c003520 con 0x7f9ba80a8df0 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba6800640 1 -- 172.21.15.194:0/2538636794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 msgr2=0x7f9ba8066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba6800640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 0x7f9ba8066eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba6800640 1 -- 172.21.15.194:0/2538636794 >> v1:172.21.15.196:6789/0 conn(0x7f9ba80a8df0 legacy=0x7f9ba806c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba6800640 1 -- 172.21.15.194:0/2538636794 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80673f0 con 0x7f9ba8158cf0 2024-03-07T10:22:56.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.292+0000 7f9ba5e00640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 0x7f9ba8066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:22:56.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.294+0000 7f9ba6800640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81591a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009d90 tx=0x7f9ba002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39219ab4b5e21539 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:56.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.294+0000 7f9ba4a00640 1 -- 172.21.15.194:0/2538636794 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0039070 con 0x7f9ba8158cf0 2024-03-07T10:22:56.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.294+0000 7f9ba4a00640 1 -- 172.21.15.194:0/2538636794 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba002cbd0 con 0x7f9ba8158cf0 2024-03-07T10:22:56.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.294+0000 7f9ba4a00640 1 -- 172.21.15.194:0/2538636794 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0034440 con 0x7f9ba8158cf0 2024-03-07T10:22:56.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 -- 172.21.15.194:0/2538636794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8158cf0 msgr2=0x7f9ba81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81591a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009d90 tx=0x7f9ba002be20 comp rx=0 tx=0).stop 2024-03-07T10:22:56.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 -- 172.21.15.194:0/2538636794 shutdown_connections 2024-03-07T10:22:56.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81591a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 --2- 172.21.15.194:0/2538636794 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba8152d80 0x7f9ba8066eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 -- 172.21.15.194:0/2538636794 >> 172.21.15.194:0/2538636794 conn(0x7f9ba80c41a0 msgr2=0x7f9ba80c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:56.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 -- 172.21.15.194:0/2538636794 shutdown_connections 2024-03-07T10:22:56.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.295+0000 7f9bacc00640 1 -- 172.21.15.194:0/2538636794 wait complete. 2024-03-07T10:22:56.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.297+0000 7f9bacc00640 1 Processor -- start 2024-03-07T10:22:56.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.297+0000 7f9bacc00640 1 -- start start 2024-03-07T10:22:56.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 0x7f9ba81ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81eec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80c2580 con 0x7f9ba8152d80 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba806fcd0 con 0x7f9ba8158cf0 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9bacc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba80c2860 con 0x7f9ba80a8df0 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9ba5e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 0x7f9ba81ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9ba5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51144/0 (socket says 172.21.15.194:51144) 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9ba5400640 1 -- 172.21.15.194:0/3871688544 learned_addr learned my addr 172.21.15.194:0/3871688544 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:22:56.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.298+0000 7f9ba6800640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81eec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 -- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 msgr2=0x7f9ba81ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 0x7f9ba81ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 -- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ba8158cf0 msgr2=0x7f9ba81eec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81eec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 -- 172.21.15.194:0/3871688544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba81ef680 con 0x7f9ba8152d80 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5e00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 0x7f9ba81ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9ba5400640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c760 tx=0x7f9b9400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.299+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94017070 con 0x7f9ba8152d80 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.300+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b94005ab0 con 0x7f9ba8152d80 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.300+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9400ce10 con 0x7f9ba8152d80 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.300+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba814bbf0 con 0x7f9ba8152d80 2024-03-07T10:22:56.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.301+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba814af50 con 0x7f9ba8152d80 2024-03-07T10:22:56.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.302+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba8068170 con 0x7f9ba8152d80 2024-03-07T10:22:56.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.303+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f9b9401a070 con 0x7f9ba8152d80 2024-03-07T10:22:56.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.304+0000 7f9b9e000640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 0x7f9b8806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:22:56.305 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.304+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f9b94089540 con 0x7f9ba8152d80 2024-03-07T10:22:56.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.304+0000 7f9ba5e00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 0x7f9b8806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:22:56.306 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.305+0000 7f9ba5e00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 0x7f9b8806d9e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009ba0 tx=0x7f9b98008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:22:56.310 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.309+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f9ba8153160 con 0x7f9ba8152d80 2024-03-07T10:22:56.555 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.554+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ba8149e10 con 0x7f9ba8152d80 2024-03-07T10:22:56.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.554+0000 7f9b9e000640 1 -- 172.21.15.194:0/3871688544 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+5466 (secure 0 0 0) 0x7f9b940579f0 con 0x7f9ba8152d80 2024-03-07T10:22:56.560 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:22:56.560 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 19 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 msgr2=0x7f9b8806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 0x7f9b8806d9e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9b98009ba0 tx=0x7f9b98008040 comp rx=0 tx=0).stop 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 msgr2=0x7f9ba814a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c760 tx=0x7f9b9400cc20 comp rx=0 tx=0).stop 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 shutdown_connections 2024-03-07T10:22:56.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f9b8806b520 0x7f9b8806d9e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f9ba8158cf0 0x7f9ba81eec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ba8152d80 0x7f9ba814a4d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 --2- 172.21.15.194:0/3871688544 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f9ba80a8df0 0x7f9ba81ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 >> 172.21.15.194:0/3871688544 conn(0x7f9ba80c41a0 msgr2=0x7f9ba8150880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 shutdown_connections 2024-03-07T10:22:56.562 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:22:56.558+0000 7f9bacc00640 1 -- 172.21.15.194:0/3871688544 wait complete. 2024-03-07T10:22:56.582 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4254 2024-03-07T10:22:56.582 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.c 2024-03-07T10:22:57.901 INFO:tasks.ceph.mds.a.smithi194.stderr:2024-03-07T10:22:57.900+0000 7fabfc800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:23:04.583 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-03-07T10:23:04.583 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-07T10:23:04.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-07T10:23:04.589 INFO:tasks.ceph.mds.c:Started 2024-03-07T10:23:04.589 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:04.818 INFO:tasks.ceph.mds.c.smithi194.stdout:starting mds.c at 2024-03-07T10:23:04.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.862+0000 7fee47400640 1 Processor -- start 2024-03-07T10:23:04.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.862+0000 7fee47400640 1 -- start start 2024-03-07T10:23:04.864 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee47400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40150b70 0x7fee400a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee47400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee40153980 con 0x7fee40156c20 2024-03-07T10:23:04.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee47400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee40153c60 con 0x7fee400a9a10 2024-03-07T10:23:04.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee47400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee40153f40 con 0x7fee40150b70 2024-03-07T10:23:04.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee3fe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fee40156c20 0x7fee4006d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:44200/0 (socket says 172.21.15.194:44200) 2024-03-07T10:23:04.865 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.863+0000 7fee3fe00640 1 -- 172.21.15.194:0/4044468434 learned_addr learned my addr 172.21.15.194:0/4044468434 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147772782 0 0) 0x7fee40153980 con 0x7fee40156c20 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee28003520 con 0x7fee40156c20 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155647557 0 0) 0x7fee40153c60 con 0x7fee400a9a10 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee40153980 con 0x7fee400a9a10 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711437581 0 0) 0x7fee28003520 con 0x7fee40156c20 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40150b70 msgr2=0x7fee400a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:04.866 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40150b70 0x7fee400a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 >> v1:172.21.15.196:6789/0 conn(0x7fee400a9a10 legacy=0x7fee4015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40154220 con 0x7fee40156c20 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fee2c001670 con 0x7fee40156c20 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.864+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 >> v1:172.21.15.194:6789/0 conn(0x7fee40156c20 legacy=0x7fee4006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee28003b70 0x7fee28003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee28004800 0x7fee28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee280052e0 0x7fee2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee40153f40 con 0x7fee280052e0 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2800c1e0 con 0x7fee28004800 2024-03-07T10:23:04.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2800c3e0 con 0x7fee28003b70 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee3fe00640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee28004800 0x7fee28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.865+0000 7fee45400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee280052e0 0x7fee2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.866+0000 7fee45400640 1 -- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee28003b70 msgr2=0x7fee28003f70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.866+0000 7fee45400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee28003b70 0x7fee28003f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.866+0000 7fee45400640 1 -- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee28004800 msgr2=0x7fee28004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.866+0000 7fee45400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee28004800 0x7fee28004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:04.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.866+0000 7fee45400640 1 -- 172.21.15.194:0/4044468434 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee40154220 con 0x7fee280052e0 2024-03-07T10:23:04.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.867+0000 7fee45400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee280052e0 0x7fee2800b9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee38001ba0 tx=0x7fee28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f98933cd5748159 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:04.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.867+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38001be0 con 0x7fee280052e0 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.867+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38030bd0 con 0x7fee280052e0 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.867+0000 7fee3f400640 1 -- 172.21.15.194:0/4044468434 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38003970 con 0x7fee280052e0 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 -- 172.21.15.194:0/4044468434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee280052e0 msgr2=0x7fee2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 --2- 172.21.15.194:0/4044468434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee280052e0 0x7fee2800b9c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fee38001ba0 tx=0x7fee28005830 comp rx=0 tx=0).stop 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee45400640 1 -- 172.21.15.194:0/4044468434 reap_dead start 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 -- 172.21.15.194:0/4044468434 shutdown_connections 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 -- 172.21.15.194:0/4044468434 >> 172.21.15.194:0/4044468434 conn(0x7fee4006b840 msgr2=0x7fee400c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 -- 172.21.15.194:0/4044468434 shutdown_connections 2024-03-07T10:23:04.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.868+0000 7fee47400640 1 -- 172.21.15.194:0/4044468434 wait complete. 2024-03-07T10:23:04.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.870+0000 7fee47400640 1 Processor -- start 2024-03-07T10:23:04.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.870+0000 7fee47400640 1 -- start start 2024-03-07T10:23:04.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 0x7fee401e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 0x7fee4014a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee400ac460 con 0x7fee400c6be0 2024-03-07T10:23:04.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee40153630 con 0x7fee280052e0 2024-03-07T10:23:04.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee47400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee401e70f0 con 0x7fee40154a20 2024-03-07T10:23:04.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee45400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 0x7fee4014a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee44a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.871+0000 7fee44a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:40200/0 (socket says 172.21.15.194:40200) 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee44a00640 1 -- 172.21.15.194:0/2987995217 learned_addr learned my addr 172.21.15.194:0/2987995217 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee3fe00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 0x7fee401e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee45400640 1 -- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 msgr2=0x7fee401e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee45400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 0x7fee401e7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee45400640 1 -- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 msgr2=0x7fee4014ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee45400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee45400640 1 -- 172.21.15.194:0/2987995217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee401560a0 con 0x7fee400c6be0 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee3fe00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 0x7fee401e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.872+0000 7fee44a00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee45400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 0x7fee4014a610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee38004000 tx=0x7fee38001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee38003b80 con 0x7fee400c6be0 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee38046070 con 0x7fee400c6be0 2024-03-07T10:23:04.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee40156380 con 0x7fee400c6be0 2024-03-07T10:23:04.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee401e7340 con 0x7fee400c6be0 2024-03-07T10:23:04.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.873+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee380050d0 con 0x7fee400c6be0 2024-03-07T10:23:04.876 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.875+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c005290 con 0x7fee400c6be0 2024-03-07T10:23:04.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.876+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fee38040070 con 0x7fee400c6be0 2024-03-07T10:23:04.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.877+0000 7fee3cc00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 0x7fee2006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:04.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.877+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fee380afe70 con 0x7fee400c6be0 2024-03-07T10:23:04.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.878+0000 7fee44a00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 0x7fee2006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:04.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.879+0000 7fee44a00640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 0x7fee2006d9c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee340098c0 tx=0x7fee34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:04.883 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:04.882+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fee3807e8e0 con 0x7fee400c6be0 2024-03-07T10:23:05.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.253+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee1c005580 con 0x7fee400c6be0 2024-03-07T10:23:05.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.253+0000 7fee3cc00640 1 -- 172.21.15.194:0/2987995217 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7fee3807e1e0 con 0x7fee400c6be0 2024-03-07T10:23:05.255 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:05.255 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:05.255 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.256+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 msgr2=0x7fee2006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.256+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 0x7fee2006d9c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fee340098c0 tx=0x7fee34008040 comp rx=0 tx=0).stop 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.256+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 msgr2=0x7fee4014a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 0x7fee4014a610 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fee38004000 tx=0x7fee38001650 comp rx=0 tx=0).stop 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 shutdown_connections 2024-03-07T10:23:05.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fee2006b500 0x7fee2006d9c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee400c6be0 0x7fee4014a610 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fee40154a20 0x7fee401e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 --2- 172.21.15.194:0/2987995217 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fee280052e0 0x7fee4014ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 >> 172.21.15.194:0/2987995217 conn(0x7fee4006b840 msgr2=0x7fee4014dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 shutdown_connections 2024-03-07T10:23:05.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:05.257+0000 7fee47400640 1 -- 172.21.15.194:0/2987995217 wait complete. 2024-03-07T10:23:05.275 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-03-07T10:23:05.275 INFO:tasks.mds_thrash.fs.[b]:waiting for 35 secs before thrashing 2024-03-07T10:23:18.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:23:18.380 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:23:19.163 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:19.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.352+0000 7f2d10a00640 1 Processor -- start 2024-03-07T10:23:19.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.352+0000 7f2d10a00640 1 -- start start 2024-03-07T10:23:19.355 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d10a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d10a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f2d0c152c80 0x7f2d0c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d10a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0c155b20 con 0x7f2d0c1528a0 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d10a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c155dc0 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d10a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0c156080 con 0x7f2d0c152c80 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d0a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d0a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33190/0 (socket says 172.21.15.194:33190) 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d0a800640 1 -- 172.21.15.194:0/2487359960 learned_addr learned my addr 172.21.15.194:0/2487359960 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:19.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.354+0000 7f2d0b200640 1 --2- 172.21.15.194:0/2487359960 >> v2:172.21.15.196:3300/0 conn(0x7f2d0c152c80 0x7f2d0c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.355+0000 7f2d0a800640 1 -- 172.21.15.194:0/2487359960 >> v2:172.21.15.196:3300/0 conn(0x7f2d0c152c80 msgr2=0x7f2d0c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.355+0000 7f2d0a800640 1 --2- 172.21.15.194:0/2487359960 >> v2:172.21.15.196:3300/0 conn(0x7f2d0c152c80 0x7f2d0c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.355+0000 7f2d0a800640 1 -- 172.21.15.194:0/2487359960 >> v1:172.21.15.196:6789/0 conn(0x7f2d0c1528a0 legacy=0x7f2d0c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.355+0000 7f2d0a800640 1 -- 172.21.15.194:0/2487359960 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c156360 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.357 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.356+0000 7f2d0a800640 1 --2- 172.21.15.194:0/2487359960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0c8900 tx=0x7f2cfc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ee1d3765e3a01 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.356+0000 7f2d09400640 1 -- 172.21.15.194:0/2487359960 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc035020 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.356+0000 7f2d09400640 1 -- 172.21.15.194:0/2487359960 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cfc031870 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.356+0000 7f2d09400640 1 -- 172.21.15.194:0/2487359960 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc031c40 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 -- 172.21.15.194:0/2487359960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c0c5bc0 msgr2=0x7f2d0c0c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.358 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 --2- 172.21.15.194:0/2487359960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0c8900 tx=0x7f2cfc02b910 comp rx=0 tx=0).stop 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 -- 172.21.15.194:0/2487359960 shutdown_connections 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 --2- 172.21.15.194:0/2487359960 >> v2:172.21.15.196:3300/0 conn(0x7f2d0c152c80 0x7f2d0c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 --2- 172.21.15.194:0/2487359960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c0c5bc0 0x7f2d0c0c8ed0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 -- 172.21.15.194:0/2487359960 >> 172.21.15.194:0/2487359960 conn(0x7f2d0c0675e0 msgr2=0x7f2d0c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 -- 172.21.15.194:0/2487359960 shutdown_connections 2024-03-07T10:23:19.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.357+0000 7f2d10a00640 1 -- 172.21.15.194:0/2487359960 wait complete. 2024-03-07T10:23:19.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.358+0000 7f2d10a00640 1 Processor -- start 2024-03-07T10:23:19.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.359+0000 7f2d10a00640 1 -- start start 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.359+0000 7f2d10a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d0c0c5bc0 0x7f2d0c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.359+0000 7f2d10a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d10a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d0c152c80 0x7f2d0c144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d10a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c1530d0 con 0x7f2d0c1528a0 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d10a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c06ce10 con 0x7f2d0c152c80 2024-03-07T10:23:19.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d10a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0c155730 con 0x7f2d0c0c5bc0 2024-03-07T10:23:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d09e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d09e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33206/0 (socket says 172.21.15.194:33206) 2024-03-07T10:23:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d09e00640 1 -- 172.21.15.194:0/3129298207 learned_addr learned my addr 172.21.15.194:0/3129298207 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d0a800640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d0c0c5bc0 0x7f2d0c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.360+0000 7f2d0b200640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d0c152c80 0x7f2d0c144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 -- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d0c0c5bc0 msgr2=0x7f2d0c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d0c0c5bc0 0x7f2d0c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 -- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d0c152c80 msgr2=0x7f2d0c144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d0c152c80 0x7f2d0c144870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 -- 172.21.15.194:0/3129298207 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c14d000 con 0x7f2d0c1528a0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d09e00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c430 tx=0x7f2cf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80052d0 con 0x7f2d0c1528a0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8005490 con 0x7f2d0c1528a0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8007260 con 0x7f2d0c1528a0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0c14d2e0 con 0x7f2d0c1528a0 2024-03-07T10:23:19.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.361+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0c14d930 con 0x7f2d0c1528a0 2024-03-07T10:23:19.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.362+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d0c068170 con 0x7f2d0c1528a0 2024-03-07T10:23:19.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.363+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f2cf8007400 con 0x7f2d0c1528a0 2024-03-07T10:23:19.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.364+0000 7f2d02a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 0x7f2cec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.364+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f2cf8089a40 con 0x7f2d0c1528a0 2024-03-07T10:23:19.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.365+0000 7f2d0a800640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 0x7f2cec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.366+0000 7f2d0a800640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 0x7f2cec06d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc036000 tx=0x7f2cfc03c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.369+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f2cf8057e60 con 0x7f2d0c1528a0 2024-03-07T10:23:19.729 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.728+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d0c06d450 con 0x7f2d0c1528a0 2024-03-07T10:23:19.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.729+0000 7f2d02a00640 1 -- 172.21.15.194:0/3129298207 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f2cf805ce20 con 0x7f2d0c1528a0 2024-03-07T10:23:19.730 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:19.730 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:19.731 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 msgr2=0x7f2cec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 0x7f2cec06d990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc036000 tx=0x7f2cfc03c040 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 msgr2=0x7f2d0c144330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800c430 tx=0x7f2cf800c8f0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 shutdown_connections 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f2cec06b4d0 0x7f2cec06d990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f2d0c152c80 0x7f2d0c144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d0c1528a0 0x7f2d0c144330 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 --2- 172.21.15.194:0/3129298207 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2d0c0c5bc0 0x7f2d0c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 >> 172.21.15.194:0/3129298207 conn(0x7f2d0c0675e0 msgr2=0x7f2d0c0ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:19.733 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 shutdown_connections 2024-03-07T10:23:19.734 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.731+0000 7f2d10a00640 1 -- 172.21.15.194:0/3129298207 wait complete. 2024-03-07T10:23:19.750 INFO:tasks.mds_thrash.fs.[a]:kill mds.b (rank=0) 2024-03-07T10:23:19.750 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-07T10:23:19.750 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:23:19.774 INFO:tasks.ceph.mds.b:Stopped 2024-03-07T10:23:19.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.960+0000 7fdac6400640 1 Processor -- start 2024-03-07T10:23:19.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.960+0000 7fdac6400640 1 -- start start 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdac6400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdac00be720 0x7fdac01556b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdac6400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac0156300 con 0x7fdac00c8f90 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdac6400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac0159750 con 0x7fdac0152e90 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdac6400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac00cb3c0 con 0x7fdac00be720 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdabea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdac00be720 0x7fdac01556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.961+0000 7fdabea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdac00be720 0x7fdac01556b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33220/0 (socket says 172.21.15.194:33220) 2024-03-07T10:23:19.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.962+0000 7fdabea00640 1 -- 172.21.15.194:0/2919650493 learned_addr learned my addr 172.21.15.194:0/2919650493 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:19.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.962+0000 7fdabea00640 1 -- 172.21.15.194:0/2919650493 >> v1:172.21.15.196:6789/0 conn(0x7fdac0152e90 legacy=0x7fdac00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:19.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.962+0000 7fdabea00640 1 -- 172.21.15.194:0/2919650493 >> v1:172.21.15.194:6789/0 conn(0x7fdac00c8f90 legacy=0x7fdac0155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.962+0000 7fdabea00640 1 -- 172.21.15.194:0/2919650493 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac0159a30 con 0x7fdac00be720 2024-03-07T10:23:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.963+0000 7fdabea00640 1 --2- 172.21.15.194:0/2919650493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac00be720 0x7fdac01556b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdabe3f9495c68f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.963+0000 7fdabe000640 1 -- 172.21.15.194:0/2919650493 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac02e070 con 0x7fdac00be720 2024-03-07T10:23:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.963+0000 7fdabe000640 1 -- 172.21.15.194:0/2919650493 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac037070 con 0x7fdac00be720 2024-03-07T10:23:19.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.963+0000 7fdabe000640 1 -- 172.21.15.194:0/2919650493 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac031a00 con 0x7fdac00be720 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 -- 172.21.15.194:0/2919650493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac00be720 msgr2=0x7fdac01556b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 --2- 172.21.15.194:0/2919650493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac00be720 0x7fdac01556b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac02b880 comp rx=0 tx=0).stop 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 -- 172.21.15.194:0/2919650493 shutdown_connections 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 --2- 172.21.15.194:0/2919650493 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac00be720 0x7fdac01556b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 -- 172.21.15.194:0/2919650493 >> 172.21.15.194:0/2919650493 conn(0x7fdac0066f70 msgr2=0x7fdac0067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 -- 172.21.15.194:0/2919650493 shutdown_connections 2024-03-07T10:23:19.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.964+0000 7fdac6400640 1 -- 172.21.15.194:0/2919650493 wait complete. 2024-03-07T10:23:19.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.966+0000 7fdac6400640 1 Processor -- start 2024-03-07T10:23:19.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.966+0000 7fdac6400640 1 -- start start 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 0x7fdac014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdac00c8f90 0x7fdac0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac006d850 con 0x7fdac0152e90 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac00cb980 con 0x7fdac00be720 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdac6400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac006d9d0 con 0x7fdac00c8f90 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33232/0 (socket says 172.21.15.194:33232) 2024-03-07T10:23:19.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 -- 172.21.15.194:0/318888567 learned_addr learned my addr 172.21.15.194:0/318888567 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabf400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 0x7fdac014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabea00640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdac00c8f90 0x7fdac0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 -- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdac00c8f90 msgr2=0x7fdac0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdac00c8f90 0x7fdac0154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 -- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 msgr2=0x7fdac014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 0x7fdac014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabfe00640 1 -- 172.21.15.194:0/318888567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac01e2e70 con 0x7fdac0152e90 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.968+0000 7fdabf400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 0x7fdac014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:23:19.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdabfe00640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c6e0 tx=0x7fdab800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8003b70 con 0x7fdac0152e90 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab8003d30 con 0x7fdac0152e90 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac01ee790 con 0x7fdac0152e90 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8005310 con 0x7fdac0152e90 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.969+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac01eed10 con 0x7fdac0152e90 2024-03-07T10:23:19.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.971+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac0068170 con 0x7fdac0152e90 2024-03-07T10:23:19.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.971+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fdab80054b0 con 0x7fdac0152e90 2024-03-07T10:23:19.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.972+0000 7fdab7400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 0x7fdaa006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:19.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.972+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fdab808a4e0 con 0x7fdac0152e90 2024-03-07T10:23:19.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.973+0000 7fdabf400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 0x7fdaa006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:19.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.974+0000 7fdabf400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 0x7fdaa006d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdab0003eb0 tx=0x7fdab0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:19.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:19.977+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdab8058ec0 con 0x7fdac0152e90 2024-03-07T10:23:20.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.273+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac006d580 con 0x7fdac0152e90 2024-03-07T10:23:20.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.274+0000 7fdab7400640 1 -- 172.21.15.194:0/318888567 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7fdab80587c0 con 0x7fdac0152e90 2024-03-07T10:23:20.275 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:20.275 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:20.276 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 msgr2=0x7fdaa006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 0x7fdaa006d990 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdab0003eb0 tx=0x7fdab0009040 comp rx=0 tx=0).stop 2024-03-07T10:23:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 msgr2=0x7fdac0154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdab800c6e0 tx=0x7fdab800cba0 comp rx=0 tx=0).stop 2024-03-07T10:23:20.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 shutdown_connections 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fdaa006b4d0 0x7fdaa006d990 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdac0152e90 0x7fdac0154570 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdac00c8f90 0x7fdac0154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 --2- 172.21.15.194:0/318888567 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdac00be720 0x7fdac014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 >> 172.21.15.194:0/318888567 conn(0x7fdac0066f70 msgr2=0x7fdac00ca4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 shutdown_connections 2024-03-07T10:23:20.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:20.277+0000 7fdac6400640 1 -- 172.21.15.194:0/318888567 wait complete. 2024-03-07T10:23:20.296 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:20.656 INFO:tasks.workunit.client.0.smithi194.stderr:Updating files: 58% (7228/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 99% (12182/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-07T10:23:21.299 INFO:tasks.workunit.client.0.smithi194.stderr:Note: switching to '8b896a9e145796119f0451201dc4d53ddac97db0'. 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr:state without impacting any branches by switching back to a branch. 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-07T10:23:21.300 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: git switch -c 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr:Or undo this operation with: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: git switch - 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr: 2024-03-07T10:23:21.301 INFO:tasks.workunit.client.0.smithi194.stderr:HEAD is now at 8b896a9e145 mds/quiesce-db: keep the db thread alive until shutdown 2024-03-07T10:23:21.306 DEBUG:teuthology.orchestra.run.smithi194:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-07T10:23:21.406 INFO:tasks.workunit.client.0.smithi194.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-07T10:23:21.412 INFO:tasks.workunit.client.0.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-07T10:23:21.412 INFO:tasks.workunit.client.0.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-07T10:23:21.712 INFO:tasks.workunit.client.1.smithi196.stderr:Updating files: 63% (7817/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-07T10:23:22.210 INFO:tasks.workunit.client.0.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-07T10:23:22.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:22.340 INFO:tasks.workunit.client.0.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-07T10:23:22.343 INFO:tasks.workunit.client.1.smithi196.stderr:Note: switching to '8b896a9e145796119f0451201dc4d53ddac97db0'. 2024-03-07T10:23:22.343 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:state without impacting any branches by switching back to a branch. 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: git switch -c 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:Or undo this operation with: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: git switch - 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.344 INFO:tasks.workunit.client.1.smithi196.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-07T10:23:22.345 INFO:tasks.workunit.client.1.smithi196.stderr: 2024-03-07T10:23:22.345 INFO:tasks.workunit.client.1.smithi196.stderr:HEAD is now at 8b896a9e145 mds/quiesce-db: keep the db thread alive until shutdown 2024-03-07T10:23:22.350 DEBUG:teuthology.orchestra.run.smithi196:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-07T10:23:22.409 INFO:tasks.workunit.client.1.smithi196.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-07T10:23:22.416 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-07T10:23:22.416 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-07T10:23:22.420 INFO:tasks.workunit.client.0.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-07T10:23:22.424 INFO:tasks.workunit.client.0.smithi194.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-07T10:23:22.424 INFO:tasks.workunit.client.0.smithi194.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-07T10:23:22.496 INFO:tasks.workunit.client.0.smithi194.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-07T10:23:22.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.499+0000 7f0b01a00640 1 Processor -- start 2024-03-07T10:23:22.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.499+0000 7f0b01a00640 1 -- start start 2024-03-07T10:23:22.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.500+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.500+0000 7f0b01a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0afc06c1c0 0x7f0afc06c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.500+0000 7f0b01a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc155b20 con 0x7f0afc0c5bc0 2024-03-07T10:23:22.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.500+0000 7f0b01a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0c95e0 con 0x7f0afc06c1c0 2024-03-07T10:23:22.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.500+0000 7f0b01a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc1531c0 con 0x7f0afc1528a0 2024-03-07T10:23:22.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.501+0000 7f0b01000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0afc06c1c0 0x7f0afc06c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.501+0000 7f0afb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.501+0000 7f0b01000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0afc06c1c0 0x7f0afc06c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:59180/0 (socket says 172.21.15.194:59180) 2024-03-07T10:23:22.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.501+0000 7f0b01000640 1 -- 172.21.15.194:0/943047831 learned_addr learned my addr 172.21.15.194:0/943047831 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:22.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.502+0000 7f0b01000640 1 -- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 msgr2=0x7f0afc152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:22.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.502+0000 7f0b01000640 1 --2- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.502+0000 7f0b01000640 1 -- 172.21.15.194:0/943047831 >> v1:172.21.15.196:6789/0 conn(0x7f0afc0c5bc0 legacy=0x7f0afc0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.502+0000 7f0b01000640 1 -- 172.21.15.194:0/943047831 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc155dc0 con 0x7f0afc06c1c0 2024-03-07T10:23:22.505 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:23:22.505 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-07T10:23:22.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.503+0000 7f0b01000640 1 --2- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc06c1c0 0x7f0afc06c630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009870 tx=0x7f0af402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89ac2607633b2d6e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:22.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.504+0000 7f0afaa00640 1 -- 172.21.15.194:0/943047831 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af4035020 con 0x7f0afc06c1c0 2024-03-07T10:23:22.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.504+0000 7f0afaa00640 1 -- 172.21.15.194:0/943047831 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af4031640 con 0x7f0afc06c1c0 2024-03-07T10:23:22.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.504+0000 7f0afaa00640 1 -- 172.21.15.194:0/943047831 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af402d040 con 0x7f0afc06c1c0 2024-03-07T10:23:22.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 -- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc06c1c0 msgr2=0x7f0afc06c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 --2- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc06c1c0 0x7f0afc06c630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009870 tx=0x7f0af402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 -- 172.21.15.194:0/943047831 shutdown_connections 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 --2- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc06c1c0 0x7f0afc06c630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 --2- 172.21.15.194:0/943047831 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 -- 172.21.15.194:0/943047831 >> 172.21.15.194:0/943047831 conn(0x7f0afc0675e0 msgr2=0x7f0afc0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 -- 172.21.15.194:0/943047831 shutdown_connections 2024-03-07T10:23:22.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.505+0000 7f0b01a00640 1 -- 172.21.15.194:0/943047831 wait complete. 2024-03-07T10:23:22.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.507+0000 7f0b01a00640 1 Processor -- start 2024-03-07T10:23:22.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.507+0000 7f0b01a00640 1 -- start start 2024-03-07T10:23:22.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc0c5bc0 0x7f0afc1ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc156640 con 0x7f0afc06c1c0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc156360 con 0x7f0afc0c5bc0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc155730 con 0x7f0afc1528a0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33236/0 (socket says 172.21.15.194:33236) 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afbe00640 1 -- 172.21.15.194:0/1357271999 learned_addr learned my addr 172.21.15.194:0/1357271999 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0b01000640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afb400640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc0c5bc0 0x7f0afc1ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afbe00640 1 -- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 msgr2=0x7f0afc150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.508+0000 7f0afbe00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0afbe00640 1 -- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc0c5bc0 msgr2=0x7f0afc1ee580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0afbe00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc0c5bc0 0x7f0afc1ee580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0afbe00640 1 -- 172.21.15.194:0/1357271999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0c20a0 con 0x7f0afc06c1c0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0afbe00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c7a0 tx=0x7f0aec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec003b90 con 0x7f0afc06c1c0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec003d50 con 0x7f0afc06c1c0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec00aa90 con 0x7f0afc06c1c0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc0c2ab0 con 0x7f0afc06c1c0 2024-03-07T10:23:22.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.509+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc150380 con 0x7f0afc06c1c0 2024-03-07T10:23:22.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.510+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc1ef000 con 0x7f0afc06c1c0 2024-03-07T10:23:22.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.512+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0aec00ac30 con 0x7f0afc06c1c0 2024-03-07T10:23:22.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.513+0000 7f0af3e00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 0x7f0adc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:22.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.513+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f0aec08a420 con 0x7f0afc06c1c0 2024-03-07T10:23:22.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.514+0000 7f0afb400640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 0x7f0adc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:22.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.515+0000 7f0afb400640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 0x7f0adc06d9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0afc150170 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:22.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.519+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0afc1ef000 con 0x7f0afc06c1c0 2024-03-07T10:23:22.543 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2024-03-07T10:23:22.545 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-03-07T10:23:22.546 DEBUG:teuthology.orchestra.run.smithi194:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b896a9e145796119f0451201dc4d53ddac97db0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2024-03-07T10:23:22.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.788+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0afc150690 con 0x7f0afc06c1c0 2024-03-07T10:23:22.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.789+0000 7f0af3e00640 1 -- 172.21.15.194:0/1357271999 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f0aec058f30 con 0x7f0afc06c1c0 2024-03-07T10:23:22.790 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:22.790 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:22.791 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:22.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 msgr2=0x7f0adc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 0x7f0adc06d9c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0afc150170 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 msgr2=0x7f0afc14cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c7a0 tx=0x7f0aec00cc60 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 shutdown_connections 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0adc06b500 0x7f0adc06d9c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0afc1528a0 0x7f0afc150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0afc0c5bc0 0x7f0afc1ee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 --2- 172.21.15.194:0/1357271999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0afc06c1c0 0x7f0afc14cdb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 >> 172.21.15.194:0/1357271999 conn(0x7f0afc0675e0 msgr2=0x7f0afc0cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 shutdown_connections 2024-03-07T10:23:22.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:22.791+0000 7f0b01a00640 1 -- 172.21.15.194:0/1357271999 wait complete. 2024-03-07T10:23:22.811 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:23.224 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-07T10:23:23.363 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-07T10:23:23.446 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-07T10:23:23.451 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-07T10:23:23.452 INFO:tasks.workunit.client.1.smithi196.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-07T10:23:23.529 INFO:tasks.workunit.client.1.smithi196.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-07T10:23:23.539 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:23:23.539 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-07T10:23:23.586 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.1... 2024-03-07T10:23:23.587 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2024-03-07T10:23:23.588 DEBUG:teuthology.orchestra.run.smithi196:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8b896a9e145796119f0451201dc4d53ddac97db0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/misc/trivial_sync.sh 2024-03-07T10:23:24.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:25.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.021+0000 7f26f1400640 1 Processor -- start 2024-03-07T10:23:25.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.022+0000 7f26f1400640 1 -- start start 2024-03-07T10:23:25.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 0x7f26ec154020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26f1400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec06f850 con 0x7f26ec150ac0 2024-03-07T10:23:25.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26f1400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26ec06fb30 con 0x7f26ec0abea0 2024-03-07T10:23:25.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26f1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec06e380 con 0x7f26ec0a8df0 2024-03-07T10:23:25.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26ea800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f26ec150ac0 0x7f26ec06eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:58872/0 (socket says 172.21.15.194:58872) 2024-03-07T10:23:25.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.023+0000 7f26ea800640 1 -- 172.21.15.194:0/263976106 learned_addr learned my addr 172.21.15.194:0/263976106 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e1e00640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 0x7f26ec154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1626245037 0 0) 0x7f26ec06f850 con 0x7f26ec150ac0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d0003520 con 0x7f26ec150ac0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970892055 0 0) 0x7f26d0003520 con 0x7f26ec150ac0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 msgr2=0x7f26ec154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 0x7f26ec154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 >> v1:172.21.15.196:6789/0 conn(0x7f26ec0abea0 legacy=0x7f26ec06c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec06e5d0 con 0x7f26ec150ac0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f26d4001670 con 0x7f26ec150ac0 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 >> v1:172.21.15.194:6789/0 conn(0x7f26ec150ac0 legacy=0x7f26ec06eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d00039e0 0x7f26d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 0x7f26d0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26d0004d40 0x7f26d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec06e380 con 0x7f26d0004d40 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d000baa0 con 0x7f26d00039e0 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.024+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d000bca0 con 0x7f26ec0a8df0 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26d0004d40 0x7f26d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26ea800640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d00039e0 0x7f26d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 -- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 msgr2=0x7f26d0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec0a8df0 0x7f26d0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 -- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d00039e0 msgr2=0x7f26d0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d00039e0 0x7f26d0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.025+0000 7f26eb200640 1 -- 172.21.15.194:0/263976106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0003520 con 0x7f26d0004d40 2024-03-07T10:23:25.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.026+0000 7f26eb200640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26d0004d40 0x7f26d00051c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001e20 tx=0x7f26d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31be44c0be2f591d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:25.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.026+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4001a70 con 0x7f26d0004d40 2024-03-07T10:23:25.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.026+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e4003b70 con 0x7f26d0004d40 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.026+0000 7f26e9e00640 1 -- 172.21.15.194:0/263976106 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40050d0 con 0x7f26d0004d40 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 -- 172.21.15.194:0/263976106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26d0004d40 msgr2=0x7f26d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 --2- 172.21.15.194:0/263976106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26d0004d40 0x7f26d00051c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001e20 tx=0x7f26d0005830 comp rx=0 tx=0).stop 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26eb200640 1 -- 172.21.15.194:0/263976106 reap_dead start 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 -- 172.21.15.194:0/263976106 shutdown_connections 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 -- 172.21.15.194:0/263976106 >> 172.21.15.194:0/263976106 conn(0x7f26ec0c41a0 msgr2=0x7f26ec0c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 -- 172.21.15.194:0/263976106 shutdown_connections 2024-03-07T10:23:25.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.027+0000 7f26f1400640 1 -- 172.21.15.194:0/263976106 wait complete. 2024-03-07T10:23:25.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.030+0000 7f26f1400640 1 Processor -- start 2024-03-07T10:23:25.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.030+0000 7f26f1400640 1 -- start start 2024-03-07T10:23:25.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.031+0000 7f26f1400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d0004d40 0x7f26ec141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.031+0000 7f26f1400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec1449c0 0x7f26ec140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.031+0000 7f26f1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26f1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec06c7a0 con 0x7f26ec14a800 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26f1400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec0c4e20 con 0x7f26d0004d40 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26f1400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26ec06c920 con 0x7f26ec1449c0 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33260/0 (socket says 172.21.15.194:33260) 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 -- 172.21.15.194:0/674947271 learned_addr learned my addr 172.21.15.194:0/674947271 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26ea800640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d0004d40 0x7f26ec141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26e1e00640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec1449c0 0x7f26ec140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 -- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec1449c0 msgr2=0x7f26ec140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec1449c0 0x7f26ec140210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 -- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d0004d40 msgr2=0x7f26ec141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d0004d40 0x7f26ec141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.032+0000 7f26eb200640 1 -- 172.21.15.194:0/674947271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec157960 con 0x7f26ec14a800 2024-03-07T10:23:25.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26eb200640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001f40 tx=0x7f26e40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:25.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4007db0 con 0x7f26ec14a800 2024-03-07T10:23:25.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e4003970 con 0x7f26ec14a800 2024-03-07T10:23:25.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e4006d50 con 0x7f26ec14a800 2024-03-07T10:23:25.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26ec14b420 con 0x7f26ec14a800 2024-03-07T10:23:25.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.033+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26ec14b9e0 con 0x7f26ec14a800 2024-03-07T10:23:25.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.034+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26ec068170 con 0x7f26ec14a800 2024-03-07T10:23:25.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.035+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f26e4007030 con 0x7f26ec14a800 2024-03-07T10:23:25.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.036+0000 7f26e3400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:25.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.036+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f26e40ab810 con 0x7f26ec14a800 2024-03-07T10:23:25.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.037+0000 7f26ea800640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:25.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.038+0000 7f26ea800640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 0x7f26c806d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26d4001050 tx=0x7f26d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:25.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.046+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f26e4033020 con 0x7f26ec14a800 2024-03-07T10:23:25.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.282+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26ec06f490 con 0x7f26ec14a800 2024-03-07T10:23:25.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.283+0000 7f26e3400640 1 -- 172.21.15.194:0/674947271 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f26e4003b40 con 0x7f26ec14a800 2024-03-07T10:23:25.285 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:25.285 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:25.285 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 msgr2=0x7f26c806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 0x7f26c806d9c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26d4001050 tx=0x7f26d4009040 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 msgr2=0x7f26ec13eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f26e4001f40 tx=0x7f26e40014a0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 shutdown_connections 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f26c806b500 0x7f26c806d9c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26ec14a800 0x7f26ec13eb60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f26ec1449c0 0x7f26ec140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 --2- 172.21.15.194:0/674947271 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f26d0004d40 0x7f26ec141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:25.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 >> 172.21.15.194:0/674947271 conn(0x7f26ec0c41a0 msgr2=0x7f26ec06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:25.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 shutdown_connections 2024-03-07T10:23:25.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:25.286+0000 7f26f1400640 1 -- 172.21.15.194:0/674947271 wait complete. 2024-03-07T10:23:25.307 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:25.712 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-07T10:23:25.712 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-07T10:23:25.837 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.1... 2024-03-07T10:23:25.837 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-07T10:23:26.828 DEBUG:teuthology.parallel:result is None 2024-03-07T10:23:27.308 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:27.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.522+0000 7f4d56600640 1 Processor -- start 2024-03-07T10:23:27.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.523+0000 7f4d56600640 1 -- start start 2024-03-07T10:23:27.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d56600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4d501528a0 0x7f4d50152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d56600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4d5006c1c0 0x7f4d5006c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d56600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d50155b20 con 0x7f4d500c5bc0 2024-03-07T10:23:27.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d56600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d500c95e0 con 0x7f4d5006c1c0 2024-03-07T10:23:27.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d56600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d501531c0 con 0x7f4d501528a0 2024-03-07T10:23:27.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d55200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4d500c5bc0 0x7f4d500c8ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:58878/0 (socket says 172.21.15.194:58878) 2024-03-07T10:23:27.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d55200640 1 -- 172.21.15.194:0/1814530698 learned_addr learned my addr 172.21.15.194:0/1814530698 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.524+0000 7f4d55c00640 1 --2- 172.21.15.194:0/1814530698 >> v2:172.21.15.194:3300/0 conn(0x7f4d5006c1c0 0x7f4d5006c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d47e00640 1 --2- 172.21.15.194:0/1814530698 >> v2:172.21.15.196:3300/0 conn(0x7f4d501528a0 0x7f4d50152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d4fe00640 1 -- 172.21.15.194:0/1814530698 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973936374 0 0) 0x7f4d50155b20 con 0x7f4d500c5bc0 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d4fe00640 1 -- 172.21.15.194:0/1814530698 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d34003520 con 0x7f4d500c5bc0 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d55c00640 1 -- 172.21.15.194:0/1814530698 >> v2:172.21.15.196:3300/0 conn(0x7f4d501528a0 msgr2=0x7f4d50152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d55c00640 1 --2- 172.21.15.194:0/1814530698 >> v2:172.21.15.196:3300/0 conn(0x7f4d501528a0 0x7f4d50152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d55c00640 1 -- 172.21.15.194:0/1814530698 >> v1:172.21.15.194:6789/0 conn(0x7f4d500c5bc0 legacy=0x7f4d500c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.525+0000 7f4d55c00640 1 -- 172.21.15.194:0/1814530698 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50155dc0 con 0x7f4d5006c1c0 2024-03-07T10:23:27.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.526+0000 7f4d55c00640 1 --2- 172.21.15.194:0/1814530698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d5006c1c0 0x7f4d5006c610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d500bea80 tx=0x7f4d4802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b637ac932cc3f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.526+0000 7f4d4fe00640 1 -- 172.21.15.194:0/1814530698 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48039070 con 0x7f4d5006c1c0 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.526+0000 7f4d4fe00640 1 -- 172.21.15.194:0/1814530698 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4802cbf0 con 0x7f4d5006c1c0 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.526+0000 7f4d4fe00640 1 -- 172.21.15.194:0/1814530698 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48034440 con 0x7f4d5006c1c0 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 -- 172.21.15.194:0/1814530698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d5006c1c0 msgr2=0x7f4d5006c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 --2- 172.21.15.194:0/1814530698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d5006c1c0 0x7f4d5006c610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d500bea80 tx=0x7f4d4802be40 comp rx=0 tx=0).stop 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 -- 172.21.15.194:0/1814530698 shutdown_connections 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 --2- 172.21.15.194:0/1814530698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d5006c1c0 0x7f4d5006c610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 --2- 172.21.15.194:0/1814530698 >> v2:172.21.15.196:3300/0 conn(0x7f4d501528a0 0x7f4d50152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 -- 172.21.15.194:0/1814530698 >> 172.21.15.194:0/1814530698 conn(0x7f4d500675e0 msgr2=0x7f4d500cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 -- 172.21.15.194:0/1814530698 shutdown_connections 2024-03-07T10:23:27.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.527+0000 7f4d56600640 1 -- 172.21.15.194:0/1814530698 wait complete. 2024-03-07T10:23:27.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.530+0000 7f4d56600640 1 Processor -- start 2024-03-07T10:23:27.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.530+0000 7f4d56600640 1 -- start start 2024-03-07T10:23:27.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.531+0000 7f4d56600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d5006c1c0 0x7f4d5014ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.531+0000 7f4d56600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d500c5bc0 0x7f4d5014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d56600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d56600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50156640 con 0x7f4d501528a0 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d56600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50156360 con 0x7f4d500c5bc0 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d56600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d50155730 con 0x7f4d5006c1c0 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:33278/0 (socket says 172.21.15.194:33278) 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 -- 172.21.15.194:0/530559556 learned_addr learned my addr 172.21.15.194:0/530559556 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 -- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d5006c1c0 msgr2=0x7f4d5014ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d5006c1c0 0x7f4d5014ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 -- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d500c5bc0 msgr2=0x7f4d5014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d500c5bc0 0x7f4d5014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.532+0000 7f4d55c00640 1 -- 172.21.15.194:0/530559556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d501ef550 con 0x7f4d501528a0 2024-03-07T10:23:27.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d55c00640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009e80 tx=0x7f4d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48039050 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d48045070 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d48009450 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d50158dc0 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.533+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d501588a0 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.534+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5014cbd0 con 0x7f4d501528a0 2024-03-07T10:23:27.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.535+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4d4803e850 con 0x7f4d501528a0 2024-03-07T10:23:27.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.536+0000 7f4d4d600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 0x7f4d2c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:27.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.536+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f4d480acc40 con 0x7f4d501528a0 2024-03-07T10:23:27.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.537+0000 7f4d55200640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 0x7f4d2c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:27.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.538+0000 7f4d55200640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 0x7f4d2c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000f60 tx=0x7f4d400078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:27.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.541+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4d5014cbd0 con 0x7f4d501528a0 2024-03-07T10:23:27.779 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.777+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d50068170 con 0x7f4d501528a0 2024-03-07T10:23:27.780 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.778+0000 7f4d4d600640 1 -- 172.21.15.194:0/530559556 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f4d4804e020 con 0x7f4d501528a0 2024-03-07T10:23:27.780 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:27.780 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:27.780 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 msgr2=0x7f4d2c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 0x7f4d2c06d9c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000f60 tx=0x7f4d400078f0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 msgr2=0x7f4d501eb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4d48009e80 tx=0x7f4d48004a40 comp rx=0 tx=0).stop 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 shutdown_connections 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4d2c06b500 0x7f4d2c06d9c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.783 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d501528a0 0x7f4d501eb530 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4d500c5bc0 0x7f4d5014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 --2- 172.21.15.194:0/530559556 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4d5006c1c0 0x7f4d5014ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:27.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.781+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 >> 172.21.15.194:0/530559556 conn(0x7f4d500675e0 msgr2=0x7f4d500cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:27.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.782+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 shutdown_connections 2024-03-07T10:23:27.784 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:27.782+0000 7f4d56600640 1 -- 172.21.15.194:0/530559556 wait complete. 2024-03-07T10:23:27.802 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:29.803 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:30.017 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.016+0000 7f4660400640 1 Processor -- start 2024-03-07T10:23:30.018 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.016+0000 7f4660400640 1 -- start start 2024-03-07T10:23:30.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f4660400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f46580ad8e0 0x7f46580adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f4660400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4658159a40 0x7f4658155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f4660400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46580c2180 con 0x7f46580c2f70 2024-03-07T10:23:30.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f4660400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46580c39f0 con 0x7f46580ad8e0 2024-03-07T10:23:30.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f4660400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46580c3cd0 con 0x7f4658159a40 2024-03-07T10:23:30.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f465da00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f46580ad8e0 0x7f46580adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:30.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f465e400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f46580c2f70 0x7f465806b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:49470/0 (socket says 172.21.15.194:49470) 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.018+0000 7f465e400640 1 -- 172.21.15.194:0/1243803580 learned_addr learned my addr 172.21.15.194:0/1243803580 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f465d000640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4658159a40 0x7f4658155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f4657e00640 1 -- 172.21.15.194:0/1243803580 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432921279 0 0) 0x7f46580c2180 con 0x7f46580c2f70 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f465da00640 1 -- 172.21.15.194:0/1243803580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4658159a40 msgr2=0x7f4658155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f465da00640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4658159a40 0x7f4658155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f465da00640 1 -- 172.21.15.194:0/1243803580 >> v1:172.21.15.194:6789/0 conn(0x7f46580c2f70 legacy=0x7f465806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.019+0000 7f465da00640 1 -- 172.21.15.194:0/1243803580 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580c1ea0 con 0x7f46580ad8e0 2024-03-07T10:23:30.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.020+0000 7f465da00640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46580ad8e0 0x7f46580adcc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f208d8de7d95919 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.020+0000 7f4657e00640 1 -- 172.21.15.194:0/1243803580 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c031780 con 0x7f46580ad8e0 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.020+0000 7f4657e00640 1 -- 172.21.15.194:0/1243803580 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c037070 con 0x7f46580ad8e0 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.020+0000 7f4657e00640 1 -- 172.21.15.194:0/1243803580 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c031b40 con 0x7f46580ad8e0 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 -- 172.21.15.194:0/1243803580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46580ad8e0 msgr2=0x7f46580adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46580ad8e0 0x7f46580adcc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f464c0097a0 tx=0x7f464c02b820 comp rx=0 tx=0).stop 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 -- 172.21.15.194:0/1243803580 shutdown_connections 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4658159a40 0x7f4658155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 --2- 172.21.15.194:0/1243803580 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46580ad8e0 0x7f46580adcc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 -- 172.21.15.194:0/1243803580 >> 172.21.15.194:0/1243803580 conn(0x7f46580c4b40 msgr2=0x7f46580c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 -- 172.21.15.194:0/1243803580 shutdown_connections 2024-03-07T10:23:30.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.021+0000 7f4660400640 1 -- 172.21.15.194:0/1243803580 wait complete. 2024-03-07T10:23:30.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.024+0000 7f4660400640 1 Processor -- start 2024-03-07T10:23:30.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.024+0000 7f4660400640 1 -- start start 2024-03-07T10:23:30.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46580ad8e0 0x7f4658149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46580c2f70 0x7f4658139690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4658153050 con 0x7f4658159a40 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46580c4340 con 0x7f46580ad8e0 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.025+0000 7f4660400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46581531d0 con 0x7f46580c2f70 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46554/0 (socket says 172.21.15.194:46554) 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 -- 172.21.15.194:0/75611134 learned_addr learned my addr 172.21.15.194:0/75611134 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 -- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46580c2f70 msgr2=0x7f4658139690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46580c2f70 0x7f4658139690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 -- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46580ad8e0 msgr2=0x7f4658149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46580ad8e0 0x7f4658149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 -- 172.21.15.194:0/75611134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658158660 con 0x7f4658159a40 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.026+0000 7f465e400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f465000c700 tx=0x7f465000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.027+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650018070 con 0x7f4658159a40 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.027+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465000ce10 con 0x7f4658159a40 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.027+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000a880 con 0x7f4658159a40 2024-03-07T10:23:30.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.027+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46581ee8b0 con 0x7f4658159a40 2024-03-07T10:23:30.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.027+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46580c6470 con 0x7f4658159a40 2024-03-07T10:23:30.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.028+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4658068170 con 0x7f4658159a40 2024-03-07T10:23:30.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.029+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f465000aa20 con 0x7f4658159a40 2024-03-07T10:23:30.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.030+0000 7f4655600640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 0x7f463806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:30.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.030+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f4650089c40 con 0x7f4658159a40 2024-03-07T10:23:30.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.030+0000 7f465da00640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 0x7f463806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:30.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.031+0000 7f465da00640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 0x7f463806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f464c036000 tx=0x7f464c030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:30.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.034+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4650058620 con 0x7f4658159a40 2024-03-07T10:23:30.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.293+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46580c6640 con 0x7f4658159a40 2024-03-07T10:23:30.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.294+0000 7f4655600640 1 -- 172.21.15.194:0/75611134 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f4650057f20 con 0x7f4658159a40 2024-03-07T10:23:30.297 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:30.297 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:30.297 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:30.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 msgr2=0x7f463806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 0x7f463806d990 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f464c036000 tx=0x7f464c030000 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 msgr2=0x7f4658139bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f465000c700 tx=0x7f465000cbc0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 shutdown_connections 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f463806b4d0 0x7f463806d990 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4658159a40 0x7f4658139bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f46580c2f70 0x7f4658139690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 --2- 172.21.15.194:0/75611134 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f46580ad8e0 0x7f4658149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 >> 172.21.15.194:0/75611134 conn(0x7f46580c4b40 msgr2=0x7f4658150c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:30.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 shutdown_connections 2024-03-07T10:23:30.302 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:30.297+0000 7f4660400640 1 -- 172.21.15.194:0/75611134 wait complete. 2024-03-07T10:23:30.320 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:32.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:32.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.532+0000 7f2956400640 1 Processor -- start 2024-03-07T10:23:32.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.532+0000 7f2956400640 1 -- start start 2024-03-07T10:23:32.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f2956400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f295006e010 0x7f295015efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:32.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f2956400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2950153980 con 0x7f2950156c20 2024-03-07T10:23:32.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f2956400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2950153c60 con 0x7f2950150b70 2024-03-07T10:23:32.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f2956400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2950153f40 con 0x7f295006e010 2024-03-07T10:23:32.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f294fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f295006e010 0x7f295015efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:32.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f294fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f295006e010 0x7f295015efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46566/0 (socket says 172.21.15.194:46566) 2024-03-07T10:23:32.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.534+0000 7f294fe00640 1 -- 172.21.15.194:0/2031168463 learned_addr learned my addr 172.21.15.194:0/2031168463 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:32.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.535+0000 7f294fe00640 1 -- 172.21.15.194:0/2031168463 >> v1:172.21.15.196:6789/0 conn(0x7f2950150b70 legacy=0x7f29500a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:32.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.535+0000 7f294fe00640 1 -- 172.21.15.194:0/2031168463 >> v1:172.21.15.194:6789/0 conn(0x7f2950156c20 legacy=0x7f295006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.535+0000 7f294fe00640 1 -- 172.21.15.194:0/2031168463 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950154220 con 0x7f295006e010 2024-03-07T10:23:32.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.535+0000 7f294ea00640 1 -- 172.21.15.194:0/2031168463 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042946021 0 0) 0x7f2950153980 con 0x7f2950156c20 2024-03-07T10:23:32.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.536+0000 7f294fe00640 1 --2- 172.21.15.194:0/2031168463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f295006e010 0x7f295015efc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e50 tx=0x7f294802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8469f2a07f6f27 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:32.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.536+0000 7f294ea00640 1 -- 172.21.15.194:0/2031168463 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294802ca80 con 0x7f295006e010 2024-03-07T10:23:32.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.536+0000 7f294ea00640 1 -- 172.21.15.194:0/2031168463 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294802cc20 con 0x7f295006e010 2024-03-07T10:23:32.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.536+0000 7f294ea00640 1 -- 172.21.15.194:0/2031168463 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480343f0 con 0x7f295006e010 2024-03-07T10:23:32.539 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 -- 172.21.15.194:0/2031168463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f295006e010 msgr2=0x7f295015efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 --2- 172.21.15.194:0/2031168463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f295006e010 0x7f295015efc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2948009e50 tx=0x7f294802bee0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 -- 172.21.15.194:0/2031168463 shutdown_connections 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 --2- 172.21.15.194:0/2031168463 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f295006e010 0x7f295015efc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 -- 172.21.15.194:0/2031168463 >> 172.21.15.194:0/2031168463 conn(0x7f295006b840 msgr2=0x7f29500c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 -- 172.21.15.194:0/2031168463 shutdown_connections 2024-03-07T10:23:32.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.537+0000 7f2956400640 1 -- 172.21.15.194:0/2031168463 wait complete. 2024-03-07T10:23:32.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.539+0000 7f2956400640 1 Processor -- start 2024-03-07T10:23:32.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.540+0000 7f2956400640 1 -- start start 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 0x7f29501519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2950156c20 0x7f29501ecbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295006e460 con 0x7f2950150b70 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2950153630 con 0x7f295006e010 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2956400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500a9be0 con 0x7f2950156c20 2024-03-07T10:23:32.545 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2947e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.541+0000 7f2947e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46578/0 (socket says 172.21.15.194:46578) 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 -- 172.21.15.194:0/872511403 learned_addr learned my addr 172.21.15.194:0/872511403 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f294fe00640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2950156c20 0x7f29501ecbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f294f400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 0x7f29501519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 -- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2950156c20 msgr2=0x7f29501ecbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2950156c20 0x7f29501ecbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 -- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 msgr2=0x7f29501519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 0x7f29501519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 -- 172.21.15.194:0/872511403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950149480 con 0x7f2950150b70 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f294f400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 0x7f29501519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947e00640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f293800c440 tx=0x7f293800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.542+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938017070 con 0x7f2950150b70 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.543+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938005480 con 0x7f2950150b70 2024-03-07T10:23:32.546 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.543+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938003830 con 0x7f2950150b70 2024-03-07T10:23:32.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.543+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29501ec410 con 0x7f2950150b70 2024-03-07T10:23:32.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.543+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2950148ec0 con 0x7f2950150b70 2024-03-07T10:23:32.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.544+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29500ac580 con 0x7f2950150b70 2024-03-07T10:23:32.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.545+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f293801a070 con 0x7f2950150b70 2024-03-07T10:23:32.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.545+0000 7f2947400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 0x7f292c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:32.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.546+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f2938089940 con 0x7f2950150b70 2024-03-07T10:23:32.548 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.546+0000 7f294f400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 0x7f292c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:32.549 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.547+0000 7f294f400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 0x7f292c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2940003eb0 tx=0x7f2940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:32.552 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.550+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f29500ac580 con 0x7f2950150b70 2024-03-07T10:23:32.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.784+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2950068170 con 0x7f2950150b70 2024-03-07T10:23:32.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.785+0000 7f2947400640 1 -- 172.21.15.194:0/872511403 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f2938058320 con 0x7f2950150b70 2024-03-07T10:23:32.788 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:32.788 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:32.789 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 msgr2=0x7f292c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 0x7f292c06d9c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2940003eb0 tx=0x7f2940009040 comp rx=0 tx=0).stop 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 msgr2=0x7f295014bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f293800c440 tx=0x7f293800c900 comp rx=0 tx=0).stop 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 shutdown_connections 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f292c06b500 0x7f292c06d9c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f2950156c20 0x7f29501ecbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2950150b70 0x7f295014bcb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 --2- 172.21.15.194:0/872511403 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f295006e010 0x7f29501519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:32.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 >> 172.21.15.194:0/872511403 conn(0x7f295006b840 msgr2=0x7f295014de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:32.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 shutdown_connections 2024-03-07T10:23:32.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:32.788+0000 7f2956400640 1 -- 172.21.15.194:0/872511403 wait complete. 2024-03-07T10:23:32.809 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:34.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:35.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.019+0000 7f1ffec00640 1 Processor -- start 2024-03-07T10:23:35.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.019+0000 7f1ffec00640 1 -- start start 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1ff80c79e0 0x7f1ff80c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff8159c20 con 0x7f1ff81560d0 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff8159010 con 0x7f1ff80c90f0 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff81592f0 con 0x7f1ff80c79e0 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffe200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1ff81560d0 0x7f1ff8160030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:49496/0 (socket says 172.21.15.194:49496) 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.020+0000 7f1ffe200640 1 -- 172.21.15.194:0/2454173773 learned_addr learned my addr 172.21.15.194:0/2454173773 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:35.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ffd800640 1 --2- 172.21.15.194:0/2454173773 >> v2:172.21.15.194:3300/0 conn(0x7f1ff80c79e0 0x7f1ff80c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:35.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ff7e00640 1 -- 172.21.15.194:0/2454173773 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406237294 0 0) 0x7f1ff8159c20 con 0x7f1ff81560d0 2024-03-07T10:23:35.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ff7e00640 1 -- 172.21.15.194:0/2454173773 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe0003520 con 0x7f1ff81560d0 2024-03-07T10:23:35.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ffd800640 1 -- 172.21.15.194:0/2454173773 >> v1:172.21.15.196:6789/0 conn(0x7f1ff80c90f0 legacy=0x7f1ff81559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ffd800640 1 -- 172.21.15.194:0/2454173773 >> v1:172.21.15.194:6789/0 conn(0x7f1ff81560d0 legacy=0x7f1ff8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.021+0000 7f1ffd800640 1 -- 172.21.15.194:0/2454173773 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff81595d0 con 0x7f1ff80c79e0 2024-03-07T10:23:35.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ffd800640 1 --2- 172.21.15.194:0/2454173773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff80c79e0 0x7f1ff80c7dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097a0 tx=0x7f1fec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc46ab1735fd9bac server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:35.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ff7e00640 1 -- 172.21.15.194:0/2454173773 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0315a0 con 0x7f1ff80c79e0 2024-03-07T10:23:35.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ff7e00640 1 -- 172.21.15.194:0/2454173773 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec037070 con 0x7f1ff80c79e0 2024-03-07T10:23:35.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ff7e00640 1 -- 172.21.15.194:0/2454173773 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec031940 con 0x7f1ff80c79e0 2024-03-07T10:23:35.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ffec00640 1 -- 172.21.15.194:0/2454173773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff80c79e0 msgr2=0x7f1ff80c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.023+0000 7f1ffec00640 1 --2- 172.21.15.194:0/2454173773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff80c79e0 0x7f1ff80c7dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0097a0 tx=0x7f1fec02b840 comp rx=0 tx=0).stop 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.024+0000 7f1ffec00640 1 -- 172.21.15.194:0/2454173773 shutdown_connections 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.024+0000 7f1ffec00640 1 --2- 172.21.15.194:0/2454173773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff80c79e0 0x7f1ff80c7dc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.024+0000 7f1ffec00640 1 -- 172.21.15.194:0/2454173773 >> 172.21.15.194:0/2454173773 conn(0x7f1ff80677b0 msgr2=0x7f1ff80cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.024+0000 7f1ffec00640 1 -- 172.21.15.194:0/2454173773 shutdown_connections 2024-03-07T10:23:35.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.024+0000 7f1ffec00640 1 -- 172.21.15.194:0/2454173773 wait complete. 2024-03-07T10:23:35.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.026+0000 7f1ffec00640 1 Processor -- start 2024-03-07T10:23:35.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.026+0000 7f1ffec00640 1 -- start start 2024-03-07T10:23:35.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 0x7f1ff8148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:35.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ff80c90f0 0x7f1ff81547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8158ca0 con 0x7f1ff81560d0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff80be8a0 con 0x7f1ff80c90f0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff8152ff0 con 0x7f1ff80c79e0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffe200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffe200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46604/0 (socket says 172.21.15.194:46604) 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.027+0000 7f1ffe200640 1 -- 172.21.15.194:0/3061072078 learned_addr learned my addr 172.21.15.194:0/3061072078 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffce00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ff80c90f0 0x7f1ff81547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffd800640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 0x7f1ff8148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 -- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 msgr2=0x7f1ff8148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 0x7f1ff8148030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 -- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ff80c90f0 msgr2=0x7f1ff81547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ff80c90f0 0x7f1ff81547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 -- 172.21.15.194:0/3061072078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff8150460 con 0x7f1ff81560d0 2024-03-07T10:23:35.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffd800640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 0x7f1ff8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:23:35.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ffe200640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000caa0 tx=0x7f1ff000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.028+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0017070 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.029+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000ac00 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.029+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0012400 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.029+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff8147d50 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.029+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff8154d20 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.030+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff814da50 con 0x7f1ff81560d0 2024-03-07T10:23:35.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.031+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1ff001a070 con 0x7f1ff81560d0 2024-03-07T10:23:35.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.032+0000 7f1ff5600640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 0x7f1fd806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:35.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.033+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f1ff008a370 con 0x7f1ff81560d0 2024-03-07T10:23:35.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.033+0000 7f1ffd800640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 0x7f1fd806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:35.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.034+0000 7f1ffd800640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 0x7f1fd806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1fec036000 tx=0x7f1fec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:35.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.037+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1ff0058e80 con 0x7f1ff81560d0 2024-03-07T10:23:35.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.273+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ff8158a40 con 0x7f1ff81560d0 2024-03-07T10:23:35.277 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.275+0000 7f1ff5600640 1 -- 172.21.15.194:0/3061072078 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f1ff0058780 con 0x7f1ff81560d0 2024-03-07T10:23:35.277 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:35.277 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:35.278 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:35.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.277+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 msgr2=0x7f1fd806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.277+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 0x7f1fd806d990 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1fec036000 tx=0x7f1fec008030 comp rx=0 tx=0).stop 2024-03-07T10:23:35.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.277+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 msgr2=0x7f1ff81ee950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:35.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.277+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000caa0 tx=0x7f1ff000cf60 comp rx=0 tx=0).stop 2024-03-07T10:23:35.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 shutdown_connections 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1fd806b4d0 0x7f1fd806d990 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ff81560d0 0x7f1ff81ee950 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1ff80c90f0 0x7f1ff81547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 --2- 172.21.15.194:0/3061072078 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1ff80c79e0 0x7f1ff8148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 >> 172.21.15.194:0/3061072078 conn(0x7f1ff80677b0 msgr2=0x7f1ff80c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 shutdown_connections 2024-03-07T10:23:35.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:35.278+0000 7f1ffec00640 1 -- 172.21.15.194:0/3061072078 wait complete. 2024-03-07T10:23:35.300 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:37.302 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:37.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.510+0000 7f4866200640 1 Processor -- start 2024-03-07T10:23:37.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4866200640 1 -- start start 2024-03-07T10:23:37.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4866200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4860071b90 0x7f4860071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:37.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4866200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4860155a00 con 0x7f48600c12a0 2024-03-07T10:23:37.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4866200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4860155ce0 con 0x7f4860152dc0 2024-03-07T10:23:37.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4866200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4860156610 con 0x7f4860071b90 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f485fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4860071b90 0x7f4860071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4857e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f48600c12a0 0x7f48600c03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:49510/0 (socket says 172.21.15.194:49510) 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.512+0000 7f4857e00640 1 -- 172.21.15.194:0/3260547022 learned_addr learned my addr 172.21.15.194:0/3260547022 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.513+0000 7f485ea00640 1 -- 172.21.15.194:0/3260547022 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248865833 0 0) 0x7f4860155a00 con 0x7f48600c12a0 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.513+0000 7f485ea00640 1 -- 172.21.15.194:0/3260547022 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4844003520 con 0x7f48600c12a0 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.513+0000 7f485fe00640 1 -- 172.21.15.194:0/3260547022 >> v1:172.21.15.196:6789/0 conn(0x7f4860152dc0 legacy=0x7f4860159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:37.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.513+0000 7f485fe00640 1 -- 172.21.15.194:0/3260547022 >> v1:172.21.15.194:6789/0 conn(0x7f48600c12a0 legacy=0x7f48600c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:37.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.513+0000 7f485fe00640 1 -- 172.21.15.194:0/3260547022 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860155fc0 con 0x7f4860071b90 2024-03-07T10:23:37.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.514+0000 7f485fe00640 1 --2- 172.21.15.194:0/3260547022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860071fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8761457868ad14be server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:37.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.514+0000 7f485ea00640 1 -- 172.21.15.194:0/3260547022 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858039070 con 0x7f4860071b90 2024-03-07T10:23:37.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.514+0000 7f485ea00640 1 -- 172.21.15.194:0/3260547022 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485802cbd0 con 0x7f4860071b90 2024-03-07T10:23:37.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.514+0000 7f485ea00640 1 -- 172.21.15.194:0/3260547022 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858034440 con 0x7f4860071b90 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 -- 172.21.15.194:0/3260547022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 msgr2=0x7f4860071fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 --2- 172.21.15.194:0/3260547022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860071fa0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4858009d90 tx=0x7f485802be20 comp rx=0 tx=0).stop 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 -- 172.21.15.194:0/3260547022 shutdown_connections 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 --2- 172.21.15.194:0/3260547022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860071fa0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 -- 172.21.15.194:0/3260547022 >> 172.21.15.194:0/3260547022 conn(0x7f486006b840 msgr2=0x7f48600c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 -- 172.21.15.194:0/3260547022 shutdown_connections 2024-03-07T10:23:37.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.515+0000 7f4866200640 1 -- 172.21.15.194:0/3260547022 wait complete. 2024-03-07T10:23:37.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.517+0000 7f4866200640 1 Processor -- start 2024-03-07T10:23:37.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.517+0000 7f4866200640 1 -- start start 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48600c12a0 0x7f48600c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4860152dc0 0x7f48601ec540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c0c80 con 0x7f4860071b90 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48600c0b00 con 0x7f4860152dc0 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f4866200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48601531a0 con 0x7f48600c12a0 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f485f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f485f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:46612/0 (socket says 172.21.15.194:46612) 2024-03-07T10:23:37.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.518+0000 7f485f400640 1 -- 172.21.15.194:0/76757439 learned_addr learned my addr 172.21.15.194:0/76757439 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 -- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48600c12a0 msgr2=0x7f48600c5320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48600c12a0 0x7f48600c5320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 -- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4860152dc0 msgr2=0x7f48601ec540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4860152dc0 0x7f48601ec540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 -- 172.21.15.194:0/76757439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860147770 con 0x7f4860071b90 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f485f400640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f485000c3c0 tx=0x7f485000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:37.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48500052d0 con 0x7f4860071b90 2024-03-07T10:23:37.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4850005490 con 0x7f4860071b90 2024-03-07T10:23:37.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850007260 con 0x7f4860071b90 2024-03-07T10:23:37.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486014daf0 con 0x7f4860071b90 2024-03-07T10:23:37.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.519+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48600ac400 con 0x7f4860071b90 2024-03-07T10:23:37.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.521+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486014c8a0 con 0x7f4860071b90 2024-03-07T10:23:37.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.521+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4850007400 con 0x7f4860071b90 2024-03-07T10:23:37.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.522+0000 7f4857400640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 0x7f483c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:37.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.522+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f48500899f0 con 0x7f4860071b90 2024-03-07T10:23:37.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.523+0000 7f4857e00640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 0x7f483c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:37.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.524+0000 7f4857e00640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 0x7f483c06d9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4860156a50 tx=0x7f48480078f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:37.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.527+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f486014c8a0 con 0x7f4860071b90 2024-03-07T10:23:37.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.766+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4860068170 con 0x7f4860071b90 2024-03-07T10:23:37.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.767+0000 7f4857400640 1 -- 172.21.15.194:0/76757439 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+6260 (secure 0 0 0) 0x7f485008be20 con 0x7f4860071b90 2024-03-07T10:23:37.769 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:37.769 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4882,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:21:01.661187+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4266},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4266":{"gid":4266,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.196:6835/1848630458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":1848630458},{"type":"v1","addr":"172.21.15.196:6835","nonce":1848630458}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4266,"qdb_cluster":[4266]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:37.769 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 20 2024-03-07T10:23:37.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.769+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 msgr2=0x7f483c06d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.769+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 0x7f483c06d9e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4860156a50 tx=0x7f48480078f0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.769+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 msgr2=0x7f4860147a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.769+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f485000c3c0 tx=0x7f485000c880 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 shutdown_connections 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f483c06b520 0x7f483c06d9e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4860152dc0 0x7f48601ec540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f48600c12a0 0x7f48600c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 --2- 172.21.15.194:0/76757439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4860071b90 0x7f4860147a50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 >> 172.21.15.194:0/76757439 conn(0x7f486006b840 msgr2=0x7f48600c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 shutdown_connections 2024-03-07T10:23:37.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:37.770+0000 7f4866200640 1 -- 172.21.15.194:0/76757439 wait complete. 2024-03-07T10:23:37.790 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-03-07T10:23:39.791 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:40.019 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.018+0000 7fd351c00640 1 Processor -- start 2024-03-07T10:23:40.020 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.018+0000 7fd351c00640 1 -- start start 2024-03-07T10:23:40.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd351c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 0x7fd34c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd351c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd34c06b080 0x7fd34c06b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd351c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd34c0c1a40 con 0x7fd34c13ee20 2024-03-07T10:23:40.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd351c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd34c073040 con 0x7fd34c06b080 2024-03-07T10:23:40.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd351c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c13ec40 con 0x7fd34c0aab30 2024-03-07T10:23:40.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd34a000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd34c13ee20 0x7fd34c0c78e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53408/0 (socket says 172.21.15.194:53408) 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.020+0000 7fd34a000640 1 -- 172.21.15.194:0/2432346266 learned_addr learned my addr 172.21.15.194:0/2432346266 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455219449 0 0) 0x7fd34c0c1a40 con 0x7fd34c13ee20 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330003520 con 0x7fd34c13ee20 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd34aa00640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 0x7fd34c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd34b400640 1 --2- 172.21.15.194:0/2432346266 >> v2:172.21.15.196:3300/0 conn(0x7fd34c06b080 0x7fd34c06b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1428208032 0 0) 0x7fd330003520 con 0x7fd34c13ee20 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 msgr2=0x7fd34c0c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 0x7fd34c0c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 >> v2:172.21.15.196:3300/0 conn(0x7fd34c06b080 msgr2=0x7fd34c06b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 --2- 172.21.15.194:0/2432346266 >> v2:172.21.15.196:3300/0 conn(0x7fd34c06b080 0x7fd34c06b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c1564c0 con 0x7fd34c13ee20 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fd338001670 con 0x7fd34c13ee20 2024-03-07T10:23:40.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 >> v1:172.21.15.194:6789/0 conn(0x7fd34c13ee20 legacy=0x7fd34c0c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3300039e0 0x7fd330003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.021+0000 7fd349600640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 0x7fd330004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd349600640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd3300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c13ec40 con 0x7fd330004d40 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000bba0 con 0x7fd3300039e0 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000bda0 con 0x7fd34c0aab30 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd3300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 -- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 msgr2=0x7fd330004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c0aab30 0x7fd330004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 -- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3300039e0 msgr2=0x7fd330003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd3300039e0 0x7fd330003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.022+0000 7fd34b400640 1 -- 172.21.15.194:0/2432346266 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330003520 con 0x7fd330004d40 2024-03-07T10:23:40.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.023+0000 7fd34b400640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd3300051c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd344007360 tx=0x7fd330005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6dd1e20e2580f3e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344039070 con 0x7fd330004d40 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34402ccf0 con 0x7fd330004d40 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd349600640 1 -- 172.21.15.194:0/2432346266 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344009be0 con 0x7fd330004d40 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd351c00640 1 -- 172.21.15.194:0/2432346266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 msgr2=0x7fd3300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd351c00640 1 --2- 172.21.15.194:0/2432346266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd3300051c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd344007360 tx=0x7fd330005830 comp rx=0 tx=0).stop 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd34b400640 1 -- 172.21.15.194:0/2432346266 reap_dead start 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd351c00640 1 -- 172.21.15.194:0/2432346266 shutdown_connections 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.024+0000 7fd351c00640 1 -- 172.21.15.194:0/2432346266 >> 172.21.15.194:0/2432346266 conn(0x7fd34c0c4bd0 msgr2=0x7fd34c0c4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.025+0000 7fd351c00640 1 -- 172.21.15.194:0/2432346266 shutdown_connections 2024-03-07T10:23:40.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.025+0000 7fd351c00640 1 -- 172.21.15.194:0/2432346266 wait complete. 2024-03-07T10:23:40.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.026+0000 7fd351c00640 1 Processor -- start 2024-03-07T10:23:40.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.026+0000 7fd351c00640 1 -- start start 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd34c1dee90 0x7fd34c1383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c1df310 0x7fd34c1ee740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c0aaf10 con 0x7fd330004d40 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c072cd0 con 0x7fd34c1dee90 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.027+0000 7fd351c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c13e8d0 con 0x7fd34c1df310 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49392/0 (socket says 172.21.15.194:49392) 2024-03-07T10:23:40.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 -- 172.21.15.194:0/3075929927 learned_addr learned my addr 172.21.15.194:0/3075929927 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34a000640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd34c1dee90 0x7fd34c1383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 -- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c1df310 msgr2=0x7fd34c1ee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c1df310 0x7fd34c1ee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 -- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd34c1dee90 msgr2=0x7fd34c1383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd34c1dee90 0x7fd34c1383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 -- 172.21.15.194:0/3075929927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c1e06e0 con 0x7fd330004d40 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd34aa00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00d800 tx=0x7fd33c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.028+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00b5e0 con 0x7fd330004d40 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.029+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00b7a0 con 0x7fd330004d40 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.029+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34c158080 con 0x7fd330004d40 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.029+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c00bb90 con 0x7fd330004d40 2024-03-07T10:23:40.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.029+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c138e20 con 0x7fd330004d40 2024-03-07T10:23:40.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.030+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c068880 con 0x7fd330004d40 2024-03-07T10:23:40.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.031+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd33c014410 con 0x7fd330004d40 2024-03-07T10:23:40.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.031+0000 7fd342a00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 0x7fd32c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.032+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fd33c08add0 con 0x7fd330004d40 2024-03-07T10:23:40.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.032+0000 7fd34a000640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 0x7fd32c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.033+0000 7fd34a000640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 0x7fd32c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd34c139990 tx=0x7fd338009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.036+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd33c0597f0 con 0x7fd330004d40 2024-03-07T10:23:40.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.270+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd34c13e080 con 0x7fd330004d40 2024-03-07T10:23:40.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.271+0000 7fd342a00640 1 -- 172.21.15.194:0/3075929927 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5463 (secure 0 0 0) 0x7fd33c0590f0 con 0x7fd330004d40 2024-03-07T10:23:40.273 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:40.273 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:39.028383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:40.273 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 23 2024-03-07T10:23:40.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.273+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 msgr2=0x7fd32c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.273+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 0x7fd32c06d990 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd34c139990 tx=0x7fd338009040 comp rx=0 tx=0).stop 2024-03-07T10:23:40.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.273+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 msgr2=0x7fd34c139100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.273+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd33c00d800 tx=0x7fd33c00dcc0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 shutdown_connections 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd32c06b4d0 0x7fd32c06d990 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd34c1df310 0x7fd34c1ee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd34c1dee90 0x7fd34c1383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 --2- 172.21.15.194:0/3075929927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd330004d40 0x7fd34c139100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 >> 172.21.15.194:0/3075929927 conn(0x7fd34c0c4bd0 msgr2=0x7fd34c061aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 shutdown_connections 2024-03-07T10:23:40.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.274+0000 7fd351c00640 1 -- 172.21.15.194:0/3075929927 wait complete. 2024-03-07T10:23:40.276 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:40.294 INFO:tasks.mds_thrash.fs.[a]:mds.b down, removed from mdsmap 2024-03-07T10:23:40.294 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-03-07T10:23:40.295 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:40.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.507+0000 7f346aa00640 1 Processor -- start 2024-03-07T10:23:40.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.507+0000 7f346aa00640 1 -- start start 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f346aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34641558a0 0x7f3464155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f346aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f346415e120 0x7f3464160510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f346aa00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640c9840 con 0x7f34640c5da0 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f346aa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640c7190 con 0x7f346415e120 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f346aa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3464156600 con 0x7f34641558a0 2024-03-07T10:23:40.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f3468a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f346415e120 0x7f3464160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f3468a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f346415e120 0x7f3464160510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49402/0 (socket says 172.21.15.194:49402) 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.509+0000 7f3468a00640 1 -- 172.21.15.194:0/3331082200 learned_addr learned my addr 172.21.15.194:0/3331082200 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f3463e00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34641558a0 0x7f3464155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f3468a00640 1 -- 172.21.15.194:0/3331082200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34641558a0 msgr2=0x7f3464155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f3468a00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34641558a0 0x7f3464155c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f3468a00640 1 -- 172.21.15.194:0/3331082200 >> v1:172.21.15.196:6789/0 conn(0x7f34640c5da0 legacy=0x7f34640c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f3468a00640 1 -- 172.21.15.194:0/3331082200 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640c9ca0 con 0x7f346415e120 2024-03-07T10:23:40.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f9791000640 1 Processor -- start 2024-03-07T10:23:40.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.510+0000 7f9791000640 1 -- start start 2024-03-07T10:23:40.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.511+0000 7f3468a00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346415e120 0x7f3464160510 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f345c009e50 tx=0x7f345c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec597eb41de3d73 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.511+0000 7f3462a00640 1 -- 172.21.15.194:0/3331082200 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c02ca70 con 0x7f346415e120 2024-03-07T10:23:40.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.511+0000 7f3462a00640 1 -- 172.21.15.194:0/3331082200 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c02cc10 con 0x7f346415e120 2024-03-07T10:23:40.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.511+0000 7f3462a00640 1 -- 172.21.15.194:0/3331082200 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0343f0 con 0x7f346415e120 2024-03-07T10:23:40.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.511+0000 7f9791000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f9791000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f978c158d50 0x7f978c1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f9791000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978c0c7970 con 0x7f978c0be570 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f9791000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978c0c7c50 con 0x7f978c158d50 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f9791000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0c7f30 con 0x7f978c14c1e0 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978aa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f978c0be570 0x7f978c0c5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53410/0 (socket says 172.21.15.194:53410) 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978aa00640 1 -- 172.21.15.194:0/725664005 learned_addr learned my addr 172.21.15.194:0/725664005 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 -- 172.21.15.194:0/3331082200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346415e120 msgr2=0x7f3464160510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346415e120 0x7f3464160510 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f345c009e50 tx=0x7f345c02bed0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 -- 172.21.15.194:0/3331082200 shutdown_connections 2024-03-07T10:23:40.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f346415e120 0x7f3464160510 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 --2- 172.21.15.194:0/3331082200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34641558a0 0x7f3464155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978be00640 1 --2- 172.21.15.194:0/725664005 >> v2:172.21.15.196:3300/0 conn(0x7f978c158d50 0x7f978c1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 -- 172.21.15.194:0/3331082200 >> 172.21.15.194:0/3331082200 conn(0x7f34640cb010 msgr2=0x7f34640cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978b400640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978a000640 1 -- 172.21.15.194:0/725664005 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177356054 0 0) 0x7f978c0c7970 con 0x7f978c0be570 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f978a000640 1 -- 172.21.15.194:0/725664005 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9770003520 con 0x7f978c0be570 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.512+0000 7f346aa00640 1 -- 172.21.15.194:0/3331082200 shutdown_connections 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.513+0000 7f346aa00640 1 -- 172.21.15.194:0/3331082200 wait complete. 2024-03-07T10:23:40.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.513+0000 7f978be00640 1 -- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 msgr2=0x7f978c155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.513+0000 7f978be00640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.513+0000 7f978be00640 1 -- 172.21.15.194:0/725664005 >> v1:172.21.15.194:6789/0 conn(0x7f978c0be570 legacy=0x7f978c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.513+0000 7f978be00640 1 -- 172.21.15.194:0/725664005 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0c8210 con 0x7f978c158d50 2024-03-07T10:23:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.514+0000 7f346aa00640 1 Processor -- start 2024-03-07T10:23:40.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.514+0000 7f346aa00640 1 -- start start 2024-03-07T10:23:40.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.514+0000 7f978be00640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1591d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d90 tx=0x7f978402bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c89d6fef0dcd065b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f978a000640 1 -- 172.21.15.194:0/725664005 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784039070 con 0x7f978c158d50 2024-03-07T10:23:40.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f978a000640 1 -- 172.21.15.194:0/725664005 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978402c740 con 0x7f978c158d50 2024-03-07T10:23:40.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f978a000640 1 -- 172.21.15.194:0/725664005 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9778001670 con 0x7f978c158d50 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34640c5da0 0x7f346414c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f346415e120 0x7f34640c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640cad20 con 0x7f34641558a0 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c9f80 con 0x7f346415e120 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f346aa00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c77c0 con 0x7f34640c5da0 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.515+0000 7f3463400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49414/0 (socket says 172.21.15.194:49414) 2024-03-07T10:23:40.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 -- 172.21.15.194:0/1503029952 learned_addr learned my addr 172.21.15.194:0/1503029952 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 -- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 msgr2=0x7f978c1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1591d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9784009d90 tx=0x7f978402bc10 comp rx=0 tx=0).stop 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 -- 172.21.15.194:0/725664005 shutdown_connections 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1591d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 --2- 172.21.15.194:0/725664005 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 -- 172.21.15.194:0/725664005 >> 172.21.15.194:0/725664005 conn(0x7f978c067390 msgr2=0x7f978c0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3468a00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f346415e120 0x7f34640c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 -- 172.21.15.194:0/725664005 shutdown_connections 2024-03-07T10:23:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463e00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34640c5da0 0x7f346414c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f9791000640 1 -- 172.21.15.194:0/725664005 wait complete. 2024-03-07T10:23:40.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 -- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34640c5da0 msgr2=0x7f346414c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34640c5da0 0x7f346414c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 -- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f346415e120 msgr2=0x7f34640c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f346415e120 0x7f34640c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.516+0000 7f3463400640 1 -- 172.21.15.194:0/1503029952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346415bf60 con 0x7f34641558a0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f3463400640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f345000c430 tx=0x7f345000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450011790 con 0x7f34641558a0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3450017070 con 0x7f34641558a0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3450011b70 con 0x7f34641558a0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346415cf70 con 0x7f34641558a0 2024-03-07T10:23:40.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.517+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346415cc90 con 0x7f34641558a0 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.518+0000 7f9791000640 1 Processor -- start 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.518+0000 7f9791000640 1 -- start start 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1ee710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0c5f70 con 0x7f978c0be570 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0c7640 con 0x7f978c158d50 2024-03-07T10:23:40.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f9791000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978c0c60f0 con 0x7f978c14c1e0 2024-03-07T10:23:40.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640c5340 con 0x7f34641558a0 2024-03-07T10:23:40.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f978b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f978b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49426/0 (socket says 172.21.15.194:49426) 2024-03-07T10:23:40.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.519+0000 7f978b400640 1 -- 172.21.15.194:0/3752319625 learned_addr learned my addr 172.21.15.194:0/3752319625 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:40.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978be00640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1ee710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978aa00640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3450011d10 con 0x7f34641558a0 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 -- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 msgr2=0x7f978c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 -- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 msgr2=0x7f978c1ee710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1ee710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 -- 172.21.15.194:0/3752319625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0c8ce0 con 0x7f978c0be570 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978aa00640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:23:40.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.520+0000 7f978b400640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9b0 tx=0x7f977c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.521+0000 7f345be00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.521+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f345008a440 con 0x7f34641558a0 2024-03-07T10:23:40.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.521+0000 7f3463e00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.522+0000 7f3463e00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 0x7f344406d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f345400a970 tx=0x7f3454008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c017070 con 0x7f978c0be570 2024-03-07T10:23:40.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00c9a0 con 0x7f978c0be570 2024-03-07T10:23:40.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f346415bf60 con 0x7f34641558a0 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00cd90 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978c0c8fc0 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.525+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978c1ee1f0 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.526+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978c068880 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.527+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f977c01a070 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.528+0000 7f9783400640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 0x7f976c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.528+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f977c08aa80 con 0x7f978c0be570 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.528+0000 7f978aa00640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 0x7f976c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:40.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.530+0000 7f978aa00640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 0x7f976c06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f978c0b0390 tx=0x7f9778009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:40.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.532+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f977c08ce20 con 0x7f978c0be570 2024-03-07T10:23:40.787 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.785+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f978c0abfd0 con 0x7f978c0be570 2024-03-07T10:23:40.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.786+0000 7f9783400640 1 -- 172.21.15.194:0/3752319625 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5463 (secure 0 0 0) 0x7f977c059410 con 0x7f978c0be570 2024-03-07T10:23:40.788 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.786+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3464068170 con 0x7f34641558a0 2024-03-07T10:23:40.788 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:40.789 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:39.028383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:40.789 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 23 2024-03-07T10:23:40.789 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.787+0000 7f345be00640 1 -- 172.21.15.194:0/1503029952 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+5463 (secure 0 0 0) 0x7f3450058e60 con 0x7f34641558a0 2024-03-07T10:23:40.790 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:40.790 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:39.028383+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:40.790 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 23 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 msgr2=0x7f976c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 0x7f976c06d990 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f978c0b0390 tx=0x7f9778009040 comp rx=0 tx=0).stop 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 msgr2=0x7f978c141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f977c00e9b0 tx=0x7f977c00ee70 comp rx=0 tx=0).stop 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 shutdown_connections 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f976c06b4d0 0x7f976c06d990 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f978c158d50 0x7f978c1ee710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f978c14c1e0 0x7f978c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 --2- 172.21.15.194:0/3752319625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f978c0be570 0x7f978c141c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 >> 172.21.15.194:0/3752319625 conn(0x7f978c067390 msgr2=0x7f978c156950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 shutdown_connections 2024-03-07T10:23:40.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.789+0000 7f9791000640 1 -- 172.21.15.194:0/3752319625 wait complete. 2024-03-07T10:23:40.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 msgr2=0x7f344406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 0x7f344406d990 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f345400a970 tx=0x7f3454008040 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 msgr2=0x7f34641f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f345000c430 tx=0x7f345000c8f0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 shutdown_connections 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f344406b4d0 0x7f344406d990 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f346415e120 0x7f34640c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34641558a0 0x7f34641f2d30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 --2- 172.21.15.194:0/1503029952 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34640c5da0 0x7f346414c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 >> 172.21.15.194:0/1503029952 conn(0x7f34640cb010 msgr2=0x7f3464155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 shutdown_connections 2024-03-07T10:23:40.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:40.790+0000 7f346aa00640 1 -- 172.21.15.194:0/1503029952 wait complete. 2024-03-07T10:23:40.816 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-03-07T10:23:40.816 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-07T10:23:40.816 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:23:40.818 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:20:57.593298+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4882": { "addr": "172.21.15.194:6835/3339340096", "addrs": { "addrvec": [ { "addr": "172.21.15.194:6834", "nonce": 3339340096, "type": "v2" }, { "addr": "172.21.15.194:6835", "nonce": 3339340096, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4882, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-03-07T10:23:39.028383+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4882 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:21:08.712900+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 19, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4251": { "addr": "172.21.15.194:6833/1582324990", "addrs": { "addrvec": [ { "addr": "172.21.15.194:6832", "nonce": 1582324990, "type": "v2" }, { "addr": "172.21.15.194:6833", "nonce": 1582324990, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4251, "incarnation": 16, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 34 } }, "last_failure": 0, "last_failure_osd_epoch": 27, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-03-07T10:22:56.000173+0000", "qdb_cluster": [ 4251 ], "qdb_leader": 4251, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4251 } } } ], "standbys": [ { "addr": "172.21.15.196:6837/1953632658", "addrs": { "addrvec": [ { "addr": "172.21.15.196:6836", "nonce": 1953632658, "type": "v2" }, { "addr": "172.21.15.196:6837", "nonce": 1953632658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-03-07T10:23:40.832 INFO:tasks.ceph.mds.a:Stopped 2024-03-07T10:23:40.832 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:41.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.094+0000 7f4b8e400640 1 Processor -- start 2024-03-07T10:23:41.096 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.094+0000 7f4b8e400640 1 -- start start 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b8e400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4b881558a0 0x7f4b88155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b8e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b880c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b8e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b88156600 con 0x7f4b880c9670 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b8e400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b880c7190 con 0x7f4b881558a0 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b8e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c9ca0 con 0x7f4b880c5da0 2024-03-07T10:23:41.097 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b87e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4b880c9670 0x7f4b88158da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53418/0 (socket says 172.21.15.194:53418) 2024-03-07T10:23:41.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b87e00640 1 -- 172.21.15.194:0/4056467439 learned_addr learned my addr 172.21.15.194:0/4056467439 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567027800 0 0) 0x7f4b88156600 con 0x7f4b880c9670 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c003520 con 0x7f4b880c9670 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b87400640 1 --2- 172.21.15.194:0/4056467439 >> v2:172.21.15.196:3300/0 conn(0x7f4b881558a0 0x7f4b88155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.096+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b880c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3067668209 0 0) 0x7f4b6c003520 con 0x7f4b880c9670 2024-03-07T10:23:41.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 msgr2=0x7f4b880c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b880c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 >> v2:172.21.15.196:3300/0 conn(0x7f4b881558a0 msgr2=0x7f4b88155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 --2- 172.21.15.194:0/4056467439 >> v2:172.21.15.196:3300/0 conn(0x7f4b881558a0 0x7f4b88155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b880cbbe0 con 0x7f4b880c9670 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f4b800019f0 con 0x7f4b880c9670 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 >> v1:172.21.15.194:6789/0 conn(0x7f4b880c9670 legacy=0x7f4b88158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b6c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b6c003fe0 0x7f4b6c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c004d40 0x7f4b6c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c7190 con 0x7f4b6c003fe0 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c9ca0 con 0x7f4b6c004d40 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c00bac0 con 0x7f4b880c5da0 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b6c003fe0 0x7f4b6c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b87400640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b6c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 -- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 msgr2=0x7f4b6c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:41.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b880c5da0 0x7f4b6c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 -- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c004d40 msgr2=0x7f4b6c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:41.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c004d40 0x7f4b6c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.097+0000 7f4b86a00640 1 -- 172.21.15.194:0/4056467439 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c003520 con 0x7f4b6c003fe0 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.098+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b6c003fe0 0x7f4b6c004800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ba30 tx=0x7f4b6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acaa5213117b3a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78036020 con 0x7f4b6c003fe0 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78032640 con 0x7f4b6c003fe0 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b86000640 1 -- 172.21.15.194:0/4056467439 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b7800b600 con 0x7f4b6c003fe0 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b8e400640 1 -- 172.21.15.194:0/4056467439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b6c003fe0 msgr2=0x7f4b6c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4056467439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b6c003fe0 0x7f4b6c004800 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4b7800ba30 tx=0x7f4b6c005830 comp rx=0 tx=0).stop 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b87e00640 1 -- 172.21.15.194:0/4056467439 reap_dead start 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b8e400640 1 -- 172.21.15.194:0/4056467439 shutdown_connections 2024-03-07T10:23:41.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.099+0000 7f4b8e400640 1 -- 172.21.15.194:0/4056467439 >> 172.21.15.194:0/4056467439 conn(0x7f4b880cb010 msgr2=0x7f4b880cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:41.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.100+0000 7f4b8e400640 1 -- 172.21.15.194:0/4056467439 shutdown_connections 2024-03-07T10:23:41.103 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.100+0000 7f4b8e400640 1 -- 172.21.15.194:0/4056467439 wait complete. 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.101+0000 7f4b8e400640 1 Processor -- start 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.101+0000 7f4b8e400640 1 -- start start 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c003fe0 0x7f4b8814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b88148dd0 0x7f4b88151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880c77c0 con 0x7f4b8814ac70 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b880cad20 con 0x7f4b6c003fe0 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b8e400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b88153170 con 0x7f4b88148dd0 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b86a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b86a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49442/0 (socket says 172.21.15.194:49442) 2024-03-07T10:23:41.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.102+0000 7f4b86a00640 1 -- 172.21.15.194:0/4096534975 learned_addr learned my addr 172.21.15.194:0/4096534975 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:41.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 -- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b88148dd0 msgr2=0x7f4b88151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.105 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b87400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c003fe0 0x7f4b8814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b88148dd0 0x7f4b88151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 -- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c003fe0 msgr2=0x7f4b8814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c003fe0 0x7f4b8814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 -- 172.21.15.194:0/4096534975 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b881ef750 con 0x7f4b8814ac70 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.103+0000 7f4b86a00640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b7802bf90 tx=0x7f4b78004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.104+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78041070 con 0x7f4b8814ac70 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.104+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b78030a50 con 0x7f4b8814ac70 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.104+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78036040 con 0x7f4b8814ac70 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.104+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b88156c30 con 0x7f4b8814ac70 2024-03-07T10:23:41.106 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.104+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b881571f0 con 0x7f4b8814ac70 2024-03-07T10:23:41.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.105+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b88068170 con 0x7f4b8814ac70 2024-03-07T10:23:41.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.106+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4b78039020 con 0x7f4b8814ac70 2024-03-07T10:23:41.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.107+0000 7f4b7f400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 0x7f4b6406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:41.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.107+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4b780ac840 con 0x7f4b8814ac70 2024-03-07T10:23:41.109 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.107+0000 7f4b87400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 0x7f4b6406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:41.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.109+0000 7f4b87400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 0x7f4b6406d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b70006fd0 tx=0x7f4b70008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:41.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.114+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4b7807b1d0 con 0x7f4b8814ac70 2024-03-07T10:23:41.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.364+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b880c8f10 con 0x7f4b8814ac70 2024-03-07T10:23:41.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.365+0000 7f4b7f400640 1 -- 172.21.15.194:0/4096534975 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f4b7807aad0 con 0x7f4b8814ac70 2024-03-07T10:23:41.367 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:41.367 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:41.367 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:41.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.368+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 msgr2=0x7f4b6406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.368+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 0x7f4b6406d9c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b70006fd0 tx=0x7f4b70008040 comp rx=0 tx=0).stop 2024-03-07T10:23:41.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.368+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 msgr2=0x7f4b88151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.368+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4b7802bf90 tx=0x7f4b78004730 comp rx=0 tx=0).stop 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 shutdown_connections 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4b6406b500 0x7f4b6406d9c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4b88148dd0 0x7f4b88151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4b8814ac70 0x7f4b88151880 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 --2- 172.21.15.194:0/4096534975 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4b6c003fe0 0x7f4b8814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 >> 172.21.15.194:0/4096534975 conn(0x7f4b880cb010 msgr2=0x7f4b8806d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 shutdown_connections 2024-03-07T10:23:41.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:41.369+0000 7f4b8e400640 1 -- 172.21.15.194:0/4096534975 wait complete. 2024-03-07T10:23:41.396 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:42.819 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:42.994 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-07T10:23:42.994 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-07T10:23:43.022 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.021+0000 7f10b9400640 1 Processor -- start 2024-03-07T10:23:43.023 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.021+0000 7f10b9400640 1 -- start start 2024-03-07T10:23:43.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 0x7f10b4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b9400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b40c9840 con 0x7f10b415e120 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b9400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b4156600 con 0x7f10b40c5da0 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b9400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c7190 con 0x7f10b41558a0 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b3200640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f10b415e120 0x7f10b4160510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53426/0 (socket says 172.21.15.194:53426) 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.023+0000 7f10b3200640 1 -- 172.21.15.194:0/4006240204 learned_addr learned my addr 172.21.15.194:0/4006240204 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:43.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b2800640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 0x7f10b4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986713859 0 0) 0x7f10b40c9840 con 0x7f10b415e120 2024-03-07T10:23:43.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1098003520 con 0x7f10b415e120 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1418534936 0 0) 0x7f1098003520 con 0x7f10b415e120 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 msgr2=0x7f10b4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 0x7f10b4155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 >> v1:172.21.15.196:6789/0 conn(0x7f10b40c5da0 legacy=0x7f10b40c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40c9ca0 con 0x7f10b415e120 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f10ac0019f0 con 0x7f10b415e120 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 >> v1:172.21.15.194:6789/0 conn(0x7f10b415e120 legacy=0x7f10b4160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.024+0000 7f10b1400640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10980039e0 0x7f1098003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b1400640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1098004390 0x7f1098004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b1400640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 0x7f10980050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c7190 con 0x7f10980039e0 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109800b9c0 con 0x7f1098004390 2024-03-07T10:23:43.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109800bbc0 con 0x7f10b41558a0 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10980039e0 0x7f1098003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 -- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 msgr2=0x7f10980050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10b41558a0 0x7f10980050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 -- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1098004390 msgr2=0x7f1098004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1098004390 0x7f1098004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.025+0000 7f10b2800640 1 -- 172.21.15.194:0/4006240204 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098003520 con 0x7f10980039e0 2024-03-07T10:23:43.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.027+0000 7f10b2800640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10980039e0 0x7f1098003dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009ac0 tx=0x7f1098005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f0d75bc9d3c5cf server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.027+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4039070 con 0x7f10980039e0 2024-03-07T10:23:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.027+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a402c710 con 0x7f10980039e0 2024-03-07T10:23:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.027+0000 7f10b1400640 1 -- 172.21.15.194:0/4006240204 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4009690 con 0x7f10980039e0 2024-03-07T10:23:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 -- 172.21.15.194:0/4006240204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10980039e0 msgr2=0x7f1098003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 --2- 172.21.15.194:0/4006240204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10980039e0 0x7f1098003dc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009ac0 tx=0x7f1098005830 comp rx=0 tx=0).stop 2024-03-07T10:23:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b3200640 1 -- 172.21.15.194:0/4006240204 reap_dead start 2024-03-07T10:23:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 -- 172.21.15.194:0/4006240204 shutdown_connections 2024-03-07T10:23:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 -- 172.21.15.194:0/4006240204 >> 172.21.15.194:0/4006240204 conn(0x7f10b40cb010 msgr2=0x7f10b40cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 -- 172.21.15.194:0/4006240204 shutdown_connections 2024-03-07T10:23:43.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.028+0000 7f10b9400640 1 -- 172.21.15.194:0/4006240204 wait complete. 2024-03-07T10:23:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.030+0000 7f10b9400640 1 Processor -- start 2024-03-07T10:23:43.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.030+0000 7f10b9400640 1 -- start start 2024-03-07T10:23:43.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10980039e0 0x7f10b4145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10b4144fb0 0x7f10b4151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40cad20 con 0x7f10b41544d0 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c9f80 con 0x7f10b4144fb0 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b9400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40c77c0 con 0x7f10980039e0 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49460/0 (socket says 172.21.15.194:49460) 2024-03-07T10:23:43.033 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b1e00640 1 -- 172.21.15.194:0/1814362533 learned_addr learned my addr 172.21.15.194:0/1814362533 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b3200640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10b4144fb0 0x7f10b4151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.031+0000 7f10b2800640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10980039e0 0x7f10b4145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 -- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10980039e0 msgr2=0x7f10b4145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10980039e0 0x7f10b4145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 -- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10b4144fb0 msgr2=0x7f10b4151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10b4144fb0 0x7f10b4151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 -- 172.21.15.194:0/1814362533 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4145720 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b1e00640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c780 tx=0x7f10a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0017070 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a0005480 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b41ef240 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.032+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a000a880 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.033+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b41528d0 con 0x7f10b41544d0 2024-03-07T10:23:43.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.034+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b4068170 con 0x7f10b41544d0 2024-03-07T10:23:43.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.035+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f10a001a070 con 0x7f10b41544d0 2024-03-07T10:23:43.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.036+0000 7f10aaa00640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.037+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f10a0089b20 con 0x7f10b41544d0 2024-03-07T10:23:43.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.037+0000 7f10b2800640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.038+0000 7f10b2800640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 0x7f109406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009ac0 tx=0x7f10a4030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.042+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f10a00585e0 con 0x7f10b41544d0 2024-03-07T10:23:43.088 INFO:tasks.workunit:Stopping ['fs/misc/trivial_sync.sh'] on client.0... 2024-03-07T10:23:43.088 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-07T10:23:43.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.283+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10b40cbe40 con 0x7f10b41544d0 2024-03-07T10:23:43.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.284+0000 7f10aaa00640 1 -- 172.21.15.194:0/1814362533 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f10a0057ee0 con 0x7f10b41544d0 2024-03-07T10:23:43.286 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:43.286 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:43.286 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:43.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 msgr2=0x7f109406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 0x7f109406d990 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009ac0 tx=0x7f10a4030000 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 msgr2=0x7f10b4144a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c780 tx=0x7f10a000cc40 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 shutdown_connections 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f109406b4d0 0x7f109406d990 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f10b4144fb0 0x7f10b4151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10b41544d0 0x7f10b4144a70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 --2- 172.21.15.194:0/1814362533 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f10980039e0 0x7f10b4145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 >> 172.21.15.194:0/1814362533 conn(0x7f10b40cb010 msgr2=0x7f10b406c780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 shutdown_connections 2024-03-07T10:23:43.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.287+0000 7f10b9400640 1 -- 172.21.15.194:0/1814362533 wait complete. 2024-03-07T10:23:43.305 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=4266 2024-03-07T10:23:43.305 INFO:tasks.mds_thrash.fs.[a]:waiting for 9 secs before reviving mds.b 2024-03-07T10:23:43.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:43.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.583+0000 7f4dcb200640 1 Processor -- start 2024-03-07T10:23:43.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.583+0000 7f4dcb200640 1 -- start start 2024-03-07T10:23:43.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.584+0000 7f4dcb200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4dc414c1e0 0x7f4dc4155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.584+0000 7f4dcb200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f4dc4158d50 0x7f4dc4159200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dcb200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc40c7970 con 0x7f4dc40be570 2024-03-07T10:23:43.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dcb200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40c7c50 con 0x7f4dc414c1e0 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dcb200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40c7f30 con 0x7f4dc4158d50 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4dc414c1e0 0x7f4dc4155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4dc414c1e0 0x7f4dc4155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49466/0 (socket says 172.21.15.194:49466) 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 -- 172.21.15.194:0/2182767705 learned_addr learned my addr 172.21.15.194:0/2182767705 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dca800640 1 --2- 172.21.15.194:0/2182767705 >> v2:172.21.15.196:3300/0 conn(0x7f4dc4158d50 0x7f4dc4159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 -- 172.21.15.194:0/2182767705 >> v2:172.21.15.196:3300/0 conn(0x7f4dc4158d50 msgr2=0x7f4dc4159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 --2- 172.21.15.194:0/2182767705 >> v2:172.21.15.196:3300/0 conn(0x7f4dc4158d50 0x7f4dc4159200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 -- 172.21.15.194:0/2182767705 >> v1:172.21.15.196:6789/0 conn(0x7f4dc40be570 legacy=0x7f4dc40c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:43.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.585+0000 7f4dc9e00640 1 -- 172.21.15.194:0/2182767705 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40c8210 con 0x7f4dc414c1e0 2024-03-07T10:23:43.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.586+0000 7f4dc9e00640 1 --2- 172.21.15.194:0/2182767705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc414c1e0 0x7f4dc4155fe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406d940 tx=0x7f4db802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa50b873a9c1e31 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dc8a00640 1 -- 172.21.15.194:0/2182767705 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db802e070 con 0x7f4dc414c1e0 2024-03-07T10:23:43.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dc8a00640 1 -- 172.21.15.194:0/2182767705 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db8037070 con 0x7f4dc414c1e0 2024-03-07T10:23:43.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dc8a00640 1 -- 172.21.15.194:0/2182767705 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8031a00 con 0x7f4dc414c1e0 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 -- 172.21.15.194:0/2182767705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc414c1e0 msgr2=0x7f4dc4155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 --2- 172.21.15.194:0/2182767705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc414c1e0 0x7f4dc4155fe0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4dc406d940 tx=0x7f4db802b880 comp rx=0 tx=0).stop 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 -- 172.21.15.194:0/2182767705 shutdown_connections 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 --2- 172.21.15.194:0/2182767705 >> v2:172.21.15.196:3300/0 conn(0x7f4dc4158d50 0x7f4dc4159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 --2- 172.21.15.194:0/2182767705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc414c1e0 0x7f4dc4155fe0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.587+0000 7f4dcb200640 1 -- 172.21.15.194:0/2182767705 >> 172.21.15.194:0/2182767705 conn(0x7f4dc4067390 msgr2=0x7f4dc40aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.588+0000 7f4dcb200640 1 -- 172.21.15.194:0/2182767705 shutdown_connections 2024-03-07T10:23:43.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.588+0000 7f4dcb200640 1 -- 172.21.15.194:0/2182767705 wait complete. 2024-03-07T10:23:43.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.589+0000 7f4dcb200640 1 Processor -- start 2024-03-07T10:23:43.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.589+0000 7f4dcb200640 1 -- start start 2024-03-07T10:23:43.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc40be570 0x7f4dc41ee520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc414c1e0 0x7f4dc414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c5f70 con 0x7f4dc4158d50 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c7640 con 0x7f4dc40be570 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dcb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c60f0 con 0x7f4dc414c1e0 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dca800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49476/0 (socket says 172.21.15.194:49476) 2024-03-07T10:23:43.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.590+0000 7f4dca800640 1 -- 172.21.15.194:0/3606394731 learned_addr learned my addr 172.21.15.194:0/3606394731 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:43.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 -- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc414c1e0 msgr2=0x7f4dc414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc414c1e0 0x7f4dc414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dc9e00640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc40be570 0x7f4dc41ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 -- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc40be570 msgr2=0x7f4dc41ee520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc40be570 0x7f4dc41ee520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 -- 172.21.15.194:0/3606394731 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc41ef000 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dca800640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007e70 tx=0x7f4dc000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0014620 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0019070 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0014a20 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.591+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc41eed60 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.592+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc40beaf0 con 0x7f4dc4158d50 2024-03-07T10:23:43.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.593+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4068880 con 0x7f4dc4158d50 2024-03-07T10:23:43.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.594+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4dc0014bc0 con 0x7f4dc4158d50 2024-03-07T10:23:43.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.595+0000 7f4dbe000640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 0x7f4da806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:43.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.595+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f4dc008af60 con 0x7f4dc4158d50 2024-03-07T10:23:43.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.595+0000 7f4dc9e00640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 0x7f4da806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:43.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.596+0000 7f4dc9e00640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 0x7f4da806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4db8036000 tx=0x7f4db8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:43.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.604+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4dc0059980 con 0x7f4dc4158d50 2024-03-07T10:23:43.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.827+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dc40c3b40 con 0x7f4dc4158d50 2024-03-07T10:23:43.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.828+0000 7f4dbe000640 1 -- 172.21.15.194:0/3606394731 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f4dc0059280 con 0x7f4dc4158d50 2024-03-07T10:23:43.829 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:43.830 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:43.830 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 msgr2=0x7f4da806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 0x7f4da806d990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4db8036000 tx=0x7f4db8008030 comp rx=0 tx=0).stop 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 msgr2=0x7f4dc414ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0007e70 tx=0x7f4dc000e4b0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 shutdown_connections 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4da806b4d0 0x7f4da806d990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dc4158d50 0x7f4dc414ad10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4dc414c1e0 0x7f4dc414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.830+0000 7f4dcb200640 1 --2- 172.21.15.194:0/3606394731 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4dc40be570 0x7f4dc41ee520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:43.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.831+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 >> 172.21.15.194:0/3606394731 conn(0x7f4dc4067390 msgr2=0x7f4dc40afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:43.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.831+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 shutdown_connections 2024-03-07T10:23:43.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:43.831+0000 7f4dcb200640 1 -- 172.21.15.194:0/3606394731 wait complete. 2024-03-07T10:23:43.849 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:44.210 DEBUG:teuthology.parallel:result is None 2024-03-07T10:23:44.210 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-07T10:23:44.304 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-07T10:23:44.304 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-07T10:23:45.060 INFO:tasks.ceph.mds.c.smithi194.stderr:2024-03-07T10:23:45.056+0000 7fd75d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:23:45.851 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:46.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.069+0000 7f9231c00640 1 Processor -- start 2024-03-07T10:23:46.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.069+0000 7f9231c00640 1 -- start start 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f9231c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f9231c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f922c0c0930 0x7f922c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f9231c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c155a00 con 0x7f922c152dc0 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f9231c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c156610 con 0x7f922c0c0930 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f9231c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c155ce0 con 0x7f922c0c12a0 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f922b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f922c0c0930 0x7f922c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f922aa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f922c152dc0 0x7f922c159880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53430/0 (socket says 172.21.15.194:53430) 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.071+0000 7f922aa00640 1 -- 172.21.15.194:0/2047525139 learned_addr learned my addr 172.21.15.194:0/2047525139 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f9222000640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f922b400640 1 -- 172.21.15.194:0/2047525139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 msgr2=0x7f922c0c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f922b400640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f922b400640 1 -- 172.21.15.194:0/2047525139 >> v1:172.21.15.194:6789/0 conn(0x7f922c152dc0 legacy=0x7f922c159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f922b400640 1 -- 172.21.15.194:0/2047525139 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c155fc0 con 0x7f922c0c0930 2024-03-07T10:23:46.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f922a000640 1 -- 172.21.15.194:0/2047525139 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199529904 0 0) 0x7f922c155a00 con 0x7f922c152dc0 2024-03-07T10:23:46.075 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.072+0000 7f9222000640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:23:46.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.073+0000 7f922b400640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c0c0930 0x7f922c071b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f922402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cd0a5a59a576 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:46.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.073+0000 7f922a000640 1 -- 172.21.15.194:0/2047525139 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224039070 con 0x7f922c0c0930 2024-03-07T10:23:46.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.073+0000 7f922a000640 1 -- 172.21.15.194:0/2047525139 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922402cb40 con 0x7f922c0c0930 2024-03-07T10:23:46.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.073+0000 7f922a000640 1 -- 172.21.15.194:0/2047525139 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224034440 con 0x7f922c0c0930 2024-03-07T10:23:46.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 -- 172.21.15.194:0/2047525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c0c0930 msgr2=0x7f922c071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c0c0930 0x7f922c071b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f922402bd90 comp rx=0 tx=0).stop 2024-03-07T10:23:46.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 -- 172.21.15.194:0/2047525139 shutdown_connections 2024-03-07T10:23:46.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c0c0930 0x7f922c071b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 --2- 172.21.15.194:0/2047525139 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 -- 172.21.15.194:0/2047525139 >> 172.21.15.194:0/2047525139 conn(0x7f922c06b840 msgr2=0x7f922c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 -- 172.21.15.194:0/2047525139 shutdown_connections 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.074+0000 7f9231c00640 1 -- 172.21.15.194:0/2047525139 wait complete. 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.076+0000 7f9231c00640 1 Processor -- start 2024-03-07T10:23:46.079 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.076+0000 7f9231c00640 1 -- start start 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.076+0000 7f9231c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922c0c0930 0x7f922c14f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f9231c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0abc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f9231c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f9231c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c153320 con 0x7f922c152dc0 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f9231c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1531a0 con 0x7f922c0c0930 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f9231c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0720d0 con 0x7f922c0c12a0 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49504/0 (socket says 172.21.15.194:49504) 2024-03-07T10:23:46.081 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 -- 172.21.15.194:0/2291983405 learned_addr learned my addr 172.21.15.194:0/2291983405 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 -- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 msgr2=0x7f922c0abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 -- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922c0c0930 msgr2=0x7f922c14f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922c0c0930 0x7f922c14f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.077+0000 7f922b400640 1 -- 172.21.15.194:0/2291983405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0c5e80 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f922b400640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f9224004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224044020 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922403a040 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9224039050 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c0c6160 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.078+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c14fb90 con 0x7f922c152dc0 2024-03-07T10:23:46.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.079+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c068170 con 0x7f922c152dc0 2024-03-07T10:23:46.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.080+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f922402c9c0 con 0x7f922c152dc0 2024-03-07T10:23:46.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.081+0000 7f9223400640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 0x7f920806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:46.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.081+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f92240acdd0 con 0x7f922c152dc0 2024-03-07T10:23:46.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.082+0000 7f922aa00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 0x7f920806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:46.084 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.083+0000 7f922aa00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 0x7f920806d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f921c007fd0 tx=0x7f921c007960 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:46.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.085+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f922404e060 con 0x7f922c152dc0 2024-03-07T10:23:46.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.328+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f922c0c29d0 con 0x7f922c152dc0 2024-03-07T10:23:46.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.330+0000 7f9223400640 1 -- 172.21.15.194:0/2291983405 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f922407b7f0 con 0x7f922c152dc0 2024-03-07T10:23:46.331 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:46.331 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:46.332 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 msgr2=0x7f920806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 0x7f920806d9c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f921c007fd0 tx=0x7f921c007960 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 msgr2=0x7f922c0ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9224009d90 tx=0x7f9224004a40 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 shutdown_connections 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f920806b500 0x7f920806d9c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f922c152dc0 0x7f922c0ac1d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f922c0c12a0 0x7f922c0abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 --2- 172.21.15.194:0/2291983405 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f922c0c0930 0x7f922c14f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:46.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 >> 172.21.15.194:0/2291983405 conn(0x7f922c06b840 msgr2=0x7f922c0c3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:46.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 shutdown_connections 2024-03-07T10:23:46.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:46.332+0000 7f9231c00640 1 -- 172.21.15.194:0/2291983405 wait complete. 2024-03-07T10:23:46.356 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:48.356 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:48.496 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:23:48.503 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:23:48.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.614+0000 7f501e800640 1 Processor -- start 2024-03-07T10:23:48.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.614+0000 7f501e800640 1 -- start start 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f50180c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501e800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5018152c80 0x7f501806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501e800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5018155b20 con 0x7f50181528a0 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501e800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5018155dc0 con 0x7f5018152c80 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5018156080 con 0x7f50180c5bc0 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5018152c80 0x7f501806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5018152c80 0x7f501806c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49512/0 (socket says 172.21.15.194:49512) 2024-03-07T10:23:48.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 -- 172.21.15.194:0/963423413 learned_addr learned my addr 172.21.15.194:0/963423413 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:48.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501d400640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f50180c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:48.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 -- 172.21.15.194:0/963423413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 msgr2=0x7f50180c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:48.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f50180c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.616+0000 7f501de00640 1 -- 172.21.15.194:0/963423413 >> v1:172.21.15.194:6789/0 conn(0x7f50181528a0 legacy=0x7f501806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.617+0000 7f501de00640 1 -- 172.21.15.194:0/963423413 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018156360 con 0x7f5018152c80 2024-03-07T10:23:48.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f501de00640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5018152c80 0x7f501806c8d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e50 tx=0x7f501002bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18448b82973475c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:48.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f5017e00640 1 -- 172.21.15.194:0/963423413 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501002ca60 con 0x7f5018152c80 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f5017e00640 1 -- 172.21.15.194:0/963423413 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501002cc00 con 0x7f5018152c80 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f5017e00640 1 -- 172.21.15.194:0/963423413 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50100343f0 con 0x7f5018152c80 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f501e800640 1 -- 172.21.15.194:0/963423413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5018152c80 msgr2=0x7f501806c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.618+0000 7f501e800640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5018152c80 0x7f501806c8d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5010009e50 tx=0x7f501002bec0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 -- 172.21.15.194:0/963423413 shutdown_connections 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5018152c80 0x7f501806c8d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 --2- 172.21.15.194:0/963423413 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f50180c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 -- 172.21.15.194:0/963423413 >> 172.21.15.194:0/963423413 conn(0x7f50180675e0 msgr2=0x7f50180cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 -- 172.21.15.194:0/963423413 shutdown_connections 2024-03-07T10:23:48.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.619+0000 7f501e800640 1 -- 172.21.15.194:0/963423413 wait complete. 2024-03-07T10:23:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.620+0000 7f501e800640 1 Processor -- start 2024-03-07T10:23:48.622 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 -- start start 2024-03-07T10:23:48.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f5018156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5018152c80 0x7f501814e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.624 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50181530f0 con 0x7f50181528a0 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501806ce10 con 0x7f5018152c80 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.621+0000 7f501e800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5018155730 con 0x7f50180c5bc0 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:49518/0 (socket says 172.21.15.194:49518) 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 -- 172.21.15.194:0/3938593130 learned_addr learned my addr 172.21.15.194:0/3938593130 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 -- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 msgr2=0x7f5018156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f5018156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 -- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5018152c80 msgr2=0x7f501814e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501de00640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5018152c80 0x7f501814e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5018152c80 0x7f501814e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.625 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.622+0000 7f501ca00640 1 -- 172.21.15.194:0/3938593130 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018158340 con 0x7f50181528a0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f501ca00640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f500400c430 tx=0x7f500400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004017070 con 0x7f50181528a0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50040052d0 con 0x7f50181528a0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004003850 con 0x7f50181528a0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5018158e40 con 0x7f50181528a0 2024-03-07T10:23:48.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.623+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5018159400 con 0x7f50181528a0 2024-03-07T10:23:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.624+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5018068170 con 0x7f50181528a0 2024-03-07T10:23:48.627 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.625+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f500401a070 con 0x7f50181528a0 2024-03-07T10:23:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.627+0000 7f5015600640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 0x7f4ff806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.627+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f50040899c0 con 0x7f50181528a0 2024-03-07T10:23:48.628 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.627+0000 7f501d400640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 0x7f4ff806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:48.630 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.628+0000 7f501d400640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 0x7f4ff806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f500c0098f0 tx=0x7f500c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:48.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.631+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f50040583e0 con 0x7f50181528a0 2024-03-07T10:23:48.871 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.866+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f501806d450 con 0x7f50181528a0 2024-03-07T10:23:48.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.867+0000 7f5015600640 1 -- 172.21.15.194:0/3938593130 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f5004087e20 con 0x7f50181528a0 2024-03-07T10:23:48.906 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:48.906 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.869+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 msgr2=0x7f4ff806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.869+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 0x7f4ff806d9c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f500c0098f0 tx=0x7f500c008040 comp rx=0 tx=0).stop 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.869+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 msgr2=0x7f501814dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.869+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f500400c430 tx=0x7f500400c8f0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.907 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 shutdown_connections 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ff806b500 0x7f4ff806d9c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5018152c80 0x7f501814e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50181528a0 0x7f501814dd10 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 --2- 172.21.15.194:0/3938593130 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f50180c5bc0 0x7f5018156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 >> 172.21.15.194:0/3938593130 conn(0x7f50180675e0 msgr2=0x7f5018154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 shutdown_connections 2024-03-07T10:23:48.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:48.870+0000 7f501e800640 1 -- 172.21.15.194:0/3938593130 wait complete. 2024-03-07T10:23:48.908 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:50.909 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:51.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.134+0000 7f1f98600640 1 Processor -- start 2024-03-07T10:23:51.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.134+0000 7f1f98600640 1 -- start start 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f90150b70 0x7f1f900a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f90156c20 0x7f1f9006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f900a9a10 0x7f1f9006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f90153980 con 0x7f1f90156c20 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f90153c60 con 0x7f1f90150b70 2024-03-07T10:23:51.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f98600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90153f40 con 0x7f1f900a9a10 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f95200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f90156c20 0x7f1f9006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f95200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f90156c20 0x7f1f9006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48024/0 (socket says 172.21.15.194:48024) 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f95200640 1 -- 172.21.15.194:0/2211610265 learned_addr learned my addr 172.21.15.194:0/2211610265 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.136+0000 7f1f96600640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f900a9a10 0x7f1f9006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.137+0000 7f1f95200640 1 -- 172.21.15.194:0/2211610265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f900a9a10 msgr2=0x7f1f9006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.137+0000 7f1f95200640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f900a9a10 0x7f1f9006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.137+0000 7f1f95200640 1 -- 172.21.15.194:0/2211610265 >> v2:172.21.15.196:3300/0 conn(0x7f1f90150b70 msgr2=0x7f1f900a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.137+0000 7f1f95200640 1 --2- 172.21.15.194:0/2211610265 >> v2:172.21.15.196:3300/0 conn(0x7f1f90150b70 0x7f1f900a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.139 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.137+0000 7f1f95200640 1 -- 172.21.15.194:0/2211610265 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f90154220 con 0x7f1f90156c20 2024-03-07T10:23:51.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.138+0000 7f1f95200640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9006d900 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1f90073240 tx=0x7f1f8402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6214ddf90802fd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.138+0000 7f1f8fe00640 1 -- 172.21.15.194:0/2211610265 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8402c9f0 con 0x7f1f90156c20 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.138+0000 7f1f8fe00640 1 -- 172.21.15.194:0/2211610265 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8402cb90 con 0x7f1f90156c20 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.138+0000 7f1f8fe00640 1 -- 172.21.15.194:0/2211610265 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840343f0 con 0x7f1f90156c20 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 -- 172.21.15.194:0/2211610265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 msgr2=0x7f1f9006d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9006d900 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1f90073240 tx=0x7f1f8402be50 comp rx=0 tx=0).stop 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 -- 172.21.15.194:0/2211610265 shutdown_connections 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f900a9a10 0x7f1f9006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 --2- 172.21.15.194:0/2211610265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9006d900 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 --2- 172.21.15.194:0/2211610265 >> v2:172.21.15.196:3300/0 conn(0x7f1f90150b70 0x7f1f900a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 -- 172.21.15.194:0/2211610265 >> 172.21.15.194:0/2211610265 conn(0x7f1f9006b840 msgr2=0x7f1f900c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 -- 172.21.15.194:0/2211610265 shutdown_connections 2024-03-07T10:23:51.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.139+0000 7f1f98600640 1 -- 172.21.15.194:0/2211610265 wait complete. 2024-03-07T10:23:51.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.140+0000 7f1f98600640 1 Processor -- start 2024-03-07T10:23:51.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.141+0000 7f1f98600640 1 -- start start 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.141+0000 7f1f98600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f900a9a10 0x7f1f901e0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f98600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f90150b70 0x7f1f901ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f98600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f98600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90150f50 con 0x7f1f90156c20 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f98600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90153630 con 0x7f1f900a9a10 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f98600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901510d0 con 0x7f1f90150b70 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48032/0 (socket says 172.21.15.194:48032) 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 -- 172.21.15.194:0/3266511583 learned_addr learned my addr 172.21.15.194:0/3266511583 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f95200640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f90150b70 0x7f1f901ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f95c00640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f900a9a10 0x7f1f901e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 -- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f90150b70 msgr2=0x7f1f901ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:51.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f90150b70 0x7f1f901ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 -- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f900a9a10 msgr2=0x7f1f901e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:51.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f900a9a10 0x7f1f901e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.142+0000 7f1f96600640 1 -- 172.21.15.194:0/3266511583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f901ec710 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f96600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800d5d0 tx=0x7f1f8800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880125f0 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f88019070 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f880129f0 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901dcf40 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.143+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f901ecc90 con 0x7f1f90156c20 2024-03-07T10:23:51.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.144+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f90068170 con 0x7f1f90156c20 2024-03-07T10:23:51.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.145+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1f88012b90 con 0x7f1f90156c20 2024-03-07T10:23:51.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.146+0000 7f1f8d600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 0x7f1f7406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:51.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.147+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f1f8808aab0 con 0x7f1f90156c20 2024-03-07T10:23:51.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.147+0000 7f1f95c00640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 0x7f1f7406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:51.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.148+0000 7f1f95c00640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 0x7f1f7406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000b810 tx=0x7f1f80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:51.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.150+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1f88059450 con 0x7f1f90156c20 2024-03-07T10:23:51.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.380+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f90150300 con 0x7f1f90156c20 2024-03-07T10:23:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.381+0000 7f1f8d600640 1 -- 172.21.15.194:0/3266511583 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f1f88058d50 con 0x7f1f90156c20 2024-03-07T10:23:51.382 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:51.382 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:51.382 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 msgr2=0x7f1f7406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 0x7f1f7406d990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000b810 tx=0x7f1f80008040 comp rx=0 tx=0).stop 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 msgr2=0x7f1f9014d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1f8800d5d0 tx=0x7f1f8800da90 comp rx=0 tx=0).stop 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 shutdown_connections 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f7406b4d0 0x7f1f7406d990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f90156c20 0x7f1f9014d0a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.385 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f90150b70 0x7f1f901ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 --2- 172.21.15.194:0/3266511583 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f900a9a10 0x7f1f901e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 >> 172.21.15.194:0/3266511583 conn(0x7f1f9006b840 msgr2=0x7f1f9014e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 shutdown_connections 2024-03-07T10:23:51.386 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:51.383+0000 7f1f98600640 1 -- 172.21.15.194:0/3266511583 wait complete. 2024-03-07T10:23:51.405 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:52.306 INFO:tasks.mds_thrash.fs.[a]:reviving mds.b 2024-03-07T10:23:52.306 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-07T10:23:52.307 DEBUG:teuthology.orchestra.run.smithi196:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-07T10:23:52.315 INFO:tasks.ceph.mds.b:Started 2024-03-07T10:23:52.315 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:52.496 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-03-07T10:23:52.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.518+0000 7f0e70a00640 1 Processor -- start 2024-03-07T10:23:52.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.518+0000 7f0e70a00640 1 -- start start 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.519+0000 7f0e70a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e6c0c5bc0 0x7f0e6c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.519+0000 7f0e70a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0e6c152c80 0x7f0e6c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.519+0000 7f0e70a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c155b20 con 0x7f0e6c1528a0 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.519+0000 7f0e70a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c155dc0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.519+0000 7f0e70a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c156080 con 0x7f0e6c152c80 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e6c0c5bc0 0x7f0e6c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e61e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0e6c1528a0 0x7f0e6c06c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53218/0 (socket says 172.21.15.194:53218) 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e61e00640 1 -- 172.21.15.194:0/2204356087 learned_addr learned my addr 172.21.15.194:0/2204356087 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6b200640 1 --2- 172.21.15.194:0/2204356087 >> v2:172.21.15.196:3300/0 conn(0x7f0e6c152c80 0x7f0e6c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6a800640 1 -- 172.21.15.194:0/2204356087 >> v2:172.21.15.196:3300/0 conn(0x7f0e6c152c80 msgr2=0x7f0e6c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:52.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6a800640 1 --2- 172.21.15.194:0/2204356087 >> v2:172.21.15.196:3300/0 conn(0x7f0e6c152c80 0x7f0e6c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6a800640 1 -- 172.21.15.194:0/2204356087 >> v1:172.21.15.194:6789/0 conn(0x7f0e6c1528a0 legacy=0x7f0e6c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.523 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.520+0000 7f0e6a800640 1 -- 172.21.15.194:0/2204356087 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c156360 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.522+0000 7f0e6a800640 1 --2- 172.21.15.194:0/2204356087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c0c8ed0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0c8900 tx=0x7f0e5c02bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b923633d2005f360 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:52.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e69e00640 1 -- 172.21.15.194:0/2204356087 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c039070 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e69e00640 1 -- 172.21.15.194:0/2204356087 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c02c9a0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.524 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e69e00640 1 -- 172.21.15.194:0/2204356087 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c02cd70 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 -- 172.21.15.194:0/2204356087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 msgr2=0x7f0e6c0c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2204356087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c0c8ed0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c0c8900 tx=0x7f0e5c02bc70 comp rx=0 tx=0).stop 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 -- 172.21.15.194:0/2204356087 shutdown_connections 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2204356087 >> v2:172.21.15.196:3300/0 conn(0x7f0e6c152c80 0x7f0e6c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2204356087 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c0c8ed0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.523+0000 7f0e70a00640 1 -- 172.21.15.194:0/2204356087 >> 172.21.15.194:0/2204356087 conn(0x7f0e6c0675e0 msgr2=0x7f0e6c0cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.524+0000 7f0e70a00640 1 -- 172.21.15.194:0/2204356087 shutdown_connections 2024-03-07T10:23:52.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.524+0000 7f0e70a00640 1 -- 172.21.15.194:0/2204356087 wait complete. 2024-03-07T10:23:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.525+0000 7f0e70a00640 1 Processor -- start 2024-03-07T10:23:52.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.525+0000 7f0e70a00640 1 -- start start 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e6c1528a0 0x7f0e6c1eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e6c152c80 0x7f0e6c1eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1530d0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c06ce10 con 0x7f0e6c152c80 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e70a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c155730 con 0x7f0e6c1528a0 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e6a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e6a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48040/0 (socket says 172.21.15.194:48040) 2024-03-07T10:23:52.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.526+0000 7f0e6a800640 1 -- 172.21.15.194:0/2459701234 learned_addr learned my addr 172.21.15.194:0/2459701234 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e61e00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e6c1528a0 0x7f0e6c1eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6b200640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e6c152c80 0x7f0e6c1eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 -- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e6c1528a0 msgr2=0x7f0e6c1eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e6c1528a0 0x7f0e6c1eb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 -- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e6c152c80 msgr2=0x7f0e6c1eb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e6c152c80 0x7f0e6c1eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 -- 172.21.15.194:0/2459701234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c159720 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e6a800640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c037040 tx=0x7f0e5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c039050 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c045070 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c040450 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.527+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c150b50 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.528+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c157f00 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.529+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c068170 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.529+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f0e5c0405f0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.530+0000 7f0e63400640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 0x7f0e4806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:52.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.530+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7f0e5c0acfb0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.531+0000 7f0e61e00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 0x7f0e4806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:52.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.532+0000 7f0e61e00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 0x7f0e4806d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0e54007fd0 tx=0x7f0e54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:52.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.535+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f0e5c07b9d0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.764+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e6c0c1e60 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.765+0000 7f0e63400640 1 -- 172.21.15.194:0/2459701234 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+5470 (secure 0 0 0) 0x7f0e5c07b2d0 con 0x7f0e6c0c5bc0 2024-03-07T10:23:52.767 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:52.767 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:52.767 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 24 2024-03-07T10:23:52.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.767+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 msgr2=0x7f0e4806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.767+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 0x7f0e4806d990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0e54007fd0 tx=0x7f0e54009040 comp rx=0 tx=0).stop 2024-03-07T10:23:52.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.767+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 msgr2=0x7f0e6c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:52.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.767+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c037040 tx=0x7f0e5c004a40 comp rx=0 tx=0).stop 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 shutdown_connections 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f0e4806b4d0 0x7f0e4806d990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0e6c152c80 0x7f0e6c1eb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f0e6c1528a0 0x7f0e6c1eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 --2- 172.21.15.194:0/2459701234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e6c0c5bc0 0x7f0e6c1579c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 >> 172.21.15.194:0/2459701234 conn(0x7f0e6c0675e0 msgr2=0x7f0e6c0ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 shutdown_connections 2024-03-07T10:23:52.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:52.768+0000 7f0e70a00640 1 -- 172.21.15.194:0/2459701234 wait complete. 2024-03-07T10:23:52.786 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-03-07T10:23:53.406 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:53.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.606+0000 7feb66800640 1 Processor -- start 2024-03-07T10:23:53.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.606+0000 7feb66800640 1 -- start start 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb66800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb60152d00 0x7feb601555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb66800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb6006f720 0x7feb6006c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb66800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb600c5c10 con 0x7feb6006c5d0 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb66800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb60158d10 con 0x7feb6006f720 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb66800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb60155ce0 con 0x7feb60152d00 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb6006f720 0x7feb6006c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb6006f720 0x7feb6006c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48054/0 (socket says 172.21.15.194:48054) 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 -- 172.21.15.194:0/2323367368 learned_addr learned my addr 172.21.15.194:0/2323367368 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb65400640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb60152d00 0x7feb601555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 -- 172.21.15.194:0/2323367368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb60152d00 msgr2=0x7feb601555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:53.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb60152d00 0x7feb601555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.609+0000 7feb64a00640 1 -- 172.21.15.194:0/2323367368 >> v1:172.21.15.196:6789/0 conn(0x7feb6006c5d0 legacy=0x7feb601591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.610+0000 7feb64a00640 1 -- 172.21.15.194:0/2323367368 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60155fc0 con 0x7feb6006f720 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.611+0000 7feb64a00640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb6006f720 0x7feb6006c090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009870 tx=0x7feb4c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62857aae485e2d99 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.611+0000 7feb5fe00640 1 -- 172.21.15.194:0/2323367368 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c038070 con 0x7feb6006f720 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.611+0000 7feb5fe00640 1 -- 172.21.15.194:0/2323367368 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c031740 con 0x7feb6006f720 2024-03-07T10:23:53.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.611+0000 7feb5fe00640 1 -- 172.21.15.194:0/2323367368 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c02f050 con 0x7feb6006f720 2024-03-07T10:23:53.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 -- 172.21.15.194:0/2323367368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb6006f720 msgr2=0x7feb6006c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:53.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb6006f720 0x7feb6006c090 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009870 tx=0x7feb4c02b7e0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 -- 172.21.15.194:0/2323367368 shutdown_connections 2024-03-07T10:23:53.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb6006f720 0x7feb6006c090 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 --2- 172.21.15.194:0/2323367368 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb60152d00 0x7feb601555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 -- 172.21.15.194:0/2323367368 >> 172.21.15.194:0/2323367368 conn(0x7feb600c4090 msgr2=0x7feb600c4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:53.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 -- 172.21.15.194:0/2323367368 shutdown_connections 2024-03-07T10:23:53.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.612+0000 7feb66800640 1 -- 172.21.15.194:0/2323367368 wait complete. 2024-03-07T10:23:53.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.614+0000 7feb66800640 1 Processor -- start 2024-03-07T10:23:53.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.614+0000 7feb66800640 1 -- start start 2024-03-07T10:23:53.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb6006c5d0 0x7feb601eeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb6006f720 0x7feb60071bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601598b0 con 0x7feb60152d00 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb601530e0 con 0x7feb6006c5d0 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.615+0000 7feb66800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb60159a30 con 0x7feb6006f720 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48068/0 (socket says 172.21.15.194:48068) 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 -- 172.21.15.194:0/3024194646 learned_addr learned my addr 172.21.15.194:0/3024194646 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65400640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb6006c5d0 0x7feb601eeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb64a00640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb6006f720 0x7feb60071bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 -- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb6006f720 msgr2=0x7feb60071bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb6006f720 0x7feb60071bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 -- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb6006c5d0 msgr2=0x7feb601eeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb6006c5d0 0x7feb601eeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 -- 172.21.15.194:0/3024194646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600712d0 con 0x7feb60152d00 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.616+0000 7feb65e00640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feb5800b9a0 tx=0x7feb5800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.617+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58019070 con 0x7feb60152d00 2024-03-07T10:23:53.619 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.617+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800cba0 con 0x7feb60152d00 2024-03-07T10:23:53.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.617+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb58014440 con 0x7feb60152d00 2024-03-07T10:23:53.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.617+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb601ef0e0 con 0x7feb60152d00 2024-03-07T10:23:53.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.617+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb60071570 con 0x7feb60152d00 2024-03-07T10:23:53.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.618+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb60068880 con 0x7feb60152d00 2024-03-07T10:23:53.620 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.619+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7feb5801c070 con 0x7feb60152d00 2024-03-07T10:23:53.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.620+0000 7feb5d600640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 0x7feb4006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:53.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.620+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7feb5808a270 con 0x7feb60152d00 2024-03-07T10:23:53.621 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.620+0000 7feb65400640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 0x7feb4006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:53.623 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.621+0000 7feb65400640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 0x7feb4006d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb54006fd0 tx=0x7feb54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:53.626 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.625+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7feb58058c90 con 0x7feb60152d00 2024-03-07T10:23:53.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.851+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb600c56b0 con 0x7feb60152d00 2024-03-07T10:23:53.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.852+0000 7feb5d600640 1 -- 172.21.15.194:0/3024194646 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6264 (secure 0 0 0) 0x7feb58058590 con 0x7feb60152d00 2024-03-07T10:23:53.854 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:53.854 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:53.854 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 25 2024-03-07T10:23:53.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 msgr2=0x7feb4006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:53.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 0x7feb4006d990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7feb54006fd0 tx=0x7feb54008040 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 msgr2=0x7feb601dee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7feb5800b9a0 tx=0x7feb5800be60 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 shutdown_connections 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feb4006b4d0 0x7feb4006d990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb60152d00 0x7feb601dee10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feb6006f720 0x7feb60071bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 --2- 172.21.15.194:0/3024194646 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feb6006c5d0 0x7feb601eeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 >> 172.21.15.194:0/3024194646 conn(0x7feb600c4090 msgr2=0x7feb60150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 shutdown_connections 2024-03-07T10:23:53.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:53.855+0000 7feb66800640 1 -- 172.21.15.194:0/3024194646 wait complete. 2024-03-07T10:23:53.875 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:54.787 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.998+0000 7ff5dfe00640 1 Processor -- start 2024-03-07T10:23:55.000 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.998+0000 7ff5dfe00640 1 -- start start 2024-03-07T10:23:55.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.999+0000 7ff5dfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff5e00c2690 0x7ff5e00c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:55.001 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.999+0000 7ff5dfe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00c33b0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.999+0000 7ff5dfe00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e0072d80 con 0x7ff5e0150a90 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:54.999+0000 7ff5dfe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e0072b50 con 0x7ff5e00c2690 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff5e00c2690 0x7ff5e00c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff5e00c2690 0x7ff5e00c16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48074/0 (socket says 172.21.15.194:48074) 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 -- 172.21.15.194:0/1014384051 learned_addr learned my addr 172.21.15.194:0/1014384051 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:55.002 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5df400640 1 --1- 172.21.15.194:0/1014384051 >> v1:172.21.15.194:6789/0 conn(0x7ff5e00c2df0 0x7ff5e00c1c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53226/0 (socket says 172.21.15.194:53226) 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 -- 172.21.15.194:0/1014384051 >> v1:172.21.15.196:6789/0 conn(0x7ff5e0150a90 legacy=0x7ff5e00c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 -- 172.21.15.194:0/1014384051 >> v1:172.21.15.194:6789/0 conn(0x7ff5e00c2df0 legacy=0x7ff5e00c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5de000640 1 -- 172.21.15.194:0/1014384051 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e0073060 con 0x7ff5e00c2690 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.000+0000 7ff5dd600640 1 -- 172.21.15.194:0/1014384051 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837435532 0 0) 0x7ff5e00c33b0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.001+0000 7ff5de000640 1 --2- 172.21.15.194:0/1014384051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2690 0x7ff5e00c16d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009870 tx=0x7ff5cc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319bd0f692f940f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dd600640 1 -- 172.21.15.194:0/1014384051 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02f840 con 0x7ff5e00c2690 2024-03-07T10:23:55.003 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dd600640 1 -- 172.21.15.194:0/1014384051 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc02f9e0 con 0x7ff5e00c2690 2024-03-07T10:23:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dd600640 1 -- 172.21.15.194:0/1014384051 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02fdb0 con 0x7ff5e00c2690 2024-03-07T10:23:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dfe00640 1 -- 172.21.15.194:0/1014384051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2690 msgr2=0x7ff5e00c16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/1014384051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2690 0x7ff5e00c16d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009870 tx=0x7ff5cc02ba20 comp rx=0 tx=0).stop 2024-03-07T10:23:55.004 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dfe00640 1 -- 172.21.15.194:0/1014384051 shutdown_connections 2024-03-07T10:23:55.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/1014384051 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2690 0x7ff5e00c16d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.002+0000 7ff5dfe00640 1 -- 172.21.15.194:0/1014384051 >> 172.21.15.194:0/1014384051 conn(0x7ff5e00c70f0 msgr2=0x7ff5e00c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:55.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.003+0000 7ff5dfe00640 1 -- 172.21.15.194:0/1014384051 shutdown_connections 2024-03-07T10:23:55.005 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.003+0000 7ff5dfe00640 1 -- 172.21.15.194:0/1014384051 wait complete. 2024-03-07T10:23:55.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.004+0000 7ff5dfe00640 1 Processor -- start 2024-03-07T10:23:55.006 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.004+0000 7ff5dfe00640 1 -- start start 2024-03-07T10:23:55.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e00c2690 0x7ff5e01ea650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:55.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:55.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5e0150a90 0x7ff5e0149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:55.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0071cf0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.007 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0150e70 con 0x7ff5e0150a90 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5dfe00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e00c2320 con 0x7ff5e00c2690 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5de000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5de000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48080/0 (socket says 172.21.15.194:48080) 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.005+0000 7ff5de000640 1 -- 172.21.15.194:0/3046295868 learned_addr learned my addr 172.21.15.194:0/3046295868 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 -- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e00c2690 msgr2=0x7ff5e01ea650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e00c2690 0x7ff5e01ea650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 -- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5e0150a90 msgr2=0x7ff5e0149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5e0150a90 0x7ff5e0149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 -- 172.21.15.194:0/3046295868 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e014a5b0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.008 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5de000640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:55.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc037d40 con 0x7ff5e00c2df0 2024-03-07T10:23:55.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc046070 con 0x7ff5e00c2df0 2024-03-07T10:23:55.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0149e20 con 0x7ff5e00c2df0 2024-03-07T10:23:55.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.006+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc041640 con 0x7ff5e00c2df0 2024-03-07T10:23:55.009 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.007+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e00aa460 con 0x7ff5e00c2df0 2024-03-07T10:23:55.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.008+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e0068170 con 0x7ff5e00c2df0 2024-03-07T10:23:55.010 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.009+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff5cc040070 con 0x7ff5e00c2df0 2024-03-07T10:23:55.011 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.010+0000 7ff5d6a00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 0x7ff5c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:55.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.010+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7ff5cc0aced0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.012 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.011+0000 7ff5dea00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 0x7ff5c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:55.013 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.012+0000 7ff5dea00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 0x7ff5c006d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0006bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:55.016 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.015+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff5cc033030 con 0x7ff5e00c2df0 2024-03-07T10:23:55.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.256+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5e00c13b0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.257+0000 7ff5d6a00640 1 -- 172.21.15.194:0/3046295868 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6264 (secure 0 0 0) 0x7ff5cc07b8f0 con 0x7ff5e00c2df0 2024-03-07T10:23:55.258 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:55.258 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:55.259 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 25 2024-03-07T10:23:55.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 msgr2=0x7ff5c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 0x7ff5c006d990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0006bc0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 msgr2=0x7ff5e0149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc004730 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 shutdown_connections 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5c006b4d0 0x7ff5c006d990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff5e0150a90 0x7ff5e0149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff5e00c2df0 0x7ff5e0149140 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 --2- 172.21.15.194:0/3046295868 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff5e00c2690 0x7ff5e01ea650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 >> 172.21.15.194:0/3046295868 conn(0x7ff5e00c70f0 msgr2=0x7ff5e014fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 shutdown_connections 2024-03-07T10:23:55.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:55.260+0000 7ff5dfe00640 1 -- 172.21.15.194:0/3046295868 wait complete. 2024-03-07T10:23:55.279 INFO:tasks.mds_thrash.fs.[a]:mds.b reported in up:standby state 2024-03-07T10:23:55.279 INFO:tasks.mds_thrash.fs.[a]:waiting for 84 secs before thrashing 2024-03-07T10:23:55.876 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:56.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.085+0000 7fa7e0400640 1 Processor -- start 2024-03-07T10:23:56.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.085+0000 7fa7e0400640 1 -- start start 2024-03-07T10:23:56.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7e0400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7d8154100 0x7fa7d8155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7e0400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa7d80c19c0 0x7fa7d8156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.088 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7e0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d81568e0 con 0x7fa7d8148f40 2024-03-07T10:23:56.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7e0400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d8073240 con 0x7fa7d8154100 2024-03-07T10:23:56.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7e0400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d806e000 con 0x7fa7d80c19c0 2024-03-07T10:23:56.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7dd000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7d8154100 0x7fa7d8155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:56.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7dda00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa7d8148f40 0x7fa7d81539f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:53234/0 (socket says 172.21.15.194:53234) 2024-03-07T10:23:56.089 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7dda00640 1 -- 172.21.15.194:0/1880030290 learned_addr learned my addr 172.21.15.194:0/1880030290 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:23:56.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7de400640 1 --2- 172.21.15.194:0/1880030290 >> v2:172.21.15.196:3300/0 conn(0x7fa7d80c19c0 0x7fa7d8156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:56.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7d7e00640 1 -- 172.21.15.194:0/1880030290 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755470938 0 0) 0x7fa7d81568e0 con 0x7fa7d8148f40 2024-03-07T10:23:56.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.087+0000 7fa7d7e00640 1 -- 172.21.15.194:0/1880030290 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7bc003520 con 0x7fa7d8148f40 2024-03-07T10:23:56.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.088+0000 7fa7dd000640 1 -- 172.21.15.194:0/1880030290 >> v2:172.21.15.196:3300/0 conn(0x7fa7d80c19c0 msgr2=0x7fa7d8156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:56.092 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.088+0000 7fa7dd000640 1 --2- 172.21.15.194:0/1880030290 >> v2:172.21.15.196:3300/0 conn(0x7fa7d80c19c0 0x7fa7d8156030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.088+0000 7fa7dd000640 1 -- 172.21.15.194:0/1880030290 >> v1:172.21.15.194:6789/0 conn(0x7fa7d8148f40 legacy=0x7fa7d81539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.088+0000 7fa7dd000640 1 -- 172.21.15.194:0/1880030290 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d806d6d0 con 0x7fa7d8154100 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.089+0000 7fa7dd000640 1 --2- 172.21.15.194:0/1880030290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d8155af0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80c79b0 tx=0x7fa7c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c795ad87492c398 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.089+0000 7fa7d7e00640 1 -- 172.21.15.194:0/1880030290 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40315a0 con 0x7fa7d8154100 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.089+0000 7fa7d7e00640 1 -- 172.21.15.194:0/1880030290 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c4037070 con 0x7fa7d8154100 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.089+0000 7fa7d7e00640 1 -- 172.21.15.194:0/1880030290 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4031940 con 0x7fa7d8154100 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 -- 172.21.15.194:0/1880030290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 msgr2=0x7fa7d8155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 --2- 172.21.15.194:0/1880030290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d8155af0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80c79b0 tx=0x7fa7c402b840 comp rx=0 tx=0).stop 2024-03-07T10:23:56.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 -- 172.21.15.194:0/1880030290 shutdown_connections 2024-03-07T10:23:56.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 --2- 172.21.15.194:0/1880030290 >> v2:172.21.15.196:3300/0 conn(0x7fa7d80c19c0 0x7fa7d8156030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 --2- 172.21.15.194:0/1880030290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d8155af0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 -- 172.21.15.194:0/1880030290 >> 172.21.15.194:0/1880030290 conn(0x7fa7d806b840 msgr2=0x7fa7d80c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:56.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 -- 172.21.15.194:0/1880030290 shutdown_connections 2024-03-07T10:23:56.094 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.090+0000 7fa7e0400640 1 -- 172.21.15.194:0/1880030290 wait complete. 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.091+0000 7fa7e0400640 1 Processor -- start 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 -- start start 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d80c19c0 0x7fa7d80c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d8148f40 0x7fa7d81ec440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8149320 con 0x7fa7d8154100 2024-03-07T10:23:56.098 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d806dc90 con 0x7fa7d8148f40 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.092+0000 7fa7e0400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d8156570 con 0x7fa7d80c19c0 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48104/0 (socket says 172.21.15.194:48104) 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 -- 172.21.15.194:0/3747478775 learned_addr learned my addr 172.21.15.194:0/3747478775 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 -- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d80c19c0 msgr2=0x7fa7d80c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d80c19c0 0x7fa7d80c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 -- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d8148f40 msgr2=0x7fa7d81ec440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d8148f40 0x7fa7d81ec440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 -- 172.21.15.194:0/3747478775 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d813eb20 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.093+0000 7fa7de400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000d600 tx=0x7fa7d000dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.094+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00125f0 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.094+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d0019070 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.094+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d81dec30 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.094+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00129f0 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.094+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d81deef0 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.095+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d8068170 con 0x7fa7d8154100 2024-03-07T10:23:56.100 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.096+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa7d0012b90 con 0x7fa7d8154100 2024-03-07T10:23:56.101 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.097+0000 7fa7d5600640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 0x7fa7b806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:56.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.097+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6809+0+0 (secure 0 0 0) 0x7fa7d008ab30 con 0x7fa7d8154100 2024-03-07T10:23:56.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.097+0000 7fa7dda00640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 0x7fa7b806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:56.102 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.099+0000 7fa7dda00640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 0x7fa7b806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80012e0 tx=0x7fa7c8001650 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:56.104 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.103+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa7d813eb20 con 0x7fa7d8154100 2024-03-07T10:23:56.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.419+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7d80c79e0 con 0x7fa7d8154100 2024-03-07T10:23:56.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.421+0000 7fa7d5600640 1 -- 172.21.15.194:0/3747478775 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+6264 (secure 0 0 0) 0x7fa7d00594d0 con 0x7fa7d8154100 2024-03-07T10:23:56.422 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:56.422 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4733,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:22:56.000173+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":27,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":16,"state":"up:active","state_seq":34,"addr":"172.21.15.194:6833/1582324990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1582324990},{"type":"v1","addr":"172.21.15.194:6833","nonce":1582324990}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4251,"qdb_cluster":[4251]},"id":2}]} 2024-03-07T10:23:56.423 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 25 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 msgr2=0x7fa7b806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 0x7fa7b806d990 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80012e0 tx=0x7fa7c8001650 comp rx=0 tx=0).stop 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 msgr2=0x7fa7d81ec980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa7d000d600 tx=0x7fa7d000dac0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 shutdown_connections 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b806b4d0 0x7fa7b806d990 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d8154100 0x7fa7d81ec980 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d8148f40 0x7fa7d81ec440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 --2- 172.21.15.194:0/3747478775 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d80c19c0 0x7fa7d80c24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 >> 172.21.15.194:0/3747478775 conn(0x7fa7d806b840 msgr2=0x7fa7d8155090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 shutdown_connections 2024-03-07T10:23:56.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:56.423+0000 7fa7e0400640 1 -- 172.21.15.194:0/3747478775 wait complete. 2024-03-07T10:23:56.443 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-03-07T10:23:58.444 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:58.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.662+0000 7fc4d8800640 1 Processor -- start 2024-03-07T10:23:58.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.662+0000 7fc4d8800640 1 -- start start 2024-03-07T10:23:58.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d8800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4d0152e90 0x7fc4d00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d8800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d00c8f90 0x7fc4d0155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d8800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4d0156300 con 0x7fc4d00be720 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d8800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d00cb3c0 con 0x7fc4d0152e90 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d8800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00cb980 con 0x7fc4d00c8f90 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4d0152e90 0x7fc4d00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4d0152e90 0x7fc4d00c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48116/0 (socket says 172.21.15.194:48116) 2024-03-07T10:23:58.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.665+0000 7fc4d5e00640 1 -- 172.21.15.194:0/1034747976 learned_addr learned my addr 172.21.15.194:0/1034747976 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:58.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.666+0000 7fc4d6800640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d00c8f90 0x7fc4d0155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.666+0000 7fc4d5e00640 1 -- 172.21.15.194:0/1034747976 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d00c8f90 msgr2=0x7fc4d0155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:58.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.666+0000 7fc4d5e00640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d00c8f90 0x7fc4d0155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.666+0000 7fc4d5e00640 1 -- 172.21.15.194:0/1034747976 >> v1:172.21.15.196:6789/0 conn(0x7fc4d00be720 legacy=0x7fc4d01556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:58.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.666+0000 7fc4d5e00640 1 -- 172.21.15.194:0/1034747976 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0159750 con 0x7fc4d0152e90 2024-03-07T10:23:58.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.667+0000 7fc4d5e00640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d0152e90 0x7fc4d00c5a10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009870 tx=0x7fc4c402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9d137f4665648d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:58.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.667+0000 7fc4d4a00640 1 -- 172.21.15.194:0/1034747976 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c4038070 con 0x7fc4d0152e90 2024-03-07T10:23:58.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.667+0000 7fc4d4a00640 1 -- 172.21.15.194:0/1034747976 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c4031740 con 0x7fc4d0152e90 2024-03-07T10:23:58.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.667+0000 7fc4d4a00640 1 -- 172.21.15.194:0/1034747976 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c402f050 con 0x7fc4d0152e90 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 -- 172.21.15.194:0/1034747976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d0152e90 msgr2=0x7fc4d00c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d0152e90 0x7fc4d00c5a10 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009870 tx=0x7fc4c402b7e0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 -- 172.21.15.194:0/1034747976 shutdown_connections 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d00c8f90 0x7fc4d0155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 --2- 172.21.15.194:0/1034747976 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d0152e90 0x7fc4d00c5a10 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.668+0000 7fc4d8800640 1 -- 172.21.15.194:0/1034747976 >> 172.21.15.194:0/1034747976 conn(0x7fc4d0066f70 msgr2=0x7fc4d0067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.669+0000 7fc4d8800640 1 -- 172.21.15.194:0/1034747976 shutdown_connections 2024-03-07T10:23:58.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.669+0000 7fc4d8800640 1 -- 172.21.15.194:0/1034747976 wait complete. 2024-03-07T10:23:58.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.672+0000 7fc4d8800640 1 Processor -- start 2024-03-07T10:23:58.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.672+0000 7fc4d8800640 1 -- start start 2024-03-07T10:23:58.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4d00be720 0x7fc4d014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d0158770 0x7fc4d0153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d006d850 con 0x7fc4d00c8f90 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d00cb610 con 0x7fc4d00be720 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d8800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d006d9d0 con 0x7fc4d0158770 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:48130/0 (socket says 172.21.15.194:48130) 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d5400640 1 -- 172.21.15.194:0/4237563613 learned_addr learned my addr 172.21.15.194:0/4237563613 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.674+0000 7fc4d5e00640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4d00be720 0x7fc4d014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d6800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d0158770 0x7fc4d0153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 -- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d0158770 msgr2=0x7fc4d0153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d0158770 0x7fc4d0153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 -- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4d00be720 msgr2=0x7fc4d014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4d00be720 0x7fc4d014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 -- 172.21.15.194:0/4237563613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d0156a50 con 0x7fc4d00c8f90 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d5400640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b3f0 tx=0x7fc4c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0015020 con 0x7fc4d00c8f90 2024-03-07T10:23:58.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c0011830 con 0x7fc4d00c8f90 2024-03-07T10:23:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0011c20 con 0x7fc4d00c8f90 2024-03-07T10:23:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.675+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d0156d30 con 0x7fc4d00c8f90 2024-03-07T10:23:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.676+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d014ff30 con 0x7fc4d00c8f90 2024-03-07T10:23:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.677+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d0068170 con 0x7fc4d00c8f90 2024-03-07T10:23:58.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.678+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc4c0018020 con 0x7fc4d00c8f90 2024-03-07T10:23:58.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.678+0000 7fc4ca000640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 0x7fc4b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:58.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.679+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fc4c008a340 con 0x7fc4d00c8f90 2024-03-07T10:23:58.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.679+0000 7fc4d5e00640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 0x7fc4b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:58.682 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.680+0000 7fc4d5e00640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 0x7fc4b406d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4035000 tx=0x7fc4c4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:58.684 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.683+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc4c001f030 con 0x7fc4d00c8f90 2024-03-07T10:23:58.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.917+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4d006d580 con 0x7fc4d00c8f90 2024-03-07T10:23:58.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.917+0000 7fc4ca000640 1 -- 172.21.15.194:0/4237563613 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+5462 (secure 0 0 0) 0x7fc4c00172c0 con 0x7fc4d00c8f90 2024-03-07T10:23:58.919 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:58.919 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:23:58.006056+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-03-07T10:23:58.919 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 26 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 msgr2=0x7fc4b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 0x7fc4b406d9c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4035000 tx=0x7fc4c4008030 comp rx=0 tx=0).stop 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 msgr2=0x7fc4d0153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc4c000b3f0 tx=0x7fc4c000b8b0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 shutdown_connections 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc4b406b500 0x7fc4b406d9c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc4d0158770 0x7fc4d0153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4d00c8f90 0x7fc4d0153730 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.922 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 --2- 172.21.15.194:0/4237563613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc4d00be720 0x7fc4d014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:58.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 >> 172.21.15.194:0/4237563613 conn(0x7fc4d0066f70 msgr2=0x7fc4d00c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:58.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 shutdown_connections 2024-03-07T10:23:58.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:58.920+0000 7fc4d8800640 1 -- 172.21.15.194:0/4237563613 wait complete. 2024-03-07T10:23:58.942 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-03-07T10:23:58.942 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-03-07T10:23:58.942 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:23:59.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.136+0000 7feefd800640 1 Processor -- start 2024-03-07T10:23:59.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.137+0000 7feefd800640 1 -- start start 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feefd800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feef806eb60 0x7feef80c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feefd800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7feef81569b0 0x7feef806b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feefd800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef8153400 con 0x7feef8150c70 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feefd800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef81542b0 con 0x7feef806eb60 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feefd800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef806f7f0 con 0x7feef81569b0 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feeefe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feef806eb60 0x7feef80c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feeefe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feef806eb60 0x7feef80c34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58040/0 (socket says 172.21.15.194:58040) 2024-03-07T10:23:59.140 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.138+0000 7feeefe00640 1 -- 172.21.15.194:0/1560480052 learned_addr learned my addr 172.21.15.194:0/1560480052 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.139+0000 7feefce00640 1 --2- 172.21.15.194:0/1560480052 >> v2:172.21.15.196:3300/0 conn(0x7feef81569b0 0x7feef806b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.139+0000 7feeefe00640 1 -- 172.21.15.194:0/1560480052 >> v2:172.21.15.196:3300/0 conn(0x7feef81569b0 msgr2=0x7feef806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.139+0000 7feeefe00640 1 --2- 172.21.15.194:0/1560480052 >> v2:172.21.15.196:3300/0 conn(0x7feef81569b0 0x7feef806b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.139+0000 7feeefe00640 1 -- 172.21.15.194:0/1560480052 >> v1:172.21.15.196:6789/0 conn(0x7feef8150c70 legacy=0x7feef8153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:23:59.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.139+0000 7feeefe00640 1 -- 172.21.15.194:0/1560480052 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef806fad0 con 0x7feef806eb60 2024-03-07T10:23:59.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.140+0000 7feeefe00640 1 --2- 172.21.15.194:0/1560480052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c34a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feef806c0c0 tx=0x7feee002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f37e7d921ceb9a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:59.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.140+0000 7feef7400640 1 -- 172.21.15.194:0/1560480052 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002e070 con 0x7feef806eb60 2024-03-07T10:23:59.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.140+0000 7feef7400640 1 -- 172.21.15.194:0/1560480052 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee0037070 con 0x7feef806eb60 2024-03-07T10:23:59.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.140+0000 7feef7400640 1 -- 172.21.15.194:0/1560480052 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee0031a00 con 0x7feef806eb60 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 -- 172.21.15.194:0/1560480052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 msgr2=0x7feef80c34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 --2- 172.21.15.194:0/1560480052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c34a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7feef806c0c0 tx=0x7feee002b880 comp rx=0 tx=0).stop 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 -- 172.21.15.194:0/1560480052 shutdown_connections 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 --2- 172.21.15.194:0/1560480052 >> v2:172.21.15.196:3300/0 conn(0x7feef81569b0 0x7feef806b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 --2- 172.21.15.194:0/1560480052 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c34a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 -- 172.21.15.194:0/1560480052 >> 172.21.15.194:0/1560480052 conn(0x7feef80c7e80 msgr2=0x7feef80c8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:59.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 -- 172.21.15.194:0/1560480052 shutdown_connections 2024-03-07T10:23:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.141+0000 7feefd800640 1 -- 172.21.15.194:0/1560480052 wait complete. 2024-03-07T10:23:59.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.143+0000 7feefd800640 1 Processor -- start 2024-03-07T10:23:59.145 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.144+0000 7feefd800640 1 -- start start 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feef81569b0 0x7feef81e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feef8149b40 0x7feef81e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8153680 con 0x7feef806eb60 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef8070090 con 0x7feef8149b40 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feefd800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef806b5c0 con 0x7feef81569b0 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feef7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feef7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58056/0 (socket says 172.21.15.194:58056) 2024-03-07T10:23:59.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.145+0000 7feef7e00640 1 -- 172.21.15.194:0/4062840838 learned_addr learned my addr 172.21.15.194:0/4062840838 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:23:59.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 -- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feef81569b0 msgr2=0x7feef81e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:59.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feef81569b0 0x7feef81e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 -- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feef8149b40 msgr2=0x7feef81e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feef8149b40 0x7feef81e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 -- 172.21.15.194:0/4062840838 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef81e9990 con 0x7feef806eb60 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef7e00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feee800c440 tx=0x7feee800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8017070 con 0x7feef806eb60 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80035f0 con 0x7feef806eb60 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8149860 con 0x7feef806eb60 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80039e0 con 0x7feef806eb60 2024-03-07T10:23:59.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.146+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8155970 con 0x7feef806eb60 2024-03-07T10:23:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.148+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef8068880 con 0x7feef806eb60 2024-03-07T10:23:59.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.148+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7feee801a070 con 0x7feef806eb60 2024-03-07T10:23:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.149+0000 7feef4c00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 0x7feed406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:23:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.149+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7feee8089a10 con 0x7feef806eb60 2024-03-07T10:23:59.151 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.150+0000 7feeefe00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 0x7feed406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:23:59.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.151+0000 7feeefe00640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 0x7feed406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feee0036000 tx=0x7feee0030000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:23:59.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.154+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7feee80583e0 con 0x7feef806eb60 2024-03-07T10:23:59.409 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.408+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feef806be10 con 0x7feef806eb60 2024-03-07T10:23:59.410 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.409+0000 7feef4c00640 1 -- 172.21.15.194:0/4062840838 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+5465 (secure 0 0 0) 0x7feee8087e20 con 0x7feef806eb60 2024-03-07T10:23:59.410 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:23:59.410 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:23:58.043827+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":3,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-03-07T10:23:59.411 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 27 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.412+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 msgr2=0x7feed406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.412+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 0x7feed406d990 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7feee0036000 tx=0x7feee0030000 comp rx=0 tx=0).stop 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.412+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 msgr2=0x7feef80c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.412+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7feee800c440 tx=0x7feee800c900 comp rx=0 tx=0).stop 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.412+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 shutdown_connections 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7feed406b4d0 0x7feed406d990 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.414 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7feef8149b40 0x7feef81e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7feef81569b0 0x7feef81e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 --2- 172.21.15.194:0/4062840838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feef806eb60 0x7feef80c6f40 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:23:59.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 >> 172.21.15.194:0/4062840838 conn(0x7feef80c7e80 msgr2=0x7feef8061aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:23:59.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 shutdown_connections 2024-03-07T10:23:59.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:23:59.413+0000 7feefd800640 1 -- 172.21.15.194:0/4062840838 wait complete. 2024-03-07T10:23:59.434 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:20:57.593298+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 24, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4882": { "addr": "172.21.15.194:6835/3339340096", "addrs": { "addrvec": [ { "addr": "172.21.15.194:6834", "nonce": 3339340096, "type": "v2" }, { "addr": "172.21.15.194:6835", "nonce": 3339340096, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4882, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-03-07T10:23:41.019647+0000", "qdb_cluster": [ 4882 ], "qdb_leader": 4882, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4882 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-03-07T10:21:08.712900+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4733": { "addr": "172.21.15.196:6835/3343805854", "addrs": { "addrvec": [ { "addr": "172.21.15.196:6834", "nonce": 3343805854, "type": "v2" }, { "addr": "172.21.15.196:6835", "nonce": 3343805854, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4733, "incarnation": 26, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:reconnect", "state_seq": 3 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-03-07T10:23:58.043827+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4733 } } } ], "standbys": [ { "addr": "172.21.15.196:6837/1953632658", "addrs": { "addrvec": [ { "addr": "172.21.15.196:6836", "nonce": 1953632658, "type": "v2" }, { "addr": "172.21.15.196:6837", "nonce": 1953632658, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 3, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4250, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-03-07T10:24:01.050 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-07T10:24:01.050 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-03-07T10:24:01.064 INFO:tasks.mds_thrash:joining mds_thrasher 2024-03-07T10:24:01.435 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:24:01.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.647+0000 7f6c2dc00640 1 Processor -- start 2024-03-07T10:24:01.648 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.647+0000 7f6c2dc00640 1 -- start start 2024-03-07T10:24:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.648+0000 7f6c2dc00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f6c280ad8e0 0x7f6c280adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.648+0000 7f6c2dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c28155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.648+0000 7f6c2dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280c2180 con 0x7f6c280c2f70 2024-03-07T10:24:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c2dc00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c280c39f0 con 0x7f6c280ad8e0 2024-03-07T10:24:01.650 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c2dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c3cd0 con 0x7f6c28159a40 2024-03-07T10:24:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c27400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6c280c2f70 0x7f6c2806b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38046/0 (socket says 172.21.15.194:38046) 2024-03-07T10:24:01.651 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c27400640 1 -- 172.21.15.194:0/3564183096 learned_addr learned my addr 172.21.15.194:0/3564183096 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c26a00640 1 --2- 172.21.15.194:0/3564183096 >> v2:172.21.15.196:3300/0 conn(0x7f6c280ad8e0 0x7f6c280adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c1fe00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c28155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892825013 0 0) 0x7f6c280c2180 con 0x7f6c280c2f70 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.649+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c0c003520 con 0x7f6c280c2f70 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 623555939 0 0) 0x7f6c0c003520 con 0x7f6c280c2f70 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 msgr2=0x7f6c28155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c28155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 >> v2:172.21.15.196:3300/0 conn(0x7f6c280ad8e0 msgr2=0x7f6c280adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 --2- 172.21.15.194:0/3564183096 >> v2:172.21.15.196:3300/0 conn(0x7f6c280ad8e0 0x7f6c280adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280c1ea0 con 0x7f6c280c2f70 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f6c200019f0 con 0x7f6c280c2f70 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 >> v1:172.21.15.194:6789/0 conn(0x7f6c280c2f70 legacy=0x7f6c2806b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c0c004d40 0x7f6c0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c39f0 con 0x7f6c0c0039b0 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c3cd0 con 0x7f6c0c004d40 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c00b9f0 con 0x7f6c28159a40 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.650+0000 7f6c26a00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c1fe00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c27400640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c0c004d40 0x7f6c0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c26a00640 1 -- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 msgr2=0x7f6c0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c26a00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28159a40 0x7f6c0c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c26a00640 1 -- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c0c004d40 msgr2=0x7f6c0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c26a00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c0c004d40 0x7f6c0c0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.654 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.651+0000 7f6c26a00640 1 -- 172.21.15.194:0/3564183096 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c003520 con 0x7f6c0c0039b0 2024-03-07T10:24:01.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.652+0000 7f6c26a00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c0c003dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009ac0 tx=0x7f6c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae8badb5ee7c6fc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:01.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.652+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18039070 con 0x7f6c0c0039b0 2024-03-07T10:24:01.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.652+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1802c710 con 0x7f6c0c0039b0 2024-03-07T10:24:01.656 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.652+0000 7f6c26000640 1 -- 172.21.15.194:0/3564183096 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18009690 con 0x7f6c0c0039b0 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 -- 172.21.15.194:0/3564183096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 msgr2=0x7f6c0c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/3564183096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c0c003dd0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009ac0 tx=0x7f6c0c005830 comp rx=0 tx=0).stop 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c27400640 1 -- 172.21.15.194:0/3564183096 reap_dead start 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 -- 172.21.15.194:0/3564183096 shutdown_connections 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 -- 172.21.15.194:0/3564183096 >> 172.21.15.194:0/3564183096 conn(0x7f6c280c4b40 msgr2=0x7f6c280c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 -- 172.21.15.194:0/3564183096 shutdown_connections 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.653+0000 7f6c2dc00640 1 -- 172.21.15.194:0/3564183096 wait complete. 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.655+0000 7f6c2dc00640 1 Processor -- start 2024-03-07T10:24:01.657 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.655+0000 7f6c2dc00640 1 -- start start 2024-03-07T10:24:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c281495d0 0x7f6c28149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 0x7f6c281535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.658 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c28153050 con 0x7f6c0c0039b0 2024-03-07T10:24:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c4340 con 0x7f6c281495d0 2024-03-07T10:24:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c2dc00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c281531d0 con 0x7f6c28149f90 2024-03-07T10:24:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58074/0 (socket says 172.21.15.194:58074) 2024-03-07T10:24:01.659 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 -- 172.21.15.194:0/603638784 learned_addr learned my addr 172.21.15.194:0/603638784 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c27400640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 0x7f6c281535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c1fe00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c281495d0 0x7f6c28149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 -- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 msgr2=0x7f6c281535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 0x7f6c281535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 -- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c281495d0 msgr2=0x7f6c28149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.660 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c281495d0 0x7f6c28149a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c26a00640 1 -- 172.21.15.194:0/603638784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2814b8a0 con 0x7f6c0c0039b0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.657+0000 7f6c27400640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 0x7f6c281535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c26a00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18039050 con 0x7f6c0c0039b0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18045070 con 0x7f6c0c0039b0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180044e0 con 0x7f6c0c0039b0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c281ee770 con 0x7f6c0c0039b0 2024-03-07T10:24:01.661 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.658+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c281eed30 con 0x7f6c0c0039b0 2024-03-07T10:24:01.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.660+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c28068170 con 0x7f6c0c0039b0 2024-03-07T10:24:01.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.660+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6c18003a50 con 0x7f6c0c0039b0 2024-03-07T10:24:01.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.661+0000 7f6c1ea00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 0x7f6c0406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:01.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.661+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f6c180ac160 con 0x7f6c0c0039b0 2024-03-07T10:24:01.663 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.662+0000 7f6c1fe00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 0x7f6c0406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:01.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.663+0000 7f6c1fe00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 0x7f6c0406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ade30 tx=0x7f6c10008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:01.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.665+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6c1804e020 con 0x7f6c0c0039b0 2024-03-07T10:24:01.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.899+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c28156700 con 0x7f6c0c0039b0 2024-03-07T10:24:01.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.900+0000 7f6c1ea00640 1 -- 172.21.15.194:0/603638784 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+5469 (secure 0 0 0) 0x7f6c1807abd0 con 0x7f6c0c0039b0 2024-03-07T10:24:01.901 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:01.902 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:24:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 29 2024-03-07T10:24:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 msgr2=0x7f6c0406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 0x7f6c0406d990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ade30 tx=0x7f6c10008040 comp rx=0 tx=0).stop 2024-03-07T10:24:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 msgr2=0x7f6c28158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6c18000c00 tx=0x7f6c18004730 comp rx=0 tx=0).stop 2024-03-07T10:24:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 shutdown_connections 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f6c0406b4d0 0x7f6c0406d990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f6c28149f90 0x7f6c281535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f6c281495d0 0x7f6c28149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 --2- 172.21.15.194:0/603638784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c0c0039b0 0x7f6c28158300 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.902+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 >> 172.21.15.194:0/603638784 conn(0x7f6c280c4b40 msgr2=0x7f6c28150ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.903+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 shutdown_connections 2024-03-07T10:24:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:01.903+0000 7f6c2dc00640 1 -- 172.21.15.194:0/603638784 wait complete. 2024-03-07T10:24:01.922 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=4251 2024-03-07T10:24:01.922 INFO:tasks.mds_thrash.fs.[b]:waiting for 0 secs before reviving mds.a 2024-03-07T10:24:01.922 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-03-07T10:24:01.922 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-07T10:24:01.922 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-07T10:24:01.926 INFO:tasks.ceph.mds.a:Started 2024-03-07T10:24:01.927 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:24:02.093 INFO:tasks.ceph.mds.a.smithi194.stdout:starting mds.a at 2024-03-07T10:24:02.107 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.106+0000 7f19d1600640 1 Processor -- start 2024-03-07T10:24:02.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.106+0000 7f19d1600640 1 -- start start 2024-03-07T10:24:02.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.108+0000 7f19d1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19cc0c9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.108+0000 7f19d1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc156390 con 0x7f19cc1558a0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.108+0000 7f19d1600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc156600 con 0x7f19cc0c9670 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.108+0000 7f19d1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c7190 con 0x7f19cc0c5da0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19caa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f19cc1558a0 0x7f19cc155c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38068/0 (socket says 172.21.15.194:38068) 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19caa00640 1 -- 172.21.15.194:0/929477541 learned_addr learned my addr 172.21.15.194:0/929477541 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19c3e00640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19cc0c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225817972 0 0) 0x7f19cc156390 con 0x7f19cc1558a0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b0003520 con 0x7f19cc1558a0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589684116 0 0) 0x7f19b0003520 con 0x7f19cc1558a0 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 msgr2=0x7f19cc0c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19cc0c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 >> v1:172.21.15.196:6789/0 conn(0x7f19cc0c9670 legacy=0x7f19cc160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0c9ca0 con 0x7f19cc1558a0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f19bc001670 con 0x7f19cc1558a0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 >> v1:172.21.15.194:6789/0 conn(0x7f19cc1558a0 legacy=0x7f19cc155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19b00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19b0003f60 0x7f19b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19b0004d40 0x7f19b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.109+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c7190 con 0x7f19b0004d40 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b000baa0 con 0x7f19b0003f60 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b000bca0 con 0x7f19cc0c5da0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19b0004d40 0x7f19b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19caa00640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19b00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19c3e00640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19b0003f60 0x7f19b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 -- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 msgr2=0x7f19b00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19b00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 -- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19b0003f60 msgr2=0x7f19b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19b0003f60 0x7f19b0004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19cb400640 1 -- 172.21.15.194:0/929477541 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b0003520 con 0x7f19b0004d40 2024-03-07T10:24:02.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.110+0000 7f19caa00640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19cc0c5da0 0x7f19b00039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:02.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.111+0000 7f19cb400640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19b0004d40 0x7f19b00051c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f19c4001e50 tx=0x7f19b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1b01cf07bdcd11 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.111+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4001a70 con 0x7f19b0004d40 2024-03-07T10:24:02.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.111+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4003b70 con 0x7f19b0004d40 2024-03-07T10:24:02.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.111+0000 7f19ca000640 1 -- 172.21.15.194:0/929477541 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c40050d0 con 0x7f19b0004d40 2024-03-07T10:24:02.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 -- 172.21.15.194:0/929477541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19b0004d40 msgr2=0x7f19b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 --2- 172.21.15.194:0/929477541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19b0004d40 0x7f19b00051c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f19c4001e50 tx=0x7f19b0005830 comp rx=0 tx=0).stop 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19cb400640 1 -- 172.21.15.194:0/929477541 reap_dead start 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 -- 172.21.15.194:0/929477541 shutdown_connections 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 -- 172.21.15.194:0/929477541 >> 172.21.15.194:0/929477541 conn(0x7f19cc0cb010 msgr2=0x7f19cc0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 -- 172.21.15.194:0/929477541 shutdown_connections 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.112+0000 7f19d1600640 1 -- 172.21.15.194:0/929477541 wait complete. 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.114+0000 7f19d1600640 1 Processor -- start 2024-03-07T10:24:02.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.114+0000 7f19d1600640 1 -- start start 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19b0004d40 0x7f19cc155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19cc1536a0 0x7f19cc154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0cad20 con 0x7f19cc148430 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c9f80 con 0x7f19cc1536a0 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19d1600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0c77c0 con 0x7f19b0004d40 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58096/0 (socket says 172.21.15.194:58096) 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 -- 172.21.15.194:0/4209757539 learned_addr learned my addr 172.21.15.194:0/4209757539 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19c3e00640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19cc1536a0 0x7f19cc154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.118 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19caa00640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19b0004d40 0x7f19cc155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 -- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19b0004d40 msgr2=0x7f19cc155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19b0004d40 0x7f19cc155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 -- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19cc1536a0 msgr2=0x7f19cc154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19cc1536a0 0x7f19cc154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.115+0000 7f19cb400640 1 -- 172.21.15.194:0/4209757539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc0ab530 con 0x7f19cc148430 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19cb400640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19c402c060 tx=0x7f19c40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4007db0 con 0x7f19cc148430 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4003970 con 0x7f19cc148430 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4006d90 con 0x7f19cc148430 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc0ab7d0 con 0x7f19cc148430 2024-03-07T10:24:02.119 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.116+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc0abd90 con 0x7f19cc148430 2024-03-07T10:24:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.117+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc0abf90 con 0x7f19cc148430 2024-03-07T10:24:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.118+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f19c4007030 con 0x7f19cc148430 2024-03-07T10:24:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.119+0000 7f19c2a00640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 0x7f19a806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.119+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f19c40ab820 con 0x7f19cc148430 2024-03-07T10:24:02.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.119+0000 7f19caa00640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 0x7f19a806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.120+0000 7f19caa00640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 0x7f19a806d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19bc001200 tx=0x7f19bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.123+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f19cc0abf90 con 0x7f19cc148430 2024-03-07T10:24:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.374+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19cc068170 con 0x7f19cc148430 2024-03-07T10:24:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.375+0000 7f19c2a00640 1 -- 172.21.15.194:0/4209757539 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6263 (secure 0 0 0) 0x7f19c4033020 con 0x7f19cc148430 2024-03-07T10:24:02.377 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:02.377 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4277918804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4277918804},{"type":"v1","addr":"172.21.15.194:6833","nonce":4277918804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:24:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 30 2024-03-07T10:24:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 msgr2=0x7f19a806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 0x7f19a806d990 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19bc001200 tx=0x7f19bc009040 comp rx=0 tx=0).stop 2024-03-07T10:24:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 msgr2=0x7f19cc1488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f19c402c060 tx=0x7f19c40014a0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 shutdown_connections 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f19a806b4d0 0x7f19a806d990 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19cc148430 0x7f19cc1488c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f19cc1536a0 0x7f19cc154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 --2- 172.21.15.194:0/4209757539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f19b0004d40 0x7f19cc155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.377+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 >> 172.21.15.194:0/4209757539 conn(0x7f19cc0cb010 msgr2=0x7f19cc14dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.378+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 shutdown_connections 2024-03-07T10:24:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.378+0000 7f19d1600640 1 -- 172.21.15.194:0/4209757539 wait complete. 2024-03-07T10:24:02.397 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-03-07T10:24:02.397 INFO:tasks.mds_thrash.fs.[b]:stat['max_mds'] = 0 2024-03-07T10:24:02.398 INFO:tasks.mds_thrash.fs.[b]:stat['deactivate'] = 0 2024-03-07T10:24:02.398 INFO:tasks.mds_thrash.fs.[b]:stat['kill'] = 2 2024-03-07T10:24:02.398 INFO:tasks.mds_thrash:done joining 2024-03-07T10:24:02.398 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-07T10:24:02.410 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-07T10:24:02.411 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:24:02.411 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:24:02.455 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:24:02.455 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:24:02.550 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:24:02.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.757+0000 7fccdb200640 1 Processor -- start 2024-03-07T10:24:02.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.757+0000 7fccdb200640 1 -- start start 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.758+0000 7fccdb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccdc0a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.758+0000 7fccdb200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fccdc0733a0 0x7fccdc152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.758+0000 7fccdb200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccdc0a6310 con 0x7fccdc0c16d0 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.758+0000 7fccdb200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccdc152440 con 0x7fccdc0733a0 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.758+0000 7fccdb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc152720 con 0x7fccdc06e930 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccda800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fccdc0c16d0 0x7fccdc0c3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38074/0 (socket says 172.21.15.194:38074) 2024-03-07T10:24:02.760 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccda800640 1 -- 172.21.15.194:0/945458491 learned_addr learned my addr 172.21.15.194:0/945458491 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccd9e00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccdc0a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccd9400640 1 --2- 172.21.15.194:0/945458491 >> v2:172.21.15.196:3300/0 conn(0x7fccdc0733a0 0x7fccdc152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975856851 0 0) 0x7fccdc0a6310 con 0x7fccdc0c16d0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.759+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccbc005730 con 0x7fccdc0c16d0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540991444 0 0) 0x7fccbc005730 con 0x7fccdc0c16d0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 msgr2=0x7fccdc0a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccdc0a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 >> v2:172.21.15.196:3300/0 conn(0x7fccdc0733a0 msgr2=0x7fccdc152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 --2- 172.21.15.194:0/945458491 >> v2:172.21.15.196:3300/0 conn(0x7fccdc0733a0 0x7fccdc152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc152a00 con 0x7fccdc0c16d0 2024-03-07T10:24:02.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fccd4001670 con 0x7fccdc0c16d0 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 >> v1:172.21.15.194:6789/0 conn(0x7fccdc0c16d0 legacy=0x7fccdc0c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccbc005bc0 0x7fccbc005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccbc006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc006f50 0x7fccbc0073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc152440 con 0x7fccbc006f50 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc152720 con 0x7fccbc005bc0 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc00dbd0 con 0x7fccdc06e930 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccda800640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc006f50 0x7fccbc0073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd9400640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccbc006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.760+0000 7fccd9e00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccbc005bc0 0x7fccbc005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccda800640 1 -- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 msgr2=0x7fccbc006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccda800640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc06e930 0x7fccbc006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccda800640 1 -- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccbc005bc0 msgr2=0x7fccbc005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:02.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccda800640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccbc005bc0 0x7fccbc005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccda800640 1 -- 172.21.15.194:0/945458491 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc005730 con 0x7fccbc006f50 2024-03-07T10:24:02.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.761+0000 7fccd9e00640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccbc005bc0 0x7fccbc005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:02.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccda800640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc006f50 0x7fccbc0073d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c240 tx=0x7fccbc007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417bf8e95e36781e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd4007d30 con 0x7fccbc006f50 2024-03-07T10:24:02.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd4030070 con 0x7fccbc006f50 2024-03-07T10:24:02.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccd8a00640 1 -- 172.21.15.194:0/945458491 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd402cd60 con 0x7fccbc006f50 2024-03-07T10:24:02.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccdb200640 1 -- 172.21.15.194:0/945458491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc006f50 msgr2=0x7fccbc0073d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccdb200640 1 --2- 172.21.15.194:0/945458491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccbc006f50 0x7fccbc0073d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fccd400c240 tx=0x7fccbc007a40 comp rx=0 tx=0).stop 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccda800640 1 -- 172.21.15.194:0/945458491 reap_dead start 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccdb200640 1 -- 172.21.15.194:0/945458491 shutdown_connections 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.762+0000 7fccdb200640 1 -- 172.21.15.194:0/945458491 >> 172.21.15.194:0/945458491 conn(0x7fccdc0c70f0 msgr2=0x7fccdc0c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.763+0000 7fccdb200640 1 -- 172.21.15.194:0/945458491 shutdown_connections 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.763+0000 7fccdb200640 1 -- 172.21.15.194:0/945458491 wait complete. 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.764+0000 7fccdb200640 1 Processor -- start 2024-03-07T10:24:02.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.764+0000 7fccdb200640 1 -- start start 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccdc0a5de0 0x7fccdc1ea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc0ac5c0 0x7fccdc0aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c12e0 con 0x7fccdc14ba80 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0a65f0 con 0x7fccdc0a5de0 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.765+0000 7fccdb200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccdc0c4300 con 0x7fccdc0ac5c0 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58100/0 (socket says 172.21.15.194:58100) 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 -- 172.21.15.194:0/3278155001 learned_addr learned my addr 172.21.15.194:0/3278155001 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9400640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccdc0a5de0 0x7fccdc1ea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 -- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc0ac5c0 msgr2=0x7fccdc0aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccda800640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc0ac5c0 0x7fccdc0aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc0ac5c0 0x7fccdc0aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 -- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccdc0a5de0 msgr2=0x7fccdc1ea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccdc0a5de0 0x7fccdc1ea6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 -- 172.21.15.194:0/3278155001 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccdc14c4c0 con 0x7fccdc14ba80 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd9e00640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0108e0 tx=0x7fcccc010da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.766+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00f040 con 0x7fccdc14ba80 2024-03-07T10:24:02.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.767+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc00ec20 con 0x7fccdc14ba80 2024-03-07T10:24:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.767+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccdc1e7d70 con 0x7fccdc14ba80 2024-03-07T10:24:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.767+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc01c400 con 0x7fccdc14ba80 2024-03-07T10:24:02.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.767+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccdc1e4c90 con 0x7fccdc14ba80 2024-03-07T10:24:02.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.768+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccdc14c690 con 0x7fccdc14ba80 2024-03-07T10:24:02.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.769+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcccc01c5a0 con 0x7fccdc14ba80 2024-03-07T10:24:02.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.770+0000 7fccd2000640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 0x7fccb806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:02.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.770+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fcccc08ae20 con 0x7fccdc14ba80 2024-03-07T10:24:02.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.770+0000 7fccd9400640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 0x7fccb806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:02.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.772+0000 7fccd9400640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 0x7fccb806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fccdc14efc0 tx=0x7fccc400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:02.775 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.774+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fccdc14c690 con 0x7fccdc14ba80 2024-03-07T10:24:02.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.969+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccdc1e7b60 con 0x7fccdc14ba80 2024-03-07T10:24:02.972 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.971+0000 7fccd2000640 1 -- 172.21.15.194:0/3278155001 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21036 (secure 0 0 0) 0x7fcccc018030 con 0x7fccdc14ba80 2024-03-07T10:24:02.973 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:02.973 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":29,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:23:58.005671+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.196:6835/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6832/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.196:6834/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6835/1436303034":"2024-03-08T10:22:52.989185+0000","172.21.15.194:6833/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.194:6834/1436303034":"2024-03-08T10:22:52.989185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:24:02.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 msgr2=0x7fccb806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 0x7fccb806d990 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fccdc14efc0 tx=0x7fccc400b040 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 msgr2=0x7fccdc14d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0108e0 tx=0x7fcccc010da0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 shutdown_connections 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fccb806b4d0 0x7fccb806d990 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccdc0ac5c0 0x7fccdc0aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccdc0a5de0 0x7fccdc1ea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 --2- 172.21.15.194:0/3278155001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccdc14ba80 0x7fccdc14d0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 >> 172.21.15.194:0/3278155001 conn(0x7fccdc0c70f0 msgr2=0x7fccdc0c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 shutdown_connections 2024-03-07T10:24:02.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:02.974+0000 7fccdb200640 1 -- 172.21.15.194:0/3278155001 wait complete. 2024-03-07T10:24:02.998 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:24:02.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:24:03.109 INFO:tasks.ceph.mds.b.smithi196.stderr:2024-03-07T10:24:03.107+0000 7fec16400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:24:03.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.212+0000 7fd761600640 1 Processor -- start 2024-03-07T10:24:03.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.212+0000 7fd761600640 1 -- start start 2024-03-07T10:24:03.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.213+0000 7fd761600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd75c150aa0 0x7fd75c0a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.213+0000 7fd761600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd75c1576c0 0x7fd75c0a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.213+0000 7fd761600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75c0c3a70 con 0x7fd75c0a8620 2024-03-07T10:24:03.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.213+0000 7fd761600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c0a6270 con 0x7fd75c150aa0 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.213+0000 7fd761600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd75c0c3d50 con 0x7fd75c1576c0 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd75c150aa0 0x7fd75c0a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75b400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fd75c0a8620 0x7fd75c156fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38086/0 (socket says 172.21.15.194:38086) 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75b400640 1 -- 172.21.15.194:0/2877692919 learned_addr learned my addr 172.21.15.194:0/2877692919 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd760c00640 1 --2- 172.21.15.194:0/2877692919 >> v2:172.21.15.196:3300/0 conn(0x7fd75c1576c0 0x7fd75c0a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75be00640 1 -- 172.21.15.194:0/2877692919 >> v2:172.21.15.196:3300/0 conn(0x7fd75c1576c0 msgr2=0x7fd75c0a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75be00640 1 --2- 172.21.15.194:0/2877692919 >> v2:172.21.15.196:3300/0 conn(0x7fd75c1576c0 0x7fd75c0a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75be00640 1 -- 172.21.15.194:0/2877692919 >> v1:172.21.15.194:6789/0 conn(0x7fd75c0a8620 legacy=0x7fd75c156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.214+0000 7fd75be00640 1 -- 172.21.15.194:0/2877692919 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0c4030 con 0x7fd75c150aa0 2024-03-07T10:24:03.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.215+0000 7fd75be00640 1 --2- 172.21.15.194:0/2877692919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c150aa0 0x7fd75c0a5d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd75c154620 tx=0x7fd74c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e5dccb526df224d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.216+0000 7fd75aa00640 1 -- 172.21.15.194:0/2877692919 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c0315a0 con 0x7fd75c150aa0 2024-03-07T10:24:03.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.216+0000 7fd75aa00640 1 -- 172.21.15.194:0/2877692919 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c037070 con 0x7fd75c150aa0 2024-03-07T10:24:03.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.216+0000 7fd75aa00640 1 -- 172.21.15.194:0/2877692919 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c031960 con 0x7fd75c150aa0 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 -- 172.21.15.194:0/2877692919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c150aa0 msgr2=0x7fd75c0a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 --2- 172.21.15.194:0/2877692919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c150aa0 0x7fd75c0a5d30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd75c154620 tx=0x7fd74c02b840 comp rx=0 tx=0).stop 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 -- 172.21.15.194:0/2877692919 shutdown_connections 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 --2- 172.21.15.194:0/2877692919 >> v2:172.21.15.196:3300/0 conn(0x7fd75c1576c0 0x7fd75c0a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 --2- 172.21.15.194:0/2877692919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c150aa0 0x7fd75c0a5d30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 -- 172.21.15.194:0/2877692919 >> 172.21.15.194:0/2877692919 conn(0x7fd75c06cd60 msgr2=0x7fd75c06b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 -- 172.21.15.194:0/2877692919 shutdown_connections 2024-03-07T10:24:03.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.217+0000 7fd761600640 1 -- 172.21.15.194:0/2877692919 wait complete. 2024-03-07T10:24:03.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.219+0000 7fd761600640 1 Processor -- start 2024-03-07T10:24:03.221 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.219+0000 7fd761600640 1 -- start start 2024-03-07T10:24:03.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.220+0000 7fd761600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd761600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd75c150aa0 0x7fd75c149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd761600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd75c1576c0 0x7fd75c14a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.224 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd761600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c150e80 con 0x7fd75c0a8620 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd761600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c156a90 con 0x7fd75c150aa0 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd761600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75c151000 con 0x7fd75c1576c0 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58116/0 (socket says 172.21.15.194:58116) 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 -- 172.21.15.194:0/465873747 learned_addr learned my addr 172.21.15.194:0/465873747 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75b400640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd75c150aa0 0x7fd75c149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 -- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd75c1576c0 msgr2=0x7fd75c14a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd75c1576c0 0x7fd75c14a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 -- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd75c150aa0 msgr2=0x7fd75c149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd75c150aa0 0x7fd75c149d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.221+0000 7fd75be00640 1 -- 172.21.15.194:0/465873747 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd75c0a73b0 con 0x7fd75c0a8620 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd75be00640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd74c000c00 tx=0x7fd74c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032840 con 0x7fd75c0a8620 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c032a00 con 0x7fd75c0a8620 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75c0a7070 con 0x7fd75c0a8620 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c032df0 con 0x7fd75c0a8620 2024-03-07T10:24:03.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.222+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75c0a7930 con 0x7fd75c0a8620 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.223+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75c075600 con 0x7fd75c0a8620 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.224+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd74c04d3f0 con 0x7fd75c0a8620 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.225+0000 7fd753e00640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.225+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fd74c02f030 con 0x7fd75c0a8620 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.225+0000 7fd75b400640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.227+0000 7fd75b400640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 0x7fd73c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0a6c40 tx=0x7fd748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.231 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.230+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd74c040070 con 0x7fd75c0a8620 2024-03-07T10:24:03.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.428+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd75c14cd40 con 0x7fd75c0a8620 2024-03-07T10:24:03.430 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.428+0000 7fd753e00640 1 -- 172.21.15.194:0/465873747 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd74c07ac70 con 0x7fd75c0a8620 2024-03-07T10:24:03.430 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:24:03.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.431+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 msgr2=0x7fd73c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.431+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 0x7fd73c06d990 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd75c0a6c40 tx=0x7fd748009040 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.431+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 msgr2=0x7fd75c14c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.431+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd74c000c00 tx=0x7fd74c0046c0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 shutdown_connections 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd73c06b4d0 0x7fd73c06d990 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd75c1576c0 0x7fd75c14a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd75c150aa0 0x7fd75c149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 --2- 172.21.15.194:0/465873747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd75c0a8620 0x7fd75c14c130 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 >> 172.21.15.194:0/465873747 conn(0x7fd75c06cd60 msgr2=0x7fd75c0c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 shutdown_connections 2024-03-07T10:24:03.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.432+0000 7fd761600640 1 -- 172.21.15.194:0/465873747 wait complete. 2024-03-07T10:24:03.453 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:24:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.665+0000 7f7bcec00640 1 Processor -- start 2024-03-07T10:24:03.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.665+0000 7f7bcec00640 1 -- start start 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.666+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bc8155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.666+0000 7f7bcec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8155b30 con 0x7f7bc80c8d90 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.666+0000 7f7bcec00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc8155e10 con 0x7f7bc814f7c0 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.666+0000 7f7bcec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81560f0 con 0x7f7bc8159730 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bcce00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7bc80c8d90 0x7f7bc8159020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38102/0 (socket says 172.21.15.194:38102) 2024-03-07T10:24:03.668 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bcce00640 1 -- 172.21.15.194:0/2060612992 learned_addr learned my addr 172.21.15.194:0/2060612992 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bce200640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bc8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 136621987 0 0) 0x7f7bc8155b30 con 0x7f7bc80c8d90 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb0003520 con 0x7f7bc80c8d90 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097405458 0 0) 0x7f7bb0003520 con 0x7f7bc80c8d90 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 msgr2=0x7f7bc8155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:03.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bc8155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 >> v1:172.21.15.196:6789/0 conn(0x7f7bc814f7c0 legacy=0x7f7bc80c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc81563d0 con 0x7f7bc80c8d90 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f7bb4001670 con 0x7f7bc80c8d90 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.667+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 >> v1:172.21.15.194:6789/0 conn(0x7f7bc80c8d90 legacy=0x7f7bc8159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bb00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bb0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bb0004d40 0x7f7bb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81560f0 con 0x7f7bb0003f60 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000bb50 con 0x7f7bb0004d40 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb000bd50 con 0x7f7bc8159730 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bb0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcd800640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bb00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bce200640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bb0004d40 0x7f7bb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 -- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 msgr2=0x7f7bb00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:03.671 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc8159730 0x7f7bb00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 -- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bb0004d40 msgr2=0x7f7bb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:03.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bb0004d40 0x7f7bb00051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.672 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.668+0000 7f7bcce00640 1 -- 172.21.15.194:0/2060612992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb0003520 con 0x7f7bb0003f60 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.669+0000 7f7bcce00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bb0004800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c210 tx=0x7f7bb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c168f0e09b9bd946 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4007d30 con 0x7f7bb0003f60 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb4030070 con 0x7f7bb0003f60 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bc7e00640 1 -- 172.21.15.194:0/2060612992 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb402cd60 con 0x7f7bb0003f60 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 -- 172.21.15.194:0/2060612992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 msgr2=0x7f7bb0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 --2- 172.21.15.194:0/2060612992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bb0004800 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c210 tx=0x7f7bb0005830 comp rx=0 tx=0).stop 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bce200640 1 -- 172.21.15.194:0/2060612992 reap_dead start 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 -- 172.21.15.194:0/2060612992 shutdown_connections 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 -- 172.21.15.194:0/2060612992 >> 172.21.15.194:0/2060612992 conn(0x7f7bc806b4a0 msgr2=0x7f7bc806b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:03.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 -- 172.21.15.194:0/2060612992 shutdown_connections 2024-03-07T10:24:03.674 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.670+0000 7f7bcec00640 1 -- 172.21.15.194:0/2060612992 wait complete. 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.672+0000 7f7bcec00640 1 Processor -- start 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.672+0000 7f7bcec00640 1 -- start start 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc80c1f60 0x7f7bc80c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc80c3d40 0x7f7bc814b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80c5f20 con 0x7f7bb0003f60 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc8072890 con 0x7f7bc80c1f60 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80c60a0 con 0x7f7bc80c3d40 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58124/0 (socket says 172.21.15.194:58124) 2024-03-07T10:24:03.675 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.673+0000 7f7bcd800640 1 -- 172.21.15.194:0/3066118922 learned_addr learned my addr 172.21.15.194:0/3066118922 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:03.676 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bce200640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc80c3d40 0x7f7bc814b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 -- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc80c3d40 msgr2=0x7f7bc814b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc80c3d40 0x7f7bc814b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 -- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc80c1f60 msgr2=0x7f7bc80c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcce00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc80c1f60 0x7f7bc80c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc80c1f60 0x7f7bc80c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 -- 172.21.15.194:0/3066118922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80c33e0 con 0x7f7bb0003f60 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcd800640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e580 tx=0x7f7bbc00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc0052e0 con 0x7f7bb0003f60 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc018070 con 0x7f7bb0003f60 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bbc003810 con 0x7f7bb0003f60 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.674+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc81504c0 con 0x7f7bb0003f60 2024-03-07T10:24:03.677 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.675+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc8150760 con 0x7f7bb0003f60 2024-03-07T10:24:03.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.676+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc8075600 con 0x7f7bb0003f60 2024-03-07T10:24:03.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.676+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7bbc0039b0 con 0x7f7bb0003f60 2024-03-07T10:24:03.678 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.677+0000 7f7bc5600640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:03.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.677+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f7bbc08a2c0 con 0x7f7bb0003f60 2024-03-07T10:24:03.679 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.678+0000 7f7bcce00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:03.680 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.679+0000 7f7bcce00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 0x7f7ba806d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c210 tx=0x7f7bb4009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:03.683 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.681+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7bbc058c10 con 0x7f7bb0003f60 2024-03-07T10:24:03.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.880+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7bc8072590 con 0x7f7bb0003f60 2024-03-07T10:24:03.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.881+0000 7f7bc5600640 1 -- 172.21.15.194:0/3066118922 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v29) v1 ==== 99+0+11 (secure 0 0 0) 0x7f7bbc058510 con 0x7f7bb0003f60 2024-03-07T10:24:03.882 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:24:03.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.883+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 msgr2=0x7f7ba806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.883+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 0x7f7ba806d9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c210 tx=0x7f7bb4009030 comp rx=0 tx=0).stop 2024-03-07T10:24:03.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.883+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 msgr2=0x7f7bc81ee3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:03.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.883+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc00e580 tx=0x7f7bbc00ea40 comp rx=0 tx=0).stop 2024-03-07T10:24:03.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 shutdown_connections 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ba806b500 0x7f7ba806d9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7bc80c3d40 0x7f7bc814b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7bc80c1f60 0x7f7bc80c3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 --2- 172.21.15.194:0/3066118922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bb0003f60 0x7f7bc81ee3a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 >> 172.21.15.194:0/3066118922 conn(0x7f7bc806b4a0 msgr2=0x7f7bc80ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 shutdown_connections 2024-03-07T10:24:03.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:03.884+0000 7f7bcec00640 1 -- 172.21.15.194:0/3066118922 wait complete. 2024-03-07T10:24:03.905 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:24:04.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.109+0000 7f2501800640 1 Processor -- start 2024-03-07T10:24:04.111 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.109+0000 7f2501800640 1 -- start start 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2501800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24fc152e60 0x7f24fc155650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2501800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc1592c0 0x7f24fc159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2501800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24fc155b90 con 0x7f24fc0ad420 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2501800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24fc0c8490 con 0x7f24fc152e60 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2501800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0c6910 con 0x7f24fc1592c0 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f24fbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24fc152e60 0x7f24fc155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f24fbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24fc152e60 0x7f24fc155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58136/0 (socket says 172.21.15.194:58136) 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f24fbe00640 1 -- 172.21.15.194:0/2177313931 learned_addr learned my addr 172.21.15.194:0/2177313931 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:04.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.111+0000 7f2500e00640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc1592c0 0x7f24fc159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.112+0000 7f24fbe00640 1 -- 172.21.15.194:0/2177313931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc1592c0 msgr2=0x7f24fc159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.112+0000 7f24fbe00640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc1592c0 0x7f24fc159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.112+0000 7f24fbe00640 1 -- 172.21.15.194:0/2177313931 >> v1:172.21.15.196:6789/0 conn(0x7f24fc0ad420 legacy=0x7f24fc0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.112+0000 7f24fbe00640 1 -- 172.21.15.194:0/2177313931 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc158dc0 con 0x7f24fc152e60 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.113+0000 7f24fbe00640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc152e60 0x7f24fc155650 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009870 tx=0x7f24ec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e49471d2093bc48 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.114 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.113+0000 7f24fb400640 1 -- 172.21.15.194:0/2177313931 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0317c0 con 0x7f24fc152e60 2024-03-07T10:24:04.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.113+0000 7f24fb400640 1 -- 172.21.15.194:0/2177313931 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec037070 con 0x7f24fc152e60 2024-03-07T10:24:04.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.113+0000 7f24fb400640 1 -- 172.21.15.194:0/2177313931 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec031b80 con 0x7f24fc152e60 2024-03-07T10:24:04.115 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 -- 172.21.15.194:0/2177313931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc152e60 msgr2=0x7f24fc155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc152e60 0x7f24fc155650 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009870 tx=0x7f24ec02b860 comp rx=0 tx=0).stop 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 -- 172.21.15.194:0/2177313931 shutdown_connections 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc1592c0 0x7f24fc159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 --2- 172.21.15.194:0/2177313931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc152e60 0x7f24fc155650 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 -- 172.21.15.194:0/2177313931 >> 172.21.15.194:0/2177313931 conn(0x7f24fc06b6b0 msgr2=0x7f24fc0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 -- 172.21.15.194:0/2177313931 shutdown_connections 2024-03-07T10:24:04.116 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.114+0000 7f2501800640 1 -- 172.21.15.194:0/2177313931 wait complete. 2024-03-07T10:24:04.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.116+0000 7f2501800640 1 Processor -- start 2024-03-07T10:24:04.117 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.116+0000 7f2501800640 1 -- start start 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 0x7f24fc1ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc152e60 0x7f24fc150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc1563f0 con 0x7f24fc1592c0 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc156110 con 0x7f24fc0ad420 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2501800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24fc0c5f70 con 0x7f24fc152e60 2024-03-07T10:24:04.120 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58152/0 (socket says 172.21.15.194:58152) 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 -- 172.21.15.194:0/1807706003 learned_addr learned my addr 172.21.15.194:0/1807706003 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f24fbe00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 0x7f24fc1ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 -- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc152e60 msgr2=0x7f24fc150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc152e60 0x7f24fc150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 -- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 msgr2=0x7f24fc1ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 0x7f24fc1ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.117+0000 7f2500e00640 1 -- 172.21.15.194:0/1807706003 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24fc1ec150 con 0x7f24fc1592c0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f24fbe00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 0x7f24fc1ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f2500e00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007e60 tx=0x7f24f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4014420 con 0x7f24fc1592c0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f4019070 con 0x7f24fc1592c0 2024-03-07T10:24:04.121 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24fc0abd20 con 0x7f24fc1592c0 2024-03-07T10:24:04.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f4014820 con 0x7f24fc1592c0 2024-03-07T10:24:04.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.118+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24fc0ac2e0 con 0x7f24fc1592c0 2024-03-07T10:24:04.122 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.119+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24fc075600 con 0x7f24fc1592c0 2024-03-07T10:24:04.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.120+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f24f40149c0 con 0x7f24fc1592c0 2024-03-07T10:24:04.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.121+0000 7f24f8c00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 0x7f24d806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.121+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f24f408ae40 con 0x7f24fc1592c0 2024-03-07T10:24:04.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.122+0000 7f24fbe00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 0x7f24d806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.124 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.123+0000 7f24fbe00640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 0x7f24d806d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24ec036000 tx=0x7f24ec008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.126+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f24fc1ec150 con 0x7f24fc1592c0 2024-03-07T10:24:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.347+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f24fc0b0e60 con 0x7f24fc1592c0 2024-03-07T10:24:04.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.348+0000 7f24f8c00640 1 -- 172.21.15.194:0/1807706003 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v29) v1 ==== 95+0+11 (secure 0 0 0) 0x7f24f40598b0 con 0x7f24fc1592c0 2024-03-07T10:24:04.352 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:24:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.350+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 msgr2=0x7f24d806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.350+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 0x7f24d806d9c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24ec036000 tx=0x7f24ec008030 comp rx=0 tx=0).stop 2024-03-07T10:24:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.350+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 msgr2=0x7f24fc1548f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.350+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f24f4007e60 tx=0x7f24f400e4b0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 shutdown_connections 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f24d806b500 0x7f24d806d9c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24fc1592c0 0x7f24fc1548f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f24fc152e60 0x7f24fc150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 --2- 172.21.15.194:0/1807706003 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f24fc0ad420 0x7f24fc1ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 >> 172.21.15.194:0/1807706003 conn(0x7f24fc06b6b0 msgr2=0x7f24fc0cb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 shutdown_connections 2024-03-07T10:24:04.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.351+0000 7f2501800640 1 -- 172.21.15.194:0/1807706003 wait complete. 2024-03-07T10:24:04.371 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:24:04.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.576+0000 7fbb14c00640 1 Processor -- start 2024-03-07T10:24:04.578 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.576+0000 7fbb14c00640 1 -- start start 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb14c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 0x7fbb100cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb14c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb14c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb10153180 con 0x7fbb10152da0 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb14c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb100c9620 con 0x7fbb100cb380 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb14c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10158f70 con 0x7fbb10155990 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb07e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 0x7fbb100cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb0e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb0e800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:38456/0 (socket says 172.21.15.194:38456) 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb0e800640 1 -- 172.21.15.194:0/813415993 learned_addr learned my addr 172.21.15.194:0/813415993 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:04.581 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.579+0000 7fbb07e00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 0x7fbb100cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:59208/0 (socket says 172.21.15.194:59208) 2024-03-07T10:24:04.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.580+0000 7fbb0e800640 1 -- 172.21.15.194:0/813415993 >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 msgr2=0x7fbb100cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:04.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.580+0000 7fbb0e800640 1 --2- 172.21.15.194:0/813415993 >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 0x7fbb100cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.580+0000 7fbb0e800640 1 -- 172.21.15.194:0/813415993 >> v1:172.21.15.196:6789/0 conn(0x7fbb10152da0 legacy=0x7fbb100c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.582 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.580+0000 7fbb0e800640 1 -- 172.21.15.194:0/813415993 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10159250 con 0x7fbb10155990 2024-03-07T10:24:04.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.581+0000 7fbb0e800640 1 --2- 172.21.15.194:0/813415993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb0802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d168f5b93e2fb17 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.582+0000 7fbb0d400640 1 -- 172.21.15.194:0/813415993 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0802cb00 con 0x7fbb10155990 2024-03-07T10:24:04.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.582+0000 7fbb0d400640 1 -- 172.21.15.194:0/813415993 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0802cca0 con 0x7fbb10155990 2024-03-07T10:24:04.583 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.582+0000 7fbb0d400640 1 -- 172.21.15.194:0/813415993 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08034610 con 0x7fbb10155990 2024-03-07T10:24:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 -- 172.21.15.194:0/813415993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 msgr2=0x7fbb10155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 --2- 172.21.15.194:0/813415993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009e50 tx=0x7fbb0802bf60 comp rx=0 tx=0).stop 2024-03-07T10:24:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 -- 172.21.15.194:0/813415993 shutdown_connections 2024-03-07T10:24:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 --2- 172.21.15.194:0/813415993 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10155990 0x7fbb10155e20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 --2- 172.21.15.194:0/813415993 >> v2:172.21.15.196:3300/0 conn(0x7fbb100cb380 0x7fbb100cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 -- 172.21.15.194:0/813415993 >> 172.21.15.194:0/813415993 conn(0x7fbb10066f70 msgr2=0x7fbb10067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:04.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 -- 172.21.15.194:0/813415993 shutdown_connections 2024-03-07T10:24:04.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.583+0000 7fbb14c00640 1 -- 172.21.15.194:0/813415993 wait complete. 2024-03-07T10:24:04.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.584+0000 7fbb14c00640 1 Processor -- start 2024-03-07T10:24:04.586 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.585+0000 7fbb14c00640 1 -- start start 2024-03-07T10:24:04.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.585+0000 7fbb14c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.585+0000 7fbb14c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10152da0 0x7fbb100c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.585+0000 7fbb14c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb10155990 0x7fbb10148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb14c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb100be8c0 con 0x7fbb100cb380 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb14c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10159810 con 0x7fbb10155990 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb14c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb10156360 con 0x7fbb10152da0 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58160/0 (socket says 172.21.15.194:58160) 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 -- 172.21.15.194:0/1436473273 learned_addr learned my addr 172.21.15.194:0/1436473273 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb07e00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10152da0 0x7fbb100c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0e800640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb10155990 0x7fbb10148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 -- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10152da0 msgr2=0x7fbb100c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10152da0 0x7fbb100c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 -- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb10155990 msgr2=0x7fbb10148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb10155990 0x7fbb10148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.586+0000 7fbb0de00640 1 -- 172.21.15.194:0/1436473273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb10149c20 con 0x7fbb100cb380 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb0de00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c450 tx=0x7fbb0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb000052d0 con 0x7fbb100cb380 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb00005470 con 0x7fbb100cb380 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00012870 con 0x7fbb100cb380 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb100c2330 con 0x7fbb100cb380 2024-03-07T10:24:04.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.587+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb100c28f0 con 0x7fbb100cb380 2024-03-07T10:24:04.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.588+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb100c20c0 con 0x7fbb100cb380 2024-03-07T10:24:04.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.589+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbb00012a10 con 0x7fbb100cb380 2024-03-07T10:24:04.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.590+0000 7fbb06000640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 0x7fbaec06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:04.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.590+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fbb0008a2a0 con 0x7fbb100cb380 2024-03-07T10:24:04.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.591+0000 7fbb07e00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 0x7fbaec06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:04.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.592+0000 7fbb07e00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 0x7fbaec06d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb1014cb60 tx=0x7fbaf8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:04.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.594+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbb00058c70 con 0x7fbb100cb380 2024-03-07T10:24:04.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.789+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb10068170 con 0x7fbb100cb380 2024-03-07T10:24:04.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.790+0000 7fbb06000640 1 -- 172.21.15.194:0/1436473273 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v29) v1 ==== 99+0+11 (secure 0 0 0) 0x7fbb00058570 con 0x7fbb100cb380 2024-03-07T10:24:04.792 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:24:04.794 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.792+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 msgr2=0x7fbaec06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.792+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 0x7fbaec06d9c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbb1014cb60 tx=0x7fbaf8008040 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.792+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 msgr2=0x7fbb101496e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.792+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000c450 tx=0x7fbb0000c910 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 shutdown_connections 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbaec06b500 0x7fbaec06d9c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbb10155990 0x7fbb10148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbb10152da0 0x7fbb100c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 --2- 172.21.15.194:0/1436473273 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb100cb380 0x7fbb101496e0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 >> 172.21.15.194:0/1436473273 conn(0x7fbb10066f70 msgr2=0x7fbb10154280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 shutdown_connections 2024-03-07T10:24:04.795 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:04.793+0000 7fbb14c00640 1 -- 172.21.15.194:0/1436473273 wait complete. 2024-03-07T10:24:04.811 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:24:05.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.022+0000 7f3d06c00640 1 Processor -- start 2024-03-07T10:24:05.024 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.022+0000 7f3d06c00640 1 -- start start 2024-03-07T10:24:05.025 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d06c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 0x7f3d00158d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d06c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d00073710 con 0x7f3d0006b080 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d06c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d000c3250 con 0x7f3d000c2030 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d06c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d00156220 con 0x7f3d00073330 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d04c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3d0006b080 0x7f3d0006e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38116/0 (socket says 172.21.15.194:38116) 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3d04c00640 1 -- 172.21.15.194:0/1363520176 learned_addr learned my addr 172.21.15.194:0/1363520176 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:05.026 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.024+0000 7f3cffe00640 1 --2- 172.21.15.194:0/1363520176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 0x7f3d00158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007221103 0 0) 0x7f3d00073710 con 0x7f3d0006b080 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ce4003520 con 0x7f3d0006b080 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901132352 0 0) 0x7f3ce8001110 con 0x7f3d000c2030 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d00073710 con 0x7f3d000c2030 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 481404114 0 0) 0x7f3ce4003520 con 0x7f3d0006b080 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cffe00640 1 -- 172.21.15.194:0/1363520176 >> v1:172.21.15.196:6789/0 conn(0x7f3d000c2030 legacy=0x7f3d000c2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cffe00640 1 -- 172.21.15.194:0/1363520176 >> v1:172.21.15.194:6789/0 conn(0x7f3d0006b080 legacy=0x7f3d0006e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.027 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.025+0000 7f3cffe00640 1 -- 172.21.15.194:0/1363520176 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d00156750 con 0x7f3d00073330 2024-03-07T10:24:05.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.026+0000 7f3cffe00640 1 --2- 172.21.15.194:0/1363520176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 0x7f3d00158d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097d0 tx=0x7f3cf002b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc278d8c20e09e4e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.027+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0037070 con 0x7f3d00073330 2024-03-07T10:24:05.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.027+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf0030510 con 0x7f3d00073330 2024-03-07T10:24:05.028 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.027+0000 7f3cff400640 1 -- 172.21.15.194:0/1363520176 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80019f0 con 0x7f3d00073330 2024-03-07T10:24:05.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 -- 172.21.15.194:0/1363520176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 msgr2=0x7f3d00158d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 --2- 172.21.15.194:0/1363520176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 0x7f3d00158d90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3cf00097d0 tx=0x7f3cf002b6e0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 -- 172.21.15.194:0/1363520176 shutdown_connections 2024-03-07T10:24:05.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 --2- 172.21.15.194:0/1363520176 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d00073330 0x7f3d00158d90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 -- 172.21.15.194:0/1363520176 >> 172.21.15.194:0/1363520176 conn(0x7f3d000c7630 msgr2=0x7f3d000c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:05.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 -- 172.21.15.194:0/1363520176 shutdown_connections 2024-03-07T10:24:05.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.028+0000 7f3d06c00640 1 -- 172.21.15.194:0/1363520176 wait complete. 2024-03-07T10:24:05.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.030+0000 7f3d06c00640 1 Processor -- start 2024-03-07T10:24:05.032 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.031+0000 7f3d06c00640 1 -- start start 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d00073330 0x7f3d000c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d000c2030 0x7f3d001ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006b6c0 con 0x7f3d0006b080 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006b9f0 con 0x7f3d00073330 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3d06c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0006e860 con 0x7f3d000c2030 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3cffe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58164/0 (socket says 172.21.15.194:58164) 2024-03-07T10:24:05.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.032+0000 7f3cffe00640 1 -- 172.21.15.194:0/3697975324 learned_addr learned my addr 172.21.15.194:0/3697975324 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:05.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cf7e00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d00073330 0x7f3d000c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3d04c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d000c2030 0x7f3d001ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 -- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d000c2030 msgr2=0x7f3d001ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d000c2030 0x7f3d001ee820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 -- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d00073330 msgr2=0x7f3d000c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d00073330 0x7f3d000c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 -- 172.21.15.194:0/3697975324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d001541d0 con 0x7f3d0006b080 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cffe00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3cf002b720 tx=0x7f3cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0042020 con 0x7f3d0006b080 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf00044a0 con 0x7f3d0006b080 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.033+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0037040 con 0x7f3d0006b080 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.034+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d001544b0 con 0x7f3d0006b080 2024-03-07T10:24:05.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.034+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0014a550 con 0x7f3d0006b080 2024-03-07T10:24:05.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.035+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d00068880 con 0x7f3d0006b080 2024-03-07T10:24:05.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.036+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3cf0045020 con 0x7f3d0006b080 2024-03-07T10:24:05.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.037+0000 7f3cfcc00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 0x7f3cdc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.037+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f3cf00ac2e0 con 0x7f3d0006b080 2024-03-07T10:24:05.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.037+0000 7f3cf7e00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 0x7f3cdc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.038+0000 7f3cf7e00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 0x7f3cdc06d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80012b0 tx=0x7f3ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.044+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f3cf004c030 con 0x7f3d0006b080 2024-03-07T10:24:05.280 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.279+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7f3d0006bd20 con 0x7f3d0006b080 2024-03-07T10:24:05.281 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.279+0000 7f3cfcc00640 1 -- 172.21.15.194:0/3697975324 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v29) v1 ==== 95+0+11 (secure 0 0 0) 0x7f3cf007acb0 con 0x7f3d0006b080 2024-03-07T10:24:05.281 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 msgr2=0x7f3cdc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 0x7f3cdc06d990 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80012b0 tx=0x7f3ce8009040 comp rx=0 tx=0).stop 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 msgr2=0x7f3d0014aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3cf002b720 tx=0x7f3cf00046c0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 shutdown_connections 2024-03-07T10:24:05.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3cdc06b4d0 0x7f3cdc06d990 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3d000c2030 0x7f3d001ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3d00073330 0x7f3d000c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 --2- 172.21.15.194:0/3697975324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0006b080 0x7f3d0014aa70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 >> 172.21.15.194:0/3697975324 conn(0x7f3d000c7630 msgr2=0x7f3d000c5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.282+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 shutdown_connections 2024-03-07T10:24:05.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.283+0000 7f3d06c00640 1 -- 172.21.15.194:0/3697975324 wait complete. 2024-03-07T10:24:05.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T10:24:05.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.507+0000 7f455de00640 1 Processor -- start 2024-03-07T10:24:05.509 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.508+0000 7f455de00640 1 -- start start 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f45580ad8e0 0x7f45580adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558155760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f45580c2f70 0x7f4558155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45580c2180 con 0x7f45580c2f70 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45580c39f0 con 0x7f45580ad8e0 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f455de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580c3cd0 con 0x7f4558159a40 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.509+0000 7f4557400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f45580c2f70 0x7f4558155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f45580c2f70 0x7f4558155ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58166/0 (socket says 172.21.15.194:58166) 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 -- 172.21.15.194:0/3752014853 learned_addr learned my addr 172.21.15.194:0/3752014853 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4556000640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4556a00640 1 --2- 172.21.15.194:0/3752014853 >> v2:172.21.15.196:3300/0 conn(0x7f45580ad8e0 0x7f45580adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 -- 172.21.15.194:0/3752014853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 msgr2=0x7f4558155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:05.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 -- 172.21.15.194:0/3752014853 >> v2:172.21.15.196:3300/0 conn(0x7f45580ad8e0 msgr2=0x7f45580adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:05.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 --2- 172.21.15.194:0/3752014853 >> v2:172.21.15.196:3300/0 conn(0x7f45580ad8e0 0x7f45580adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4557400640 1 -- 172.21.15.194:0/3752014853 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580c1ea0 con 0x7f45580c2f70 2024-03-07T10:24:05.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.510+0000 7f4556000640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.511+0000 7f4557400640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558155ca0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f45580732f0 tx=0x7f455002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ed07aac9742875 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f4555600640 1 -- 172.21.15.194:0/3752014853 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455002c9e0 con 0x7f45580c2f70 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f4555600640 1 -- 172.21.15.194:0/3752014853 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455002cb80 con 0x7f45580c2f70 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f4555600640 1 -- 172.21.15.194:0/3752014853 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500343f0 con 0x7f45580c2f70 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 -- 172.21.15.194:0/3752014853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 msgr2=0x7f4558155ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558155ca0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f45580732f0 tx=0x7f455002be40 comp rx=0 tx=0).stop 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 -- 172.21.15.194:0/3752014853 shutdown_connections 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558155ca0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 --2- 172.21.15.194:0/3752014853 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 --2- 172.21.15.194:0/3752014853 >> v2:172.21.15.196:3300/0 conn(0x7f45580ad8e0 0x7f45580adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 -- 172.21.15.194:0/3752014853 >> 172.21.15.194:0/3752014853 conn(0x7f45580c4b40 msgr2=0x7f45580c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 -- 172.21.15.194:0/3752014853 shutdown_connections 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.512+0000 7f455de00640 1 -- 172.21.15.194:0/3752014853 wait complete. 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.514+0000 7f455de00640 1 Processor -- start 2024-03-07T10:24:05.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.514+0000 7f455de00640 1 -- start start 2024-03-07T10:24:05.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45580ad8e0 0x7f455814c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.518 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4558153050 con 0x7f45580c2f70 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580c4340 con 0x7f45580ad8e0 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f455de00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45581531d0 con 0x7f4558159a40 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f4556000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f4556000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58182/0 (socket says 172.21.15.194:58182) 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.515+0000 7f4556000640 1 -- 172.21.15.194:0/1272122025 learned_addr learned my addr 172.21.15.194:0/1272122025 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4557400640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556a00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45580ad8e0 0x7f455814c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 -- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 msgr2=0x7f4558153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 -- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45580ad8e0 msgr2=0x7f455814c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45580ad8e0 0x7f455814c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 -- 172.21.15.194:0/1272122025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45581551c0 con 0x7f45580c2f70 2024-03-07T10:24:05.519 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f4556000640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f454400d800 tx=0x7f454400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544004030 con 0x7f45580c2f70 2024-03-07T10:24:05.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45440041d0 con 0x7f45580c2f70 2024-03-07T10:24:05.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45440096a0 con 0x7f45580c2f70 2024-03-07T10:24:05.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45581ef0b0 con 0x7f45580c2f70 2024-03-07T10:24:05.520 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.516+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45581e1a30 con 0x7f45580c2f70 2024-03-07T10:24:05.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.518+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4558068170 con 0x7f45580c2f70 2024-03-07T10:24:05.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.518+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4544009840 con 0x7f45580c2f70 2024-03-07T10:24:05.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.519+0000 7f454f400640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 0x7f453806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:05.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.520+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f454408a960 con 0x7f45580c2f70 2024-03-07T10:24:05.521 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.520+0000 7f4556a00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 0x7f453806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:05.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.521+0000 7f4556a00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 0x7f453806d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4548006fd0 tx=0x7f4548008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:05.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.524+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f4544059330 con 0x7f45580c2f70 2024-03-07T10:24:05.738 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.736+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4558156700 con 0x7f45580c2f70 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.737+0000 7f454f400640 1 -- 172.21.15.194:0/1272122025 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v29) v1 ==== 80+0+372 (secure 0 0 0) 0x7f4544058c30 con 0x7f45580c2f70 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.196:6835/1848630458 2024-03-08T10:23:37.999292+0000 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6832/1582324990 2024-03-08T10:23:58.005535+0000 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.196:6834/1848630458 2024-03-08T10:23:37.999292+0000 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6835/1436303034 2024-03-08T10:22:52.989185+0000 2024-03-07T10:24:05.739 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6833/1582324990 2024-03-08T10:23:58.005535+0000 2024-03-07T10:24:05.740 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6834/1436303034 2024-03-08T10:22:52.989185+0000 2024-03-07T10:24:05.740 INFO:teuthology.orchestra.run.smithi194.stderr:listed 6 entries 2024-03-07T10:24:05.742 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.740+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 msgr2=0x7f453806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.740+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 0x7f453806d990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4548006fd0 tx=0x7f4548008040 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.740+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 msgr2=0x7f4558153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.740+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f454400d800 tx=0x7f454400dcc0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 shutdown_connections 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f453806b4d0 0x7f453806d990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4558159a40 0x7f4558153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f45580c2f70 0x7f4558153730 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 --2- 172.21.15.194:0/1272122025 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f45580ad8e0 0x7f455814c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 >> 172.21.15.194:0/1272122025 conn(0x7f45580c4b40 msgr2=0x7f455806b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:05.743 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 shutdown_connections 2024-03-07T10:24:05.744 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:05.741+0000 7f455de00640 1 -- 172.21.15.194:0/1272122025 wait complete. 2024-03-07T10:24:05.760 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-07T10:24:05.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:05.760 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-07T10:24:05.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:24:05.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:05.874 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-07T10:24:05.949 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:24:05.949 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:24:05.986 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:24:05.986 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:24:06.066 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:24:06.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.256+0000 7fa8d5000640 1 Processor -- start 2024-03-07T10:24:06.258 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.256+0000 7fa8d5000640 1 -- start start 2024-03-07T10:24:06.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8d5000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa8d0152c80 0x7fa8d006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8d5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0155b20 con 0x7fa8d01528a0 2024-03-07T10:24:06.259 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8d5000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0155dc0 con 0x7fa8d00c5bc0 2024-03-07T10:24:06.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8d5000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d00c95e0 con 0x7fa8d0152c80 2024-03-07T10:24:06.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8c6a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa8d01528a0 0x7fa8d006c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38126/0 (socket says 172.21.15.194:38126) 2024-03-07T10:24:06.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8c6a00640 1 -- 172.21.15.194:0/3623425072 learned_addr learned my addr 172.21.15.194:0/3623425072 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.258+0000 7fa8cfe00640 1 --2- 172.21.15.194:0/3623425072 >> v2:172.21.15.196:3300/0 conn(0x7fa8d0152c80 0x7fa8d006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813803145 0 0) 0x7fa8d0155b20 con 0x7fa8d01528a0 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b4003520 con 0x7fa8d01528a0 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cfe00640 1 -- 172.21.15.194:0/3623425072 >> v1:172.21.15.196:6789/0 conn(0x7fa8d00c5bc0 legacy=0x7fa8d00c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cfe00640 1 -- 172.21.15.194:0/3623425072 >> v1:172.21.15.194:6789/0 conn(0x7fa8d01528a0 legacy=0x7fa8d006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059133387 0 0) 0x7fa8b4003520 con 0x7fa8d01528a0 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.259+0000 7fa8cfe00640 1 -- 172.21.15.194:0/3623425072 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0156080 con 0x7fa8d0152c80 2024-03-07T10:24:06.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.260+0000 7fa8cfe00640 1 --2- 172.21.15.194:0/3623425072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d0152c80 0x7fa8d006c8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009d90 tx=0x7fa8c802bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea510d913562e166 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.261+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8039070 con 0x7fa8d0152c80 2024-03-07T10:24:06.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.261+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c802c8b0 con 0x7fa8d0152c80 2024-03-07T10:24:06.262 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.261+0000 7fa8cea00640 1 -- 172.21.15.194:0/3623425072 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8001670 con 0x7fa8d0152c80 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.261+0000 7fa8d5000640 1 -- 172.21.15.194:0/3623425072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d0152c80 msgr2=0x7fa8d006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.261+0000 7fa8d5000640 1 --2- 172.21.15.194:0/3623425072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d0152c80 0x7fa8d006c8d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009d90 tx=0x7fa8c802bd80 comp rx=0 tx=0).stop 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.262+0000 7fa8d5000640 1 -- 172.21.15.194:0/3623425072 shutdown_connections 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.262+0000 7fa8d5000640 1 --2- 172.21.15.194:0/3623425072 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d0152c80 0x7fa8d006c8d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.262+0000 7fa8d5000640 1 -- 172.21.15.194:0/3623425072 >> 172.21.15.194:0/3623425072 conn(0x7fa8d00675e0 msgr2=0x7fa8d00cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.262+0000 7fa8d5000640 1 -- 172.21.15.194:0/3623425072 shutdown_connections 2024-03-07T10:24:06.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.262+0000 7fa8d5000640 1 -- 172.21.15.194:0/3623425072 wait complete. 2024-03-07T10:24:06.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.264+0000 7fa8d5000640 1 Processor -- start 2024-03-07T10:24:06.265 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.264+0000 7fa8d5000640 1 -- start start 2024-03-07T10:24:06.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d00c5bc0 0x7fa8d00c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.267 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 0x7fa8d00c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006ce10 con 0x7fa8d0152c80 2024-03-07T10:24:06.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0156640 con 0x7fa8d00c5bc0 2024-03-07T10:24:06.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8d5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d01530d0 con 0x7fa8d01528a0 2024-03-07T10:24:06.268 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8cfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58196/0 (socket says 172.21.15.194:58196) 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8cfe00640 1 -- 172.21.15.194:0/1431218234 learned_addr learned my addr 172.21.15.194:0/1431218234 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8c6a00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 0x7fa8d00c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.265+0000 7fa8cf400640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d00c5bc0 0x7fa8d00c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 -- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 msgr2=0x7fa8d00c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 0x7fa8d00c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 -- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d00c5bc0 msgr2=0x7fa8d00c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d00c5bc0 0x7fa8d00c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 -- 172.21.15.194:0/1431218234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d014fe10 con 0x7fa8d0152c80 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8c6a00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 0x7fa8d00c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:24:06.269 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8cfe00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009eb0 tx=0x7fa8c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8044030 con 0x7fa8d0152c80 2024-03-07T10:24:06.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c8004040 con 0x7fa8d0152c80 2024-03-07T10:24:06.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d014b4d0 con 0x7fa8d0152c80 2024-03-07T10:24:06.270 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.266+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8039040 con 0x7fa8d0152c80 2024-03-07T10:24:06.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.267+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d01ef2f0 con 0x7fa8d0152c80 2024-03-07T10:24:06.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.268+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0068170 con 0x7fa8d0152c80 2024-03-07T10:24:06.271 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.270+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa8c8047070 con 0x7fa8d0152c80 2024-03-07T10:24:06.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.271+0000 7fa8c7e00640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 0x7fa8ac06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.271+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fa8c80acb30 con 0x7fa8d0152c80 2024-03-07T10:24:06.272 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.271+0000 7fa8cf400640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 0x7fa8ac06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.274 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.272+0000 7fa8cf400640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 0x7fa8ac06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0159cb0 tx=0x7fa8c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.275+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa8c804e070 con 0x7fa8d0152c80 2024-03-07T10:24:06.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.471+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8d00c5400 con 0x7fa8d0152c80 2024-03-07T10:24:06.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.473+0000 7fa8c7e00640 1 -- 172.21.15.194:0/1431218234 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21036 (secure 0 0 0) 0x7fa8c807b6a0 con 0x7fa8d0152c80 2024-03-07T10:24:06.476 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:06.476 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":29,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:23:58.005671+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.196:6835/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6832/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.196:6834/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6835/1436303034":"2024-03-08T10:22:52.989185+0000","172.21.15.194:6833/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.194:6834/1436303034":"2024-03-08T10:22:52.989185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 msgr2=0x7fa8ac06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 0x7fa8ac06d990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0159cb0 tx=0x7fa8c0009040 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 msgr2=0x7fa8d014a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009eb0 tx=0x7fa8c8004a40 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 shutdown_connections 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa8ac06b4d0 0x7fa8ac06d990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa8d0152c80 0x7fa8d014a8b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa8d01528a0 0x7fa8d00c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 --2- 172.21.15.194:0/1431218234 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa8d00c5bc0 0x7fa8d00c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 >> 172.21.15.194:0/1431218234 conn(0x7fa8d00675e0 msgr2=0x7fa8d0153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:06.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.476+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 shutdown_connections 2024-03-07T10:24:06.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.477+0000 7fa8d5000640 1 -- 172.21.15.194:0/1431218234 wait complete. 2024-03-07T10:24:06.498 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-07T10:20:46.482552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-03-07T10:20:55.864525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-03-07T10:20:56.608790+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-03-07T10:21:06.809543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-03-07T10:21:07.702778+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-07T10:24:06.499 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-07T10:24:06.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.709+0000 7f65a5800640 1 Processor -- start 2024-03-07T10:24:06.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.709+0000 7f65a5800640 1 -- start start 2024-03-07T10:24:06.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.710+0000 7f65a5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65a00c2ff0 0x7f65a00adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.710+0000 7f65a5800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0156290 0x7f65a0160000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.710+0000 7f65a5800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a0158c70 con 0x7f65a00ad8e0 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.710+0000 7f65a5800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a0155680 con 0x7f65a00c2ff0 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.710+0000 7f65a5800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a006de10 con 0x7f65a0156290 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65a00c2ff0 0x7f65a00adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65a00c2ff0 0x7f65a00adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58198/0 (socket says 172.21.15.194:58198) 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 -- 172.21.15.194:0/2384617644 learned_addr learned my addr 172.21.15.194:0/2384617644 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659f400640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0156290 0x7f65a0160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 -- 172.21.15.194:0/2384617644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0156290 msgr2=0x7f65a0160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0156290 0x7f65a0160000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 -- 172.21.15.194:0/2384617644 >> v1:172.21.15.196:6789/0 conn(0x7f65a00ad8e0 legacy=0x7f65a0155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.711+0000 7f659e000640 1 -- 172.21.15.194:0/2384617644 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00c4040 con 0x7f65a00c2ff0 2024-03-07T10:24:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.713+0000 7f659e000640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a00c2ff0 0x7f65a00adcc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f658c009870 tx=0x7f658c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45de0f79541cb23d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.713+0000 7f659d600640 1 -- 172.21.15.194:0/2384617644 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c035020 con 0x7f65a00c2ff0 2024-03-07T10:24:06.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.713+0000 7f659d600640 1 -- 172.21.15.194:0/2384617644 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c031640 con 0x7f65a00c2ff0 2024-03-07T10:24:06.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.713+0000 7f659d600640 1 -- 172.21.15.194:0/2384617644 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c02d040 con 0x7f65a00c2ff0 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 -- 172.21.15.194:0/2384617644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a00c2ff0 msgr2=0x7f65a00adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a00c2ff0 0x7f65a00adcc0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f658c009870 tx=0x7f658c02b8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 -- 172.21.15.194:0/2384617644 shutdown_connections 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a0156290 0x7f65a0160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 --2- 172.21.15.194:0/2384617644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a00c2ff0 0x7f65a00adcc0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 -- 172.21.15.194:0/2384617644 >> 172.21.15.194:0/2384617644 conn(0x7f65a00c4a60 msgr2=0x7f65a00c4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 -- 172.21.15.194:0/2384617644 shutdown_connections 2024-03-07T10:24:06.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.714+0000 7f65a5800640 1 -- 172.21.15.194:0/2384617644 wait complete. 2024-03-07T10:24:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.716+0000 7f65a5800640 1 Processor -- start 2024-03-07T10:24:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.716+0000 7f65a5800640 1 -- start start 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a00ad8e0 0x7f65a014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00c2ff0 0x7f65a014abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a006dac0 con 0x7f65a0156290 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00c4600 con 0x7f65a00c2ff0 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f65a5800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0152f00 con 0x7f65a00ad8e0 2024-03-07T10:24:06.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f659f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f659f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58208/0 (socket says 172.21.15.194:58208) 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f659f400640 1 -- 172.21.15.194:0/3633743435 learned_addr learned my addr 172.21.15.194:0/3633743435 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f659ea00640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a00ad8e0 0x7f65a014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.717+0000 7f659e000640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00c2ff0 0x7f65a014abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 -- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a00ad8e0 msgr2=0x7f65a014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a00ad8e0 0x7f65a014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 -- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00c2ff0 msgr2=0x7f65a014abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00c2ff0 0x7f65a014abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 -- 172.21.15.194:0/3633743435 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a01ee5c0 con 0x7f65a0156290 2024-03-07T10:24:06.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f659f400640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6598009cb0 tx=0x7f659800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598018020 con 0x7f65a0156290 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6598014480 con 0x7f65a0156290 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6598014870 con 0x7f65a0156290 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a01ee8a0 con 0x7f65a0156290 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.718+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a01eee60 con 0x7f65a0156290 2024-03-07T10:24:06.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.720+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a0068880 con 0x7f65a0156290 2024-03-07T10:24:06.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.720+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f6598005d10 con 0x7f65a0156290 2024-03-07T10:24:06.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.722+0000 7f6596a00640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 0x7f658006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:06.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.722+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f659808b4b0 con 0x7f65a0156290 2024-03-07T10:24:06.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.722+0000 7f659ea00640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 0x7f658006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:06.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.723+0000 7f659ea00640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 0x7f658006d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6590000f60 tx=0x7f6590009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:06.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.726+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f6598022030 con 0x7f65a0156290 2024-03-07T10:24:06.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.922+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65a014e310 con 0x7f65a0156290 2024-03-07T10:24:06.924 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.923+0000 7f6596a00640 1 -- 172.21.15.194:0/3633743435 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6598010040 con 0x7f65a0156290 2024-03-07T10:24:06.925 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 1 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 msgr2=0x7f658006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 0x7f658006d990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6590000f60 tx=0x7f6590009040 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 msgr2=0x7f65a014b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6598009cb0 tx=0x7f659800c490 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 shutdown_connections 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f658006b4d0 0x7f658006d990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65a0156290 0x7f65a014b0f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f65a00c2ff0 0x7f65a014abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 --2- 172.21.15.194:0/3633743435 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f65a00ad8e0 0x7f65a014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 >> 172.21.15.194:0/3633743435 conn(0x7f65a00c4a60 msgr2=0x7f65a00adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 shutdown_connections 2024-03-07T10:24:06.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:06.926+0000 7f65a5800640 1 -- 172.21.15.194:0/3633743435 wait complete. 2024-03-07T10:24:06.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-03-07T10:24:07.152 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.151+0000 7f18d8e00640 1 Processor -- start 2024-03-07T10:24:07.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.151+0000 7f18d8e00640 1 -- start start 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.152+0000 7f18d8e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18d4070e10 0x7f18d40a8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.152+0000 7f18d8e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d40c5e90 con 0x7f18d4156240 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.152+0000 7f18d8e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d4155760 con 0x7f18d40a7d50 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.152+0000 7f18d8e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d40c6170 con 0x7f18d4070e10 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d2a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f18d4156240 0x7f18d4158b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38128/0 (socket says 172.21.15.194:38128) 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18d4070e10 0x7f18d40a8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d2a00640 1 -- 172.21.15.194:0/792836363 learned_addr learned my addr 172.21.15.194:0/792836363 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:07.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d3e00640 1 -- 172.21.15.194:0/792836363 >> v1:172.21.15.196:6789/0 conn(0x7f18d40a7d50 legacy=0x7f18d40c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:07.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d3e00640 1 -- 172.21.15.194:0/792836363 >> v1:172.21.15.194:6789/0 conn(0x7f18d4156240 legacy=0x7f18d4158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d2000640 1 -- 172.21.15.194:0/792836363 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395662471 0 0) 0x7f18d40c5e90 con 0x7f18d4156240 2024-03-07T10:24:07.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.153+0000 7f18d3e00640 1 -- 172.21.15.194:0/792836363 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4155a40 con 0x7f18d4070e10 2024-03-07T10:24:07.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.154+0000 7f18d3e00640 1 --2- 172.21.15.194:0/792836363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4070e10 0x7f18d40a8130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009d90 tx=0x7f18cc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b337aac34a91f83 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.154+0000 7f18d2000640 1 -- 172.21.15.194:0/792836363 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc039070 con 0x7f18d4070e10 2024-03-07T10:24:07.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d2000640 1 -- 172.21.15.194:0/792836363 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc02cc60 con 0x7f18d4070e10 2024-03-07T10:24:07.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d2000640 1 -- 172.21.15.194:0/792836363 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc034660 con 0x7f18d4070e10 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 -- 172.21.15.194:0/792836363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4070e10 msgr2=0x7f18d40a8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 --2- 172.21.15.194:0/792836363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4070e10 0x7f18d40a8130 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009d90 tx=0x7f18cc02beb0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 -- 172.21.15.194:0/792836363 shutdown_connections 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 --2- 172.21.15.194:0/792836363 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4070e10 0x7f18d40a8130 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 -- 172.21.15.194:0/792836363 >> 172.21.15.194:0/792836363 conn(0x7f18d40aa8c0 msgr2=0x7f18d40aaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 -- 172.21.15.194:0/792836363 shutdown_connections 2024-03-07T10:24:07.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.155+0000 7f18d8e00640 1 -- 172.21.15.194:0/792836363 wait complete. 2024-03-07T10:24:07.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.157+0000 7f18d8e00640 1 Processor -- start 2024-03-07T10:24:07.158 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.157+0000 7f18d8e00640 1 -- start start 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 0x7f18d4153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18d40a7d50 0x7f18d41ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40c4050 con 0x7f18d4156240 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4155db0 con 0x7f18d40a7d50 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d8e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4159240 con 0x7f18d4070e10 2024-03-07T10:24:07.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58230/0 (socket says 172.21.15.194:58230) 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.158+0000 7f18d3e00640 1 -- 172.21.15.194:0/2005918983 learned_addr learned my addr 172.21.15.194:0/2005918983 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d2a00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18d40a7d50 0x7f18d41ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3400640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 0x7f18d4153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 -- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 msgr2=0x7f18d4153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 0x7f18d4153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 -- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18d40a7d50 msgr2=0x7f18d41ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18d40a7d50 0x7f18d41ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 -- 172.21.15.194:0/2005918983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d41ef070 con 0x7f18d4156240 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3400640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 0x7f18d4153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d3e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f18cc037040 tx=0x7f18cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc039050 con 0x7f18d4156240 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc045070 con 0x7f18d4156240 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc03e850 con 0x7f18d4156240 2024-03-07T10:24:07.162 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.159+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d41ef310 con 0x7f18d4156240 2024-03-07T10:24:07.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.160+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d41588b0 con 0x7f18d4156240 2024-03-07T10:24:07.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.161+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d41ec760 con 0x7f18d4156240 2024-03-07T10:24:07.163 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.162+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f18cc03e9f0 con 0x7f18d4156240 2024-03-07T10:24:07.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.163+0000 7f18cb400640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 0x7f18b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.164+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f18cc0ad820 con 0x7f18d4156240 2024-03-07T10:24:07.165 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.164+0000 7f18d3400640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 0x7f18b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.166 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.165+0000 7f18d3400640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 0x7f18b406d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000f60 tx=0x7f18c4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.168 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.167+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f18cc07c3d0 con 0x7f18d4156240 2024-03-07T10:24:07.365 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.363+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18d4075600 con 0x7f18d4156240 2024-03-07T10:24:07.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.364+0000 7f18cb400640 1 -- 172.21.15.194:0/2005918983 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v29) v1 ==== 99+0+11 (secure 0 0 0) 0x7f18cc07bcd0 con 0x7f18d4156240 2024-03-07T10:24:07.366 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 msgr2=0x7f18b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 0x7f18b406d990 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18c4000f60 tx=0x7f18c4009040 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 msgr2=0x7f18d41ed170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f18cc037040 tx=0x7f18cc004a40 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 shutdown_connections 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f18b406b4d0 0x7f18b406d990 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18d4156240 0x7f18d41ed170 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f18d40a7d50 0x7f18d41ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 --2- 172.21.15.194:0/2005918983 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f18d4070e10 0x7f18d4153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 >> 172.21.15.194:0/2005918983 conn(0x7f18d40aa8c0 msgr2=0x7f18d406ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 shutdown_connections 2024-03-07T10:24:07.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.367+0000 7f18d8e00640 1 -- 172.21.15.194:0/2005918983 wait complete. 2024-03-07T10:24:07.386 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-03-07T10:24:07.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.591+0000 7f44c8600640 1 Processor -- start 2024-03-07T10:24:07.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.592+0000 7f44c8600640 1 -- start start 2024-03-07T10:24:07.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c8600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f44c014d6e0 0x7f44c006e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44c00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c8600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c0153760 con 0x7f44c00ab7c0 2024-03-07T10:24:07.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c8600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44c006daf0 con 0x7f44c014d6e0 2024-03-07T10:24:07.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006dd40 con 0x7f44c00ab340 2024-03-07T10:24:07.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c6600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f44c00ab7c0 0x7f44c0156b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38136/0 (socket says 172.21.15.194:38136) 2024-03-07T10:24:07.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c6600640 1 -- 172.21.15.194:0/3261883200 learned_addr learned my addr 172.21.15.194:0/3261883200 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:07.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.594+0000 7f44c5200640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44c00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44c5c00640 1 --2- 172.21.15.194:0/3261883200 >> v2:172.21.15.196:3300/0 conn(0x7f44c014d6e0 0x7f44c006e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133039680 0 0) 0x7f44c0153760 con 0x7f44c00ab7c0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a8003520 con 0x7f44c00ab7c0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696043452 0 0) 0x7f44a8003520 con 0x7f44c00ab7c0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 msgr2=0x7f44c00a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44c00a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 >> v2:172.21.15.196:3300/0 conn(0x7f44c014d6e0 msgr2=0x7f44c006e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 --2- 172.21.15.194:0/3261883200 >> v2:172.21.15.196:3300/0 conn(0x7f44c014d6e0 0x7f44c006e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c006e020 con 0x7f44c00ab7c0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f44b80019f0 con 0x7f44c00ab7c0 2024-03-07T10:24:07.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 >> v1:172.21.15.194:6789/0 conn(0x7f44c00ab7c0 legacy=0x7f44c0156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44a8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a8004d40 0x7f44a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006daf0 con 0x7f44a80039b0 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006dd40 con 0x7f44a8004d40 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.595+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a800b9c0 con 0x7f44c00ab340 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44a8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5200640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c6600640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a8004d40 0x7f44a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 -- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 msgr2=0x7f44a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00ab340 0x7f44a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 -- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a8004d40 msgr2=0x7f44a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44a8004d40 0x7f44a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.596+0000 7f44c5c00640 1 -- 172.21.15.194:0/3261883200 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a8003520 con 0x7f44a80039b0 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.597+0000 7f44c5c00640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44a8003df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009ac0 tx=0x7f44a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d11161d2541dc7f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4039070 con 0x7f44a80039b0 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b402c710 con 0x7f44a80039b0 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44bfe00640 1 -- 172.21.15.194:0/3261883200 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4009690 con 0x7f44a80039b0 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44c8600640 1 -- 172.21.15.194:0/3261883200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 msgr2=0x7f44a8003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44c8600640 1 --2- 172.21.15.194:0/3261883200 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44a8003df0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f44b4009ac0 tx=0x7f44a8005830 comp rx=0 tx=0).stop 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44c6600640 1 -- 172.21.15.194:0/3261883200 reap_dead start 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44c8600640 1 -- 172.21.15.194:0/3261883200 shutdown_connections 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.598+0000 7f44c8600640 1 -- 172.21.15.194:0/3261883200 >> 172.21.15.194:0/3261883200 conn(0x7f44c006b860 msgr2=0x7f44c00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.599+0000 7f44c8600640 1 -- 172.21.15.194:0/3261883200 shutdown_connections 2024-03-07T10:24:07.601 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.599+0000 7f44c8600640 1 -- 172.21.15.194:0/3261883200 wait complete. 2024-03-07T10:24:07.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.602+0000 7f44c8600640 1 Processor -- start 2024-03-07T10:24:07.604 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.602+0000 7f44c8600640 1 -- start start 2024-03-07T10:24:07.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00715b0 0x7f44c0148800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0148d40 0x7f44c013f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00aae10 con 0x7f44a80039b0 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00c79c0 con 0x7f44c0148d40 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.604+0000 7f44c8600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006ce70 con 0x7f44c00715b0 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58244/0 (socket says 172.21.15.194:58244) 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 -- 172.21.15.194:0/2167516992 learned_addr learned my addr 172.21.15.194:0/2167516992 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5200640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00715b0 0x7f44c0148800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c6600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0148d40 0x7f44c013f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 -- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00715b0 msgr2=0x7f44c0148800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00715b0 0x7f44c0148800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 -- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0148d40 msgr2=0x7f44c013f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0148d40 0x7f44c013f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.605+0000 7f44c5c00640 1 -- 172.21.15.194:0/2167516992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c0146cb0 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44c5c00640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f44b4037040 tx=0x7f44b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4042020 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b403a040 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c0147cb0 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b4039070 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.606+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c0147330 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.607+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c0068170 con 0x7f44a80039b0 2024-03-07T10:24:07.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.608+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f44b4045020 con 0x7f44a80039b0 2024-03-07T10:24:07.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.609+0000 7f44bd600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 0x7f44a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:07.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.609+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f44b40abad0 con 0x7f44a80039b0 2024-03-07T10:24:07.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.610+0000 7f44c5200640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 0x7f44a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:07.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.611+0000 7f44c5200640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 0x7f44a006d9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44c0157a80 tx=0x7f44ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:07.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.614+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f44b404c070 con 0x7f44a80039b0 2024-03-07T10:24:07.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.809+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) v1 -- 0x7f44c00c7c20 con 0x7f44a80039b0 2024-03-07T10:24:07.812 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.810+0000 7f44bd600640 1 -- 172.21.15.194:0/2167516992 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v29) v1 ==== 95+0+11 (secure 0 0 0) 0x7f44b407a540 con 0x7f44a80039b0 2024-03-07T10:24:07.812 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 msgr2=0x7f44a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 0x7f44a006d9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f44c0157a80 tx=0x7f44ac008040 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 msgr2=0x7f44c00c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f44b4037040 tx=0x7f44b4004730 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 shutdown_connections 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f44a006b500 0x7f44a006d9c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f44c0148d40 0x7f44c013f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f44c00715b0 0x7f44c0148800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 --2- 172.21.15.194:0/2167516992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a80039b0 0x7f44c00c0660 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 >> 172.21.15.194:0/2167516992 conn(0x7f44c006b860 msgr2=0x7f44c00c5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 shutdown_connections 2024-03-07T10:24:07.815 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:07.813+0000 7f44c8600640 1 -- 172.21.15.194:0/2167516992 wait complete. 2024-03-07T10:24:07.834 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-03-07T10:24:08.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.050+0000 7f8c80c00640 1 Processor -- start 2024-03-07T10:24:08.052 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.050+0000 7f8c80c00640 1 -- start start 2024-03-07T10:24:08.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.052+0000 7f8c80c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.054 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c80c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c7c06d1e0 0x7f8c7c06d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c80c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c7c070ba0 con 0x7f8c7c0c3520 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c80c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c7c152bd0 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c80c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c152330 con 0x7f8c7c14f480 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c7a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c7c06d1e0 0x7f8c7c06d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c7a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8c7c06d1e0 0x7f8c7c06d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58250/0 (socket says 172.21.15.194:58250) 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c7a800640 1 -- 172.21.15.194:0/1946663490 learned_addr learned my addr 172.21.15.194:0/1946663490 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:08.055 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c79e00640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c7a800640 1 -- 172.21.15.194:0/1946663490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 msgr2=0x7f8c7c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.053+0000 7f8c7a800640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.054+0000 7f8c7a800640 1 -- 172.21.15.194:0/1946663490 >> v1:172.21.15.196:6789/0 conn(0x7f8c7c0c3520 legacy=0x7f8c7c0c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.054+0000 7f8c7a800640 1 -- 172.21.15.194:0/1946663490 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c152610 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.054+0000 7f8c79e00640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:24:08.056 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.055+0000 7f8c7a800640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c06d670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009e50 tx=0x7f8c7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd27bad28224d6b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.055+0000 7f8c79400640 1 -- 172.21.15.194:0/1946663490 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7402ca70 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.055+0000 7f8c79400640 1 -- 172.21.15.194:0/1946663490 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7402cc10 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.057 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.055+0000 7f8c79400640 1 -- 172.21.15.194:0/1946663490 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c740343f0 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 -- 172.21.15.194:0/1946663490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 msgr2=0x7f8c7c06d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c06d670 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8c74009e50 tx=0x7f8c7402bed0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 -- 172.21.15.194:0/1946663490 shutdown_connections 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c06d670 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 --2- 172.21.15.194:0/1946663490 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 -- 172.21.15.194:0/1946663490 >> 172.21.15.194:0/1946663490 conn(0x7f8c7c06b860 msgr2=0x7f8c7c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 -- 172.21.15.194:0/1946663490 shutdown_connections 2024-03-07T10:24:08.058 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.056+0000 7f8c80c00640 1 -- 172.21.15.194:0/1946663490 wait complete. 2024-03-07T10:24:08.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.058+0000 7f8c80c00640 1 Processor -- start 2024-03-07T10:24:08.059 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.058+0000 7f8c80c00640 1 -- start start 2024-03-07T10:24:08.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.060 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c0c3520 0x7f8c7c147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06e900 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06ccc0 con 0x7f8c7c0c3520 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c80c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7c06dbb0 con 0x7f8c7c14f480 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c79e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c79e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58266/0 (socket says 172.21.15.194:58266) 2024-03-07T10:24:08.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c79e00640 1 -- 172.21.15.194:0/22988007 learned_addr learned my addr 172.21.15.194:0/22988007 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:08.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c7a800640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.059+0000 7f8c73e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c0c3520 0x7f8c7c147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 -- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 msgr2=0x7f8c7c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 -- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c0c3520 msgr2=0x7f8c7c147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c0c3520 0x7f8c7c147700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 -- 172.21.15.194:0/22988007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c7c1546e0 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c79e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e7e0 tx=0x7f8c6c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00f040 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6c004030 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c0043e0 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.060+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7c1ebe30 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.061+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7c148180 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.062+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c7c06ea80 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.063+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f8c6c00c6d0 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.064+0000 7f8c72000640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 0x7f8c5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.064+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f8c6c08a780 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.064+0000 7f8c73e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 0x7f8c5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.065+0000 7f8c73e00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 0x7f8c5806d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c64007fd0 tx=0x7f8c64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.068+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c7c06ea80 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.281+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c7c068170 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.282+0000 7f8c72000640 1 -- 172.21.15.194:0/22988007 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v29) v1 ==== 99+0+11 (secure 0 0 0) 0x7f8c6c017020 con 0x7f8c7c06d1e0 2024-03-07T10:24:08.284 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 32 2024-03-07T10:24:08.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.284+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 msgr2=0x7f8c5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.284+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 0x7f8c5806d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c64007fd0 tx=0x7f8c64009040 comp rx=0 tx=0).stop 2024-03-07T10:24:08.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.284+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 msgr2=0x7f8c7c151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00e7e0 tx=0x7f8c6c00eca0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 shutdown_connections 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8c5806b500 0x7f8c5806d9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c7c14f480 0x7f8c7c147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c7c0c3520 0x7f8c7c147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 --2- 172.21.15.194:0/22988007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c7c06d1e0 0x7f8c7c151110 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 >> 172.21.15.194:0/22988007 conn(0x7f8c7c06b860 msgr2=0x7f8c7c14d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 shutdown_connections 2024-03-07T10:24:08.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.285+0000 7f8c80c00640 1 -- 172.21.15.194:0/22988007 wait complete. 2024-03-07T10:24:08.306 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-03-07T10:24:08.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.520+0000 7fdaa9000640 1 Processor -- start 2024-03-07T10:24:08.522 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.521+0000 7fdaa9000640 1 -- start start 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.523+0000 7fdaa9000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fdaa40cb380 0x7fdaa40cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.523+0000 7fdaa9000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdaa4155990 0x7fdaa4155e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.523+0000 7fdaa9000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaa4153180 con 0x7fdaa4152da0 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.523+0000 7fdaa9000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa40c9620 con 0x7fdaa4155990 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.523+0000 7fdaa9000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaa4158f70 con 0x7fdaa40cb380 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa1e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdaa4152da0 0x7fdaa40c8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:38140/0 (socket says 172.21.15.194:38140) 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa1e00640 1 -- 172.21.15.194:0/209541933 learned_addr learned my addr 172.21.15.194:0/209541933 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:08.525 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa2800640 1 --2- 172.21.15.194:0/209541933 >> v2:172.21.15.194:3300/0 conn(0x7fdaa4155990 0x7fdaa4155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fda99400640 1 --2- 172.21.15.194:0/209541933 >> v2:172.21.15.196:3300/0 conn(0x7fdaa40cb380 0x7fdaa40cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa1400640 1 -- 172.21.15.194:0/209541933 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223608473 0 0) 0x7fdaa4153180 con 0x7fdaa4152da0 2024-03-07T10:24:08.526 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa1400640 1 -- 172.21.15.194:0/209541933 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda88003520 con 0x7fdaa4152da0 2024-03-07T10:24:08.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa2800640 1 -- 172.21.15.194:0/209541933 >> v2:172.21.15.196:3300/0 conn(0x7fdaa40cb380 msgr2=0x7fdaa40cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:08.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa2800640 1 --2- 172.21.15.194:0/209541933 >> v2:172.21.15.196:3300/0 conn(0x7fdaa40cb380 0x7fdaa40cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa2800640 1 -- 172.21.15.194:0/209541933 >> v1:172.21.15.194:6789/0 conn(0x7fdaa4152da0 legacy=0x7fdaa40c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.527 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.524+0000 7fdaa2800640 1 -- 172.21.15.194:0/209541933 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4159250 con 0x7fdaa4155990 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa2800640 1 --2- 172.21.15.194:0/209541933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4155990 0x7fdaa4155e00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406c890 tx=0x7fda9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bee67c47205e761 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa1400640 1 -- 172.21.15.194:0/209541933 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c035020 con 0x7fdaa4155990 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa1400640 1 -- 172.21.15.194:0/209541933 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c031830 con 0x7fdaa4155990 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa1400640 1 -- 172.21.15.194:0/209541933 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c031c00 con 0x7fdaa4155990 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 -- 172.21.15.194:0/209541933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4155990 msgr2=0x7fdaa4155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 --2- 172.21.15.194:0/209541933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4155990 0x7fdaa4155e00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdaa406c890 tx=0x7fda9c02b8d0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.528 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 -- 172.21.15.194:0/209541933 shutdown_connections 2024-03-07T10:24:08.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 --2- 172.21.15.194:0/209541933 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4155990 0x7fdaa4155e00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 --2- 172.21.15.194:0/209541933 >> v2:172.21.15.196:3300/0 conn(0x7fdaa40cb380 0x7fdaa40cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.526+0000 7fdaa9000640 1 -- 172.21.15.194:0/209541933 >> 172.21.15.194:0/209541933 conn(0x7fdaa4066f70 msgr2=0x7fdaa4067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:08.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.527+0000 7fdaa9000640 1 -- 172.21.15.194:0/209541933 shutdown_connections 2024-03-07T10:24:08.529 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.527+0000 7fdaa9000640 1 -- 172.21.15.194:0/209541933 wait complete. 2024-03-07T10:24:08.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.529+0000 7fdaa9000640 1 Processor -- start 2024-03-07T10:24:08.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.529+0000 7fdaa9000640 1 -- start start 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdaa40cb380 0x7fdaa41e8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdaa4155990 0x7fdaa414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa40be8c0 con 0x7fdaa4152da0 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4159810 con 0x7fdaa40cb380 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.530+0000 7fdaa9000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaa4156340 con 0x7fdaa4155990 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:58286/0 (socket says 172.21.15.194:58286) 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 -- 172.21.15.194:0/2618556857 learned_addr learned my addr 172.21.15.194:0/2618556857 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fdaa1e00640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdaa40cb380 0x7fdaa41e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 -- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdaa4155990 msgr2=0x7fdaa414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdaa4155990 0x7fdaa414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 -- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdaa40cb380 msgr2=0x7fdaa41e8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdaa40cb380 0x7fdaa41e8300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 -- 172.21.15.194:0/2618556857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa40bec30 con 0x7fdaa4152da0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda99400640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9e0 tx=0x7fda8c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.531+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c017070 con 0x7fdaa4152da0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.532+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00c9d0 con 0x7fdaa4152da0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.532+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa41e8840 con 0x7fdaa4152da0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.532+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00cdc0 con 0x7fdaa4152da0 2024-03-07T10:24:08.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.532+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaa41eeed0 con 0x7fdaa4152da0 2024-03-07T10:24:08.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.533+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaa414dc10 con 0x7fdaa4152da0 2024-03-07T10:24:08.535 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.534+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fda8c01a070 con 0x7fdaa4152da0 2024-03-07T10:24:08.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.535+0000 7fda9aa00640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 0x7fda8006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.536 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.535+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fda8c08aa50 con 0x7fdaa4152da0 2024-03-07T10:24:08.537 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.535+0000 7fdaa1e00640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 0x7fda8006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.537+0000 7fdaa1e00640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 0x7fda8006d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4150220 tx=0x7fda94009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.539+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fdaa414dc10 con 0x7fdaa4152da0 2024-03-07T10:24:08.736 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.735+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) v1 -- 0x7fdaa4068170 con 0x7fdaa4152da0 2024-03-07T10:24:08.737 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.736+0000 7fda9aa00640 1 -- 172.21.15.194:0/2618556857 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v29) v1 ==== 95+0+11 (secure 0 0 0) 0x7fda8c0594c0 con 0x7fdaa4152da0 2024-03-07T10:24:08.737 INFO:teuthology.orchestra.run.smithi194.stdout:pg_num: 64 2024-03-07T10:24:08.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.738+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 msgr2=0x7fda8006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.738+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 0x7fda8006d990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4150220 tx=0x7fda94009040 comp rx=0 tx=0).stop 2024-03-07T10:24:08.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.738+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 msgr2=0x7fdaa41ee420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.740 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.738+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9e0 tx=0x7fda8c00eea0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 shutdown_connections 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fda8006b4d0 0x7fda8006d990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fdaa4155990 0x7fdaa414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaa4152da0 0x7fdaa41ee420 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 --2- 172.21.15.194:0/2618556857 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fdaa40cb380 0x7fdaa41e8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 >> 172.21.15.194:0/2618556857 conn(0x7fdaa4066f70 msgr2=0x7fdaa4154c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 shutdown_connections 2024-03-07T10:24:08.741 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.739+0000 7fdaa9000640 1 -- 172.21.15.194:0/2618556857 wait complete. 2024-03-07T10:24:08.759 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-07T10:24:08.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.960+0000 7f756c400640 1 Processor -- start 2024-03-07T10:24:08.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.960+0000 7f756c400640 1 -- start start 2024-03-07T10:24:08.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f75640c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75640c6190 con 0x7f7564159530 2024-03-07T10:24:08.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756c400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7564155b80 con 0x7f75640c59f0 2024-03-07T10:24:08.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75641561d0 con 0x7f75640c8f70 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756a400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f7564159530 0x7f75641601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42966/0 (socket says 172.21.15.194:42966) 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f756a400640 1 -- 172.21.15.194:0/587035241 learned_addr learned my addr 172.21.15.194:0/587035241 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.962+0000 7f7569a00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f75640c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895731956 0 0) 0x7f75640c6190 con 0x7f7564159530 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f754c003520 con 0x7f7564159530 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4271732335 0 0) 0x7f754c003520 con 0x7f7564159530 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 msgr2=0x7f75640c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f75640c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 >> v1:172.21.15.196:6789/0 conn(0x7f75640c59f0 legacy=0x7f7564158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7564155e60 con 0x7f7564159530 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f755c0019f0 con 0x7f7564159530 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 >> v1:172.21.15.194:6789/0 conn(0x7f7564159530 legacy=0x7f75641601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f754c0039e0 0x7f754c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f754c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f754c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75641561d0 con 0x7f754c004d40 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c00bb50 con 0x7f754c0039e0 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.963+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c00bd50 con 0x7f75640c8f70 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f754c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f7569a00640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f754c0039e0 0x7f754c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f7569000640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f754c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 -- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 msgr2=0x7f754c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75640c8f70 0x7f754c004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 -- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f754c0039e0 msgr2=0x7f754c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f754c0039e0 0x7f754c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.964+0000 7f756a400640 1 -- 172.21.15.194:0/587035241 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c003520 con 0x7f754c004d40 2024-03-07T10:24:08.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.965+0000 7f756a400640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f754c0051c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f755c00a7b0 tx=0x7f754c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e2a89939cbb269 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.965+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c00a3d0 con 0x7f754c004d40 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.965+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c034650 con 0x7f754c004d40 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.965+0000 7f7563e00640 1 -- 172.21.15.194:0/587035241 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c034a80 con 0x7f754c004d40 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 -- 172.21.15.194:0/587035241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 msgr2=0x7f754c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 --2- 172.21.15.194:0/587035241 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f754c0051c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f755c00a7b0 tx=0x7f754c005830 comp rx=0 tx=0).stop 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756a400640 1 -- 172.21.15.194:0/587035241 reap_dead start 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 -- 172.21.15.194:0/587035241 shutdown_connections 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 -- 172.21.15.194:0/587035241 >> 172.21.15.194:0/587035241 conn(0x7f75640671b0 msgr2=0x7f75640675c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 -- 172.21.15.194:0/587035241 shutdown_connections 2024-03-07T10:24:08.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.966+0000 7f756c400640 1 -- 172.21.15.194:0/587035241 wait complete. 2024-03-07T10:24:08.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.969+0000 7f756c400640 1 Processor -- start 2024-03-07T10:24:08.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.969+0000 7f756c400640 1 -- start start 2024-03-07T10:24:08.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 0x7f75641eb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 0x7f75641482c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7564155830 con 0x7f754c004d40 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75640c5e70 con 0x7f756414d410 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.970+0000 7f756c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f756406d8c0 con 0x7f75641eb590 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60750/0 (socket says 172.21.15.194:60750) 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 -- 172.21.15.194:0/3468607183 learned_addr learned my addr 172.21.15.194:0/3468607183 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569000640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 0x7f75641eb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 -- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 msgr2=0x7f75641482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f756a400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 0x7f75641482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 0x7f75641482c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 -- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 msgr2=0x7f75641eb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:08.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 0x7f75641eb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 -- 172.21.15.194:0/3468607183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75640c4d70 con 0x7f754c004d40 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569000640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 0x7f75641eb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f756a400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 0x7f75641482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.971+0000 7f7569a00640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7558011600 tx=0x7f7558011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.972+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800f920 con 0x7f754c004d40 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.972+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755800fac0 con 0x7f754c004d40 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.972+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75640c4a90 con 0x7f754c004d40 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.972+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755800fe70 con 0x7f754c004d40 2024-03-07T10:24:08.975 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.972+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756414e2d0 con 0x7f754c004d40 2024-03-07T10:24:08.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.973+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7564068170 con 0x7f754c004d40 2024-03-07T10:24:08.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.974+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7558015460 con 0x7f754c004d40 2024-03-07T10:24:08.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.975+0000 7f7561600640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 0x7f754406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:08.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.975+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f755808b040 con 0x7f754c004d40 2024-03-07T10:24:08.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.976+0000 7f7569000640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 0x7f754406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:08.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.977+0000 7f7569000640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 0x7f754406d9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7564159110 tx=0x7f7550009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:08.985 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:08.984+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7558019030 con 0x7f754c004d40 2024-03-07T10:24:09.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.195+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75641527b0 con 0x7f754c004d40 2024-03-07T10:24:09.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.199+0000 7f7561600640 1 -- 172.21.15.194:0/3468607183 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v29) v1 ==== 80+0+372 (secure 0 0 0) 0x7f7558059a10 con 0x7f754c004d40 2024-03-07T10:24:09.200 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.196:6835/1848630458 2024-03-08T10:23:37.999292+0000 2024-03-07T10:24:09.200 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6832/1582324990 2024-03-08T10:23:58.005535+0000 2024-03-07T10:24:09.201 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.196:6834/1848630458 2024-03-08T10:23:37.999292+0000 2024-03-07T10:24:09.201 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6835/1436303034 2024-03-08T10:22:52.989185+0000 2024-03-07T10:24:09.201 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6833/1582324990 2024-03-08T10:23:58.005535+0000 2024-03-07T10:24:09.201 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.15.194:6834/1436303034 2024-03-08T10:22:52.989185+0000 2024-03-07T10:24:09.201 INFO:teuthology.orchestra.run.smithi194.stderr:listed 6 entries 2024-03-07T10:24:09.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.201+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 msgr2=0x7f754406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:09.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.201+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 0x7f754406d9c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7564159110 tx=0x7f7550009040 comp rx=0 tx=0).stop 2024-03-07T10:24:09.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 msgr2=0x7f756414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:09.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f7558011600 tx=0x7f7558011ac0 comp rx=0 tx=0).stop 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 shutdown_connections 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f754406b500 0x7f754406d9c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f75641eb590 0x7f75641482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f756414d410 0x7f75641eb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 --2- 172.21.15.194:0/3468607183 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f754c004d40 0x7f756414dd90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 >> 172.21.15.194:0/3468607183 conn(0x7f75640671b0 msgr2=0x7f75640cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 shutdown_connections 2024-03-07T10:24:09.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:09.202+0000 7f756c400640 1 -- 172.21.15.194:0/3468607183 wait complete. 2024-03-07T10:24:09.221 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-07T10:24:09.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.222 DEBUG:teuthology.orchestra.run.smithi196:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-03-07T10:24:09.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:24:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.346 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-07T10:24:09.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.401 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-03-07T10:24:09.456 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-07T10:24:09.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-07T10:24:09.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.557 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-03-07T10:24:09.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.670 DEBUG:teuthology.orchestra.run.smithi196:> ip netns list 2024-03-07T10:24:09.720 INFO:teuthology.orchestra.run.smithi196.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-07T10:24:09.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.721 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-07T10:24:09.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:24:09.794 DEBUG:teuthology.orchestra.run.smithi196:> sudo ip link delete ceph-brx 2024-03-07T10:24:09.909 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-07T10:24:09.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-07T10:24:09.919 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:24:10.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.130+0000 7f3336200640 1 Processor -- start 2024-03-07T10:24:10.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.130+0000 7f3336200640 1 -- start start 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.131+0000 7f3336200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3330150a90 0x7f33300c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.131+0000 7f3336200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f33300c2690 0x7f33300c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.131+0000 7f3336200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33300c33b0 con 0x7f33300c4130 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.131+0000 7f3336200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3330072b50 con 0x7f3330150a90 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.131+0000 7f3336200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3330150e70 con 0x7f33300c2690 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3330150a90 0x7f33300c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.133 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3330150a90 0x7f33300c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60766/0 (socket says 172.21.15.194:60766) 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 -- 172.21.15.194:0/1511959399 learned_addr learned my addr 172.21.15.194:0/1511959399 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3335800640 1 --2- 172.21.15.194:0/1511959399 >> v2:172.21.15.196:3300/0 conn(0x7f33300c2690 0x7f33300c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 -- 172.21.15.194:0/1511959399 >> v2:172.21.15.196:3300/0 conn(0x7f33300c2690 msgr2=0x7f33300c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 --2- 172.21.15.194:0/1511959399 >> v2:172.21.15.196:3300/0 conn(0x7f33300c2690 0x7f33300c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 -- 172.21.15.194:0/1511959399 >> v1:172.21.15.196:6789/0 conn(0x7f33300c4130 legacy=0x7f33300c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.134 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.132+0000 7f3334e00640 1 -- 172.21.15.194:0/1511959399 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330072d80 con 0x7f3330150a90 2024-03-07T10:24:10.135 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.134+0000 7f3334e00640 1 --2- 172.21.15.194:0/1511959399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3330150a90 0x7f33300c3bf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f33300709a0 tx=0x7f332402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a275bfda3738b6d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.134+0000 7f332f400640 1 -- 172.21.15.194:0/1511959399 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324034070 con 0x7f3330150a90 2024-03-07T10:24:10.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.134+0000 7f332f400640 1 -- 172.21.15.194:0/1511959399 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324030850 con 0x7f3330150a90 2024-03-07T10:24:10.136 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.134+0000 7f332f400640 1 -- 172.21.15.194:0/1511959399 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324030c20 con 0x7f3330150a90 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 -- 172.21.15.194:0/1511959399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3330150a90 msgr2=0x7f33300c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 --2- 172.21.15.194:0/1511959399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3330150a90 0x7f33300c3bf0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f33300709a0 tx=0x7f332402b990 comp rx=0 tx=0).stop 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 -- 172.21.15.194:0/1511959399 shutdown_connections 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 --2- 172.21.15.194:0/1511959399 >> v2:172.21.15.196:3300/0 conn(0x7f33300c2690 0x7f33300c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 --2- 172.21.15.194:0/1511959399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3330150a90 0x7f33300c3bf0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 -- 172.21.15.194:0/1511959399 >> 172.21.15.194:0/1511959399 conn(0x7f33300c70f0 msgr2=0x7f33300c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 -- 172.21.15.194:0/1511959399 shutdown_connections 2024-03-07T10:24:10.137 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.135+0000 7f3336200640 1 -- 172.21.15.194:0/1511959399 wait complete. 2024-03-07T10:24:10.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.137+0000 7f3336200640 1 Processor -- start 2024-03-07T10:24:10.138 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.137+0000 7f3336200640 1 -- start start 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 0x7f33301de210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3330150a90 0x7f333014fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330073340 con 0x7f33300c4130 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3330071cf0 con 0x7f33300c2690 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f3336200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33300c2320 con 0x7f3330150a90 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f332fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f332fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60772/0 (socket says 172.21.15.194:60772) 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.138+0000 7f332fe00640 1 -- 172.21.15.194:0/534142081 learned_addr learned my addr 172.21.15.194:0/534142081 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f3335800640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3330150a90 0x7f333014fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f3334e00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 0x7f33301de210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 -- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3330150a90 msgr2=0x7f333014fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3330150a90 0x7f333014fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.141 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 -- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 msgr2=0x7f33301de210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 0x7f33301de210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 -- 172.21.15.194:0/534142081 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3330154150 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f3334e00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 0x7f33301de210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332fe00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f332000c430 tx=0x7f332000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200052d0 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3320005490 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3320007260 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33301517d0 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.139+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3330153710 con 0x7f33300c4130 2024-03-07T10:24:10.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.140+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330068170 con 0x7f33300c4130 2024-03-07T10:24:10.143 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.142+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3320007400 con 0x7f33300c4130 2024-03-07T10:24:10.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.143+0000 7f332cc00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 0x7f331406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.143+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f3320089c30 con 0x7f33300c4130 2024-03-07T10:24:10.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.143+0000 7f3334e00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 0x7f331406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.145+0000 7f3334e00640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 0x7f331406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3324036000 tx=0x7f332403b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.147+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f33301517d0 con 0x7f33300c4130 2024-03-07T10:24:10.399 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.397+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33300c69f0 con 0x7f331406b4d0 2024-03-07T10:24:10.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.432+0000 7f332cc00640 1 -- 172.21.15.194:0/534142081 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490607 (secure 0 0 0) 0x7f33300c69f0 con 0x7f331406b4d0 2024-03-07T10:24:10.440 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:10.444 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 msgr2=0x7f331406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 0x7f331406d990 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3324036000 tx=0x7f332403b040 comp rx=0 tx=0).stop 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 msgr2=0x7f3330153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f332000c430 tx=0x7f332000c8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 shutdown_connections 2024-03-07T10:24:10.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f331406b4d0 0x7f331406d990 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3330150a90 0x7f333014fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300c4130 0x7f3330153c10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 --2- 172.21.15.194:0/534142081 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f33300c2690 0x7f33301de210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 >> 172.21.15.194:0/534142081 conn(0x7f33300c70f0 msgr2=0x7f333014e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 shutdown_connections 2024-03-07T10:24:10.447 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.439+0000 7f3336200640 1 -- 172.21.15.194:0/534142081 wait complete. 2024-03-07T10:24:10.459 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-03-07T10:24:08.487540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670581,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":353,"num_read_kb":387,"num_write":342,"num_write_kb":2568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":804,"ondisk_log_size":804,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220044,"kb_used_data":3912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754676,"statfs":{"total":773094113280,"available":772868788224,"internally_reserved":0,"allocated":4005888,"data_stored":2416042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7528,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":111,"num_write":14,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.474416"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024280+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:23:58.024280+0000","last_peered":"2024-03-07T10:23:58.024280+0000","last_clean":"2024-03-07T10:23:58.024280+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:23:58.024280+0000","last_undegraded":"2024-03-07T10:23:58.024280+0000","last_fullsized":"2024-03-07T10:23:58.024280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030677+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:23:58.030677+0000","last_peered":"2024-03-07T10:23:58.030677+0000","last_clean":"2024-03-07T10:23:58.030677+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:23:58.030677+0000","last_undegraded":"2024-03-07T10:23:58.030677+0000","last_fullsized":"2024-03-07T10:23:58.030677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903986+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:24:05.903986+0000","last_peered":"2024-03-07T10:24:05.903986+0000","last_clean":"2024-03-07T10:24:05.903986+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:05.903986+0000","last_undegraded":"2024-03-07T10:24:05.903986+0000","last_fullsized":"2024-03-07T10:24:05.903986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015730+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:23:58.015730+0000","last_peered":"2024-03-07T10:23:58.015730+0000","last_clean":"2024-03-07T10:23:58.015730+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:23:58.015730+0000","last_undegraded":"2024-03-07T10:23:58.015730+0000","last_fullsized":"2024-03-07T10:23:58.015730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019525+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:23:58.019525+0000","last_peered":"2024-03-07T10:23:58.019525+0000","last_clean":"2024-03-07T10:23:58.019525+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:23:58.019525+0000","last_undegraded":"2024-03-07T10:23:58.019525+0000","last_fullsized":"2024-03-07T10:23:58.019525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021122+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:23:58.021122+0000","last_peered":"2024-03-07T10:23:58.021122+0000","last_clean":"2024-03-07T10:23:58.021122+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:23:58.021122+0000","last_undegraded":"2024-03-07T10:23:58.021122+0000","last_fullsized":"2024-03-07T10:23:58.021122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908428+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:24:05.908428+0000","last_peered":"2024-03-07T10:24:05.908428+0000","last_clean":"2024-03-07T10:24:05.908428+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:05.908428+0000","last_undegraded":"2024-03-07T10:24:05.908428+0000","last_fullsized":"2024-03-07T10:24:05.908428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024431+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:23:58.024431+0000","last_peered":"2024-03-07T10:23:58.024431+0000","last_clean":"2024-03-07T10:23:58.024431+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:23:58.024431+0000","last_undegraded":"2024-03-07T10:23:58.024431+0000","last_fullsized":"2024-03-07T10:23:58.024431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047467+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:23:58.047467+0000","last_peered":"2024-03-07T10:23:58.047467+0000","last_clean":"2024-03-07T10:23:58.047467+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:23:58.047467+0000","last_undegraded":"2024-03-07T10:23:58.047467+0000","last_fullsized":"2024-03-07T10:23:58.047467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048385+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:23:58.048385+0000","last_peered":"2024-03-07T10:23:58.048385+0000","last_clean":"2024-03-07T10:23:58.048385+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:23:58.048385+0000","last_undegraded":"2024-03-07T10:23:58.048385+0000","last_fullsized":"2024-03-07T10:23:58.048385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907846+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:24:05.907846+0000","last_peered":"2024-03-07T10:24:05.907846+0000","last_clean":"2024-03-07T10:24:05.907846+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:05.907846+0000","last_undegraded":"2024-03-07T10:24:05.907846+0000","last_fullsized":"2024-03-07T10:24:05.907846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025165+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:23:58.025165+0000","last_peered":"2024-03-07T10:23:58.025165+0000","last_clean":"2024-03-07T10:23:58.025165+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:23:58.025165+0000","last_undegraded":"2024-03-07T10:23:58.025165+0000","last_fullsized":"2024-03-07T10:23:58.025165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048028+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:23:58.048028+0000","last_peered":"2024-03-07T10:23:58.048028+0000","last_clean":"2024-03-07T10:23:58.048028+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:23:58.048028+0000","last_undegraded":"2024-03-07T10:23:58.048028+0000","last_fullsized":"2024-03-07T10:23:58.048028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902537+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:24:05.902537+0000","last_peered":"2024-03-07T10:24:05.902537+0000","last_clean":"2024-03-07T10:24:05.902537+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:05.902537+0000","last_undegraded":"2024-03-07T10:24:05.902537+0000","last_fullsized":"2024-03-07T10:24:05.902537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024932+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:23:58.024932+0000","last_peered":"2024-03-07T10:23:58.024932+0000","last_clean":"2024-03-07T10:23:58.024932+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:23:58.024932+0000","last_undegraded":"2024-03-07T10:23:58.024932+0000","last_fullsized":"2024-03-07T10:23:58.024932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018731+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:23:58.018731+0000","last_peered":"2024-03-07T10:23:58.018731+0000","last_clean":"2024-03-07T10:23:58.018731+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:23:58.018731+0000","last_undegraded":"2024-03-07T10:23:58.018731+0000","last_fullsized":"2024-03-07T10:23:58.018731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912919+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:24:05.912919+0000","last_peered":"2024-03-07T10:24:05.912919+0000","last_clean":"2024-03-07T10:24:05.912919+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:05.912919+0000","last_undegraded":"2024-03-07T10:24:05.912919+0000","last_fullsized":"2024-03-07T10:24:05.912919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047794+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:23:58.047794+0000","last_peered":"2024-03-07T10:23:58.047794+0000","last_clean":"2024-03-07T10:23:58.047794+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:23:58.047794+0000","last_undegraded":"2024-03-07T10:23:58.047794+0000","last_fullsized":"2024-03-07T10:23:58.047794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026019+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:23:58.026019+0000","last_peered":"2024-03-07T10:23:58.026019+0000","last_clean":"2024-03-07T10:23:58.026019+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:23:58.026019+0000","last_undegraded":"2024-03-07T10:23:58.026019+0000","last_fullsized":"2024-03-07T10:23:58.026019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021488+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:23:58.021488+0000","last_peered":"2024-03-07T10:23:58.021488+0000","last_clean":"2024-03-07T10:23:58.021488+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:23:58.021488+0000","last_undegraded":"2024-03-07T10:23:58.021488+0000","last_fullsized":"2024-03-07T10:23:58.021488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909235+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:24:05.909235+0000","last_peered":"2024-03-07T10:24:05.909235+0000","last_clean":"2024-03-07T10:24:05.909235+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:05.909235+0000","last_undegraded":"2024-03-07T10:24:05.909235+0000","last_fullsized":"2024-03-07T10:24:05.909235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021928+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:23:58.021928+0000","last_peered":"2024-03-07T10:23:58.021928+0000","last_clean":"2024-03-07T10:23:58.021928+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:23:58.021928+0000","last_undegraded":"2024-03-07T10:23:58.021928+0000","last_fullsized":"2024-03-07T10:23:58.021928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025697+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:23:58.025697+0000","last_peered":"2024-03-07T10:23:58.025697+0000","last_clean":"2024-03-07T10:23:58.025697+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:23:58.025697+0000","last_undegraded":"2024-03-07T10:23:58.025697+0000","last_fullsized":"2024-03-07T10:23:58.025697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025370+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:23:58.025370+0000","last_peered":"2024-03-07T10:23:58.025370+0000","last_clean":"2024-03-07T10:23:58.025370+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:23:58.025370+0000","last_undegraded":"2024-03-07T10:23:58.025370+0000","last_fullsized":"2024-03-07T10:23:58.025370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905051+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:24:05.905051+0000","last_peered":"2024-03-07T10:24:05.905051+0000","last_clean":"2024-03-07T10:24:05.905051+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:05.905051+0000","last_undegraded":"2024-03-07T10:24:05.905051+0000","last_fullsized":"2024-03-07T10:24:05.905051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020557+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:23:58.020557+0000","last_peered":"2024-03-07T10:23:58.020557+0000","last_clean":"2024-03-07T10:23:58.020557+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:23:58.020557+0000","last_undegraded":"2024-03-07T10:23:58.020557+0000","last_fullsized":"2024-03-07T10:23:58.020557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023377+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:23:58.023377+0000","last_peered":"2024-03-07T10:23:58.023377+0000","last_clean":"2024-03-07T10:23:58.023377+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:23:58.023377+0000","last_undegraded":"2024-03-07T10:23:58.023377+0000","last_fullsized":"2024-03-07T10:23:58.023377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027741+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:23:58.027741+0000","last_peered":"2024-03-07T10:23:58.027741+0000","last_clean":"2024-03-07T10:23:58.027741+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:23:58.027741+0000","last_undegraded":"2024-03-07T10:23:58.027741+0000","last_fullsized":"2024-03-07T10:23:58.027741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.851798+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:24:05.851798+0000","last_peered":"2024-03-07T10:24:05.851798+0000","last_clean":"2024-03-07T10:24:05.851798+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:05.851798+0000","last_undegraded":"2024-03-07T10:24:05.851798+0000","last_fullsized":"2024-03-07T10:24:05.851798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047943+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:23:58.047943+0000","last_peered":"2024-03-07T10:23:58.047943+0000","last_clean":"2024-03-07T10:23:58.047943+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:23:58.047943+0000","last_undegraded":"2024-03-07T10:23:58.047943+0000","last_fullsized":"2024-03-07T10:23:58.047943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.036887+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:24:01.036887+0000","last_peered":"2024-03-07T10:24:01.036887+0000","last_clean":"2024-03-07T10:24:01.036887+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:01.036887+0000","last_undegraded":"2024-03-07T10:24:01.036887+0000","last_fullsized":"2024-03-07T10:24:01.036887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016321+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:23:58.016321+0000","last_peered":"2024-03-07T10:23:58.016321+0000","last_clean":"2024-03-07T10:23:58.016321+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:23:58.016321+0000","last_undegraded":"2024-03-07T10:23:58.016321+0000","last_fullsized":"2024-03-07T10:23:58.016321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906780+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:24:05.906780+0000","last_peered":"2024-03-07T10:24:05.906780+0000","last_clean":"2024-03-07T10:24:05.906780+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:05.906780+0000","last_undegraded":"2024-03-07T10:24:05.906780+0000","last_fullsized":"2024-03-07T10:24:05.906780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037774+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:23:58.037774+0000","last_peered":"2024-03-07T10:23:58.037774+0000","last_clean":"2024-03-07T10:23:58.037774+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:23:58.037774+0000","last_undegraded":"2024-03-07T10:23:58.037774+0000","last_fullsized":"2024-03-07T10:23:58.037774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024779+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:23:58.024779+0000","last_peered":"2024-03-07T10:23:58.024779+0000","last_clean":"2024-03-07T10:23:58.024779+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:23:58.024779+0000","last_undegraded":"2024-03-07T10:23:58.024779+0000","last_fullsized":"2024-03-07T10:23:58.024779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024293+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:23:58.024293+0000","last_peered":"2024-03-07T10:23:58.024293+0000","last_clean":"2024-03-07T10:23:58.024293+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:23:58.024293+0000","last_undegraded":"2024-03-07T10:23:58.024293+0000","last_fullsized":"2024-03-07T10:23:58.024293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906157+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:24:05.906157+0000","last_peered":"2024-03-07T10:24:05.906157+0000","last_clean":"2024-03-07T10:24:05.906157+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:05.906157+0000","last_undegraded":"2024-03-07T10:24:05.906157+0000","last_fullsized":"2024-03-07T10:24:05.906157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023629+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:23:58.023629+0000","last_peered":"2024-03-07T10:23:58.023629+0000","last_clean":"2024-03-07T10:23:58.023629+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:23:58.023629+0000","last_undegraded":"2024-03-07T10:23:58.023629+0000","last_fullsized":"2024-03-07T10:23:58.023629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015274+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:23:58.015274+0000","last_peered":"2024-03-07T10:23:58.015274+0000","last_clean":"2024-03-07T10:23:58.015274+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:23:58.015274+0000","last_undegraded":"2024-03-07T10:23:58.015274+0000","last_fullsized":"2024-03-07T10:23:58.015274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036766+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:23:58.036766+0000","last_peered":"2024-03-07T10:23:58.036766+0000","last_clean":"2024-03-07T10:23:58.036766+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:23:58.036766+0000","last_undegraded":"2024-03-07T10:23:58.036766+0000","last_fullsized":"2024-03-07T10:23:58.036766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.894099+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:24:05.894099+0000","last_peered":"2024-03-07T10:24:05.894099+0000","last_clean":"2024-03-07T10:24:05.894099+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:05.894099+0000","last_undegraded":"2024-03-07T10:24:05.894099+0000","last_fullsized":"2024-03-07T10:24:05.894099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048513+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:23:58.048513+0000","last_peered":"2024-03-07T10:23:58.048513+0000","last_clean":"2024-03-07T10:23:58.048513+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:23:58.048513+0000","last_undegraded":"2024-03-07T10:23:58.048513+0000","last_fullsized":"2024-03-07T10:23:58.048513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030079+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:23:58.030079+0000","last_peered":"2024-03-07T10:23:58.030079+0000","last_clean":"2024-03-07T10:23:58.030079+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:23:58.030079+0000","last_undegraded":"2024-03-07T10:23:58.030079+0000","last_fullsized":"2024-03-07T10:23:58.030079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030683+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:23:58.030683+0000","last_peered":"2024-03-07T10:23:58.030683+0000","last_clean":"2024-03-07T10:23:58.030683+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:23:58.030683+0000","last_undegraded":"2024-03-07T10:23:58.030683+0000","last_fullsized":"2024-03-07T10:23:58.030683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912092+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:24:05.912092+0000","last_peered":"2024-03-07T10:24:05.912092+0000","last_clean":"2024-03-07T10:24:05.912092+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:05.912092+0000","last_undegraded":"2024-03-07T10:24:05.912092+0000","last_fullsized":"2024-03-07T10:24:05.912092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022761+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:23:58.022761+0000","last_peered":"2024-03-07T10:23:58.022761+0000","last_clean":"2024-03-07T10:23:58.022761+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:23:58.022761+0000","last_undegraded":"2024-03-07T10:23:58.022761+0000","last_fullsized":"2024-03-07T10:23:58.022761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021237+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:23:58.021237+0000","last_peered":"2024-03-07T10:23:58.021237+0000","last_clean":"2024-03-07T10:23:58.021237+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:23:58.021237+0000","last_undegraded":"2024-03-07T10:23:58.021237+0000","last_fullsized":"2024-03-07T10:23:58.021237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029730+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:23:58.029730+0000","last_peered":"2024-03-07T10:23:58.029730+0000","last_clean":"2024-03-07T10:23:58.029730+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:23:58.029730+0000","last_undegraded":"2024-03-07T10:23:58.029730+0000","last_fullsized":"2024-03-07T10:23:58.029730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906576+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:24:05.906576+0000","last_peered":"2024-03-07T10:24:05.906576+0000","last_clean":"2024-03-07T10:24:05.906576+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:05.906576+0000","last_undegraded":"2024-03-07T10:24:05.906576+0000","last_fullsized":"2024-03-07T10:24:05.906576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026748+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:23:58.026748+0000","last_peered":"2024-03-07T10:23:58.026748+0000","last_clean":"2024-03-07T10:23:58.026748+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:23:58.026748+0000","last_undegraded":"2024-03-07T10:23:58.026748+0000","last_fullsized":"2024-03-07T10:23:58.026748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022319+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:23:58.022319+0000","last_peered":"2024-03-07T10:23:58.022319+0000","last_clean":"2024-03-07T10:23:58.022319+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:23:58.022319+0000","last_undegraded":"2024-03-07T10:23:58.022319+0000","last_fullsized":"2024-03-07T10:23:58.022319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021571+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:23:58.021571+0000","last_peered":"2024-03-07T10:23:58.021571+0000","last_clean":"2024-03-07T10:23:58.021571+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:23:58.021571+0000","last_undegraded":"2024-03-07T10:23:58.021571+0000","last_fullsized":"2024-03-07T10:23:58.021571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893529+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:24:05.893529+0000","last_peered":"2024-03-07T10:24:05.893529+0000","last_clean":"2024-03-07T10:24:05.893529+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:05.893529+0000","last_undegraded":"2024-03-07T10:24:05.893529+0000","last_fullsized":"2024-03-07T10:24:05.893529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020619+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:23:58.020619+0000","last_peered":"2024-03-07T10:23:58.020619+0000","last_clean":"2024-03-07T10:23:58.020619+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:23:58.020619+0000","last_undegraded":"2024-03-07T10:23:58.020619+0000","last_fullsized":"2024-03-07T10:23:58.020619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.038168+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:24:01.038168+0000","last_peered":"2024-03-07T10:24:01.038168+0000","last_clean":"2024-03-07T10:24:01.038168+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:01.038168+0000","last_undegraded":"2024-03-07T10:24:01.038168+0000","last_fullsized":"2024-03-07T10:24:01.038168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027870+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:23:58.027870+0000","last_peered":"2024-03-07T10:23:58.027870+0000","last_clean":"2024-03-07T10:23:58.027870+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:23:58.027870+0000","last_undegraded":"2024-03-07T10:23:58.027870+0000","last_fullsized":"2024-03-07T10:23:58.027870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903468+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:24:05.903468+0000","last_peered":"2024-03-07T10:24:05.903468+0000","last_clean":"2024-03-07T10:24:05.903468+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:05.903468+0000","last_undegraded":"2024-03-07T10:24:05.903468+0000","last_fullsized":"2024-03-07T10:24:05.903468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047603+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:23:58.047603+0000","last_peered":"2024-03-07T10:23:58.047603+0000","last_clean":"2024-03-07T10:23:58.047603+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:23:58.047603+0000","last_undegraded":"2024-03-07T10:23:58.047603+0000","last_fullsized":"2024-03-07T10:23:58.047603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.023491+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:24:02.023491+0000","last_peered":"2024-03-07T10:24:02.023491+0000","last_clean":"2024-03-07T10:24:02.023491+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:02.023491+0000","last_undegraded":"2024-03-07T10:24:02.023491+0000","last_fullsized":"2024-03-07T10:24:02.023491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047787+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:23:58.047787+0000","last_peered":"2024-03-07T10:23:58.047787+0000","last_clean":"2024-03-07T10:23:58.047787+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:23:58.047787+0000","last_undegraded":"2024-03-07T10:23:58.047787+0000","last_fullsized":"2024-03-07T10:23:58.047787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907310+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:24:05.907310+0000","last_peered":"2024-03-07T10:24:05.907310+0000","last_clean":"2024-03-07T10:24:05.907310+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:05.907310+0000","last_undegraded":"2024-03-07T10:24:05.907310+0000","last_fullsized":"2024-03-07T10:24:05.907310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047898+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:23:58.047898+0000","last_peered":"2024-03-07T10:23:58.047898+0000","last_clean":"2024-03-07T10:23:58.047898+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:23:58.047898+0000","last_undegraded":"2024-03-07T10:23:58.047898+0000","last_fullsized":"2024-03-07T10:23:58.047898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037197+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:23:58.037197+0000","last_peered":"2024-03-07T10:23:58.037197+0000","last_clean":"2024-03-07T10:23:58.037197+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:23:58.037197+0000","last_undegraded":"2024-03-07T10:23:58.037197+0000","last_fullsized":"2024-03-07T10:23:58.037197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020468+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:23:58.020468+0000","last_peered":"2024-03-07T10:23:58.020468+0000","last_clean":"2024-03-07T10:23:58.020468+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:23:58.020468+0000","last_undegraded":"2024-03-07T10:23:58.020468+0000","last_fullsized":"2024-03-07T10:23:58.020468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911873+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:24:05.911873+0000","last_peered":"2024-03-07T10:24:05.911873+0000","last_clean":"2024-03-07T10:24:05.911873+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:05.911873+0000","last_undegraded":"2024-03-07T10:24:05.911873+0000","last_fullsized":"2024-03-07T10:24:05.911873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021748+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:23:58.021748+0000","last_peered":"2024-03-07T10:23:58.021748+0000","last_clean":"2024-03-07T10:23:58.021748+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:23:58.021748+0000","last_undegraded":"2024-03-07T10:23:58.021748+0000","last_fullsized":"2024-03-07T10:23:58.021748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036726+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:23:58.036726+0000","last_peered":"2024-03-07T10:23:58.036726+0000","last_clean":"2024-03-07T10:23:58.036726+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:23:58.036726+0000","last_undegraded":"2024-03-07T10:23:58.036726+0000","last_fullsized":"2024-03-07T10:23:58.036726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019729+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:23:58.019729+0000","last_peered":"2024-03-07T10:23:58.019729+0000","last_clean":"2024-03-07T10:23:58.019729+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:23:58.019729+0000","last_undegraded":"2024-03-07T10:23:58.019729+0000","last_fullsized":"2024-03-07T10:23:58.019729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913110+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:24:05.913110+0000","last_peered":"2024-03-07T10:24:05.913110+0000","last_clean":"2024-03-07T10:24:05.913110+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:05.913110+0000","last_undegraded":"2024-03-07T10:24:05.913110+0000","last_fullsized":"2024-03-07T10:24:05.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024183+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:23:58.024183+0000","last_peered":"2024-03-07T10:23:58.024183+0000","last_clean":"2024-03-07T10:23:58.024183+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:23:58.024183+0000","last_undegraded":"2024-03-07T10:23:58.024183+0000","last_fullsized":"2024-03-07T10:23:58.024183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031695+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:23:58.031695+0000","last_peered":"2024-03-07T10:23:58.031695+0000","last_clean":"2024-03-07T10:23:58.031695+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:23:58.031695+0000","last_undegraded":"2024-03-07T10:23:58.031695+0000","last_fullsized":"2024-03-07T10:23:58.031695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047240+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:23:58.047240+0000","last_peered":"2024-03-07T10:23:58.047240+0000","last_clean":"2024-03-07T10:23:58.047240+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:23:58.047240+0000","last_undegraded":"2024-03-07T10:23:58.047240+0000","last_fullsized":"2024-03-07T10:23:58.047240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905249+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:24:05.905249+0000","last_peered":"2024-03-07T10:24:05.905249+0000","last_clean":"2024-03-07T10:24:05.905249+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:05.905249+0000","last_undegraded":"2024-03-07T10:24:05.905249+0000","last_fullsized":"2024-03-07T10:24:05.905249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021976+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:23:58.021976+0000","last_peered":"2024-03-07T10:23:58.021976+0000","last_clean":"2024-03-07T10:23:58.021976+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:23:58.021976+0000","last_undegraded":"2024-03-07T10:23:58.021976+0000","last_fullsized":"2024-03-07T10:23:58.021976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024972+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:23:58.024972+0000","last_peered":"2024-03-07T10:23:58.024972+0000","last_clean":"2024-03-07T10:23:58.024972+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:23:58.024972+0000","last_undegraded":"2024-03-07T10:23:58.024972+0000","last_fullsized":"2024-03-07T10:23:58.024972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020868+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:23:58.020868+0000","last_peered":"2024-03-07T10:23:58.020868+0000","last_clean":"2024-03-07T10:23:58.020868+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:23:58.020868+0000","last_undegraded":"2024-03-07T10:23:58.020868+0000","last_fullsized":"2024-03-07T10:23:58.020868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904960+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:24:05.904960+0000","last_peered":"2024-03-07T10:24:05.904960+0000","last_clean":"2024-03-07T10:24:05.904960+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:05.904960+0000","last_undegraded":"2024-03-07T10:24:05.904960+0000","last_fullsized":"2024-03-07T10:24:05.904960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025874+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:23:58.025874+0000","last_peered":"2024-03-07T10:23:58.025874+0000","last_clean":"2024-03-07T10:23:58.025874+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:23:58.025874+0000","last_undegraded":"2024-03-07T10:23:58.025874+0000","last_fullsized":"2024-03-07T10:23:58.025874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024476+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:23:58.024476+0000","last_peered":"2024-03-07T10:23:58.024476+0000","last_clean":"2024-03-07T10:23:58.024476+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:23:58.024476+0000","last_undegraded":"2024-03-07T10:23:58.024476+0000","last_fullsized":"2024-03-07T10:23:58.024476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019285+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:23:58.019285+0000","last_peered":"2024-03-07T10:23:58.019285+0000","last_clean":"2024-03-07T10:23:58.019285+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:23:58.019285+0000","last_undegraded":"2024-03-07T10:23:58.019285+0000","last_fullsized":"2024-03-07T10:23:58.019285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905323+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:24:05.905323+0000","last_peered":"2024-03-07T10:24:05.905323+0000","last_clean":"2024-03-07T10:24:05.905323+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:05.905323+0000","last_undegraded":"2024-03-07T10:24:05.905323+0000","last_fullsized":"2024-03-07T10:24:05.905323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019013+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:23:58.019013+0000","last_peered":"2024-03-07T10:23:58.019013+0000","last_clean":"2024-03-07T10:23:58.019013+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:23:58.019013+0000","last_undegraded":"2024-03-07T10:23:58.019013+0000","last_fullsized":"2024-03-07T10:23:58.019013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030524+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:23:58.030524+0000","last_peered":"2024-03-07T10:23:58.030524+0000","last_clean":"2024-03-07T10:23:58.030524+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:23:58.030524+0000","last_undegraded":"2024-03-07T10:23:58.030524+0000","last_fullsized":"2024-03-07T10:23:58.030524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026481+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:23:58.026481+0000","last_peered":"2024-03-07T10:23:58.026481+0000","last_clean":"2024-03-07T10:23:58.026481+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:23:58.026481+0000","last_undegraded":"2024-03-07T10:23:58.026481+0000","last_fullsized":"2024-03-07T10:23:58.026481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908498+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:24:05.908498+0000","last_peered":"2024-03-07T10:24:05.908498+0000","last_clean":"2024-03-07T10:24:05.908498+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:05.908498+0000","last_undegraded":"2024-03-07T10:24:05.908498+0000","last_fullsized":"2024-03-07T10:24:05.908498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036847+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:23:58.036847+0000","last_peered":"2024-03-07T10:23:58.036847+0000","last_clean":"2024-03-07T10:23:58.036847+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:23:58.036847+0000","last_undegraded":"2024-03-07T10:23:58.036847+0000","last_fullsized":"2024-03-07T10:23:58.036847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019400+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:23:58.019400+0000","last_peered":"2024-03-07T10:23:58.019400+0000","last_clean":"2024-03-07T10:23:58.019400+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:23:58.019400+0000","last_undegraded":"2024-03-07T10:23:58.019400+0000","last_fullsized":"2024-03-07T10:23:58.019400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026935+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:23:58.026935+0000","last_peered":"2024-03-07T10:23:58.026935+0000","last_clean":"2024-03-07T10:23:58.026935+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:23:58.026935+0000","last_undegraded":"2024-03-07T10:23:58.026935+0000","last_fullsized":"2024-03-07T10:23:58.026935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906429+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:24:05.906429+0000","last_peered":"2024-03-07T10:24:05.906429+0000","last_clean":"2024-03-07T10:24:05.906429+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:05.906429+0000","last_undegraded":"2024-03-07T10:24:05.906429+0000","last_fullsized":"2024-03-07T10:24:05.906429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026621+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:23:58.026621+0000","last_peered":"2024-03-07T10:23:58.026621+0000","last_clean":"2024-03-07T10:23:58.026621+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:23:58.026621+0000","last_undegraded":"2024-03-07T10:23:58.026621+0000","last_fullsized":"2024-03-07T10:23:58.026621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.512699+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:24:02.512699+0000","last_peered":"2024-03-07T10:24:02.512699+0000","last_clean":"2024-03-07T10:24:02.512699+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:02.512699+0000","last_undegraded":"2024-03-07T10:24:02.512699+0000","last_fullsized":"2024-03-07T10:24:02.512699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39899,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":28,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016723+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:23:58.016723+0000","last_peered":"2024-03-07T10:23:58.016723+0000","last_clean":"2024-03-07T10:23:58.016723+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:23:58.016723+0000","last_undegraded":"2024-03-07T10:23:58.016723+0000","last_fullsized":"2024-03-07T10:23:58.016723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903527+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:24:05.903527+0000","last_peered":"2024-03-07T10:24:05.903527+0000","last_clean":"2024-03-07T10:24:05.903527+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:05.903527+0000","last_undegraded":"2024-03-07T10:24:05.903527+0000","last_fullsized":"2024-03-07T10:24:05.903527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031125+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:23:58.031125+0000","last_peered":"2024-03-07T10:23:58.031125+0000","last_clean":"2024-03-07T10:23:58.031125+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:23:58.031125+0000","last_undegraded":"2024-03-07T10:23:58.031125+0000","last_fullsized":"2024-03-07T10:23:58.031125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.030282+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:24:01.030282+0000","last_peered":"2024-03-07T10:24:01.030282+0000","last_clean":"2024-03-07T10:24:01.030282+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:01.030282+0000","last_undegraded":"2024-03-07T10:24:01.030282+0000","last_fullsized":"2024-03-07T10:24:01.030282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017016+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:23:58.017016+0000","last_peered":"2024-03-07T10:23:58.017016+0000","last_clean":"2024-03-07T10:23:58.017016+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:23:58.017016+0000","last_undegraded":"2024-03-07T10:23:58.017016+0000","last_fullsized":"2024-03-07T10:23:58.017016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901641+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:24:05.901641+0000","last_peered":"2024-03-07T10:24:05.901641+0000","last_clean":"2024-03-07T10:24:05.901641+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:05.901641+0000","last_undegraded":"2024-03-07T10:24:05.901641+0000","last_fullsized":"2024-03-07T10:24:05.901641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.845529+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:24:05.845529+0000","last_peered":"2024-03-07T10:24:05.845529+0000","last_clean":"2024-03-07T10:24:05.845529+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:05.845529+0000","last_undegraded":"2024-03-07T10:24:05.845529+0000","last_fullsized":"2024-03-07T10:24:05.845529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021023+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:23:58.021023+0000","last_peered":"2024-03-07T10:23:58.021023+0000","last_clean":"2024-03-07T10:23:58.021023+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:23:58.021023+0000","last_undegraded":"2024-03-07T10:23:58.021023+0000","last_fullsized":"2024-03-07T10:23:58.021023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021596+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:23:58.021596+0000","last_peered":"2024-03-07T10:23:58.021596+0000","last_clean":"2024-03-07T10:23:58.021596+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:23:58.021596+0000","last_undegraded":"2024-03-07T10:23:58.021596+0000","last_fullsized":"2024-03-07T10:23:58.021596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902224+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:24:05.902224+0000","last_peered":"2024-03-07T10:24:05.902224+0000","last_clean":"2024-03-07T10:24:05.902224+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:05.902224+0000","last_undegraded":"2024-03-07T10:24:05.902224+0000","last_fullsized":"2024-03-07T10:24:05.902224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024117+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:23:58.024117+0000","last_peered":"2024-03-07T10:23:58.024117+0000","last_clean":"2024-03-07T10:23:58.024117+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:23:58.024117+0000","last_undegraded":"2024-03-07T10:23:58.024117+0000","last_fullsized":"2024-03-07T10:23:58.024117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026448+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:23:58.026448+0000","last_peered":"2024-03-07T10:23:58.026448+0000","last_clean":"2024-03-07T10:23:58.026448+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:23:58.026448+0000","last_undegraded":"2024-03-07T10:23:58.026448+0000","last_fullsized":"2024-03-07T10:23:58.026448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036723+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:23:58.036723+0000","last_peered":"2024-03-07T10:23:58.036723+0000","last_clean":"2024-03-07T10:23:58.036723+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:23:58.036723+0000","last_undegraded":"2024-03-07T10:23:58.036723+0000","last_fullsized":"2024-03-07T10:23:58.036723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908330+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:24:05.908330+0000","last_peered":"2024-03-07T10:24:05.908330+0000","last_clean":"2024-03-07T10:24:05.908330+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:05.908330+0000","last_undegraded":"2024-03-07T10:24:05.908330+0000","last_fullsized":"2024-03-07T10:24:05.908330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027480+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:23:58.027480+0000","last_peered":"2024-03-07T10:23:58.027480+0000","last_clean":"2024-03-07T10:23:58.027480+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:23:58.027480+0000","last_undegraded":"2024-03-07T10:23:58.027480+0000","last_fullsized":"2024-03-07T10:23:58.027480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.043454+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:24:01.043454+0000","last_peered":"2024-03-07T10:24:01.043454+0000","last_clean":"2024-03-07T10:24:01.043454+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:01.043454+0000","last_undegraded":"2024-03-07T10:24:01.043454+0000","last_fullsized":"2024-03-07T10:24:01.043454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047262+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:23:58.047262+0000","last_peered":"2024-03-07T10:23:58.047262+0000","last_clean":"2024-03-07T10:23:58.047262+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:23:58.047262+0000","last_undegraded":"2024-03-07T10:23:58.047262+0000","last_fullsized":"2024-03-07T10:23:58.047262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901905+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:24:05.901905+0000","last_peered":"2024-03-07T10:24:05.901905+0000","last_clean":"2024-03-07T10:24:05.901905+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:05.901905+0000","last_undegraded":"2024-03-07T10:24:05.901905+0000","last_fullsized":"2024-03-07T10:24:05.901905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037698+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:23:58.037698+0000","last_peered":"2024-03-07T10:23:58.037698+0000","last_clean":"2024-03-07T10:23:58.037698+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:23:58.037698+0000","last_undegraded":"2024-03-07T10:23:58.037698+0000","last_fullsized":"2024-03-07T10:23:58.037698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015385+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:23:58.015385+0000","last_peered":"2024-03-07T10:23:58.015385+0000","last_clean":"2024-03-07T10:23:58.015385+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:23:58.015385+0000","last_undegraded":"2024-03-07T10:23:58.015385+0000","last_fullsized":"2024-03-07T10:23:58.015385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037601+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:23:58.037601+0000","last_peered":"2024-03-07T10:23:58.037601+0000","last_clean":"2024-03-07T10:23:58.037601+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:23:58.037601+0000","last_undegraded":"2024-03-07T10:23:58.037601+0000","last_fullsized":"2024-03-07T10:23:58.037601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030304+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:23:58.030304+0000","last_peered":"2024-03-07T10:23:58.030304+0000","last_clean":"2024-03-07T10:23:58.030304+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:23:58.030304+0000","last_undegraded":"2024-03-07T10:23:58.030304+0000","last_fullsized":"2024-03-07T10:23:58.030304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910547+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:24:05.910547+0000","last_peered":"2024-03-07T10:24:05.910547+0000","last_clean":"2024-03-07T10:24:05.910547+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:05.910547+0000","last_undegraded":"2024-03-07T10:24:05.910547+0000","last_fullsized":"2024-03-07T10:24:05.910547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025312+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:23:58.025312+0000","last_peered":"2024-03-07T10:23:58.025312+0000","last_clean":"2024-03-07T10:23:58.025312+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:23:58.025312+0000","last_undegraded":"2024-03-07T10:23:58.025312+0000","last_fullsized":"2024-03-07T10:23:58.025312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030072+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:23:58.030072+0000","last_peered":"2024-03-07T10:23:58.030072+0000","last_clean":"2024-03-07T10:23:58.030072+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:23:58.030072+0000","last_undegraded":"2024-03-07T10:23:58.030072+0000","last_fullsized":"2024-03-07T10:23:58.030072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.044936+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:23:58.044936+0000","last_peered":"2024-03-07T10:23:58.044936+0000","last_clean":"2024-03-07T10:23:58.044936+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:23:58.044936+0000","last_undegraded":"2024-03-07T10:23:58.044936+0000","last_fullsized":"2024-03-07T10:23:58.044936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911084+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:24:05.911084+0000","last_peered":"2024-03-07T10:24:05.911084+0000","last_clean":"2024-03-07T10:24:05.911084+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:05.911084+0000","last_undegraded":"2024-03-07T10:24:05.911084+0000","last_fullsized":"2024-03-07T10:24:05.911084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016397+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:23:58.016397+0000","last_peered":"2024-03-07T10:23:58.016397+0000","last_clean":"2024-03-07T10:23:58.016397+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:23:58.016397+0000","last_undegraded":"2024-03-07T10:23:58.016397+0000","last_fullsized":"2024-03-07T10:23:58.016397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023755+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:23:58.023755+0000","last_peered":"2024-03-07T10:23:58.023755+0000","last_clean":"2024-03-07T10:23:58.023755+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:23:58.023755+0000","last_undegraded":"2024-03-07T10:23:58.023755+0000","last_fullsized":"2024-03-07T10:23:58.023755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037173+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:23:58.037173+0000","last_peered":"2024-03-07T10:23:58.037173+0000","last_clean":"2024-03-07T10:23:58.037173+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:23:58.037173+0000","last_undegraded":"2024-03-07T10:23:58.037173+0000","last_fullsized":"2024-03-07T10:23:58.037173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910066+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:24:05.910066+0000","last_peered":"2024-03-07T10:24:05.910066+0000","last_clean":"2024-03-07T10:24:05.910066+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:05.910066+0000","last_undegraded":"2024-03-07T10:24:05.910066+0000","last_fullsized":"2024-03-07T10:24:05.910066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.035701+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:24:01.035701+0000","last_peered":"2024-03-07T10:24:01.035701+0000","last_clean":"2024-03-07T10:24:01.035701+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:01.035701+0000","last_undegraded":"2024-03-07T10:24:01.035701+0000","last_fullsized":"2024-03-07T10:24:01.035701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025302+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:23:58.025302+0000","last_peered":"2024-03-07T10:23:58.025302+0000","last_clean":"2024-03-07T10:23:58.025302+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:23:58.025302+0000","last_undegraded":"2024-03-07T10:23:58.025302+0000","last_fullsized":"2024-03-07T10:23:58.025302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017526+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:23:58.017526+0000","last_peered":"2024-03-07T10:23:58.017526+0000","last_clean":"2024-03-07T10:23:58.017526+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:23:58.017526+0000","last_undegraded":"2024-03-07T10:23:58.017526+0000","last_fullsized":"2024-03-07T10:23:58.017526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.890051+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:24:05.890051+0000","last_peered":"2024-03-07T10:24:05.890051+0000","last_clean":"2024-03-07T10:24:05.890051+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:05.890051+0000","last_undegraded":"2024-03-07T10:24:05.890051+0000","last_fullsized":"2024-03-07T10:24:05.890051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.031368+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:24:01.031368+0000","last_peered":"2024-03-07T10:24:01.031368+0000","last_clean":"2024-03-07T10:24:01.031368+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:01.031368+0000","last_undegraded":"2024-03-07T10:24:01.031368+0000","last_fullsized":"2024-03-07T10:24:01.031368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020470+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:23:58.020470+0000","last_peered":"2024-03-07T10:23:58.020470+0000","last_clean":"2024-03-07T10:23:58.020470+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:23:58.020470+0000","last_undegraded":"2024-03-07T10:23:58.020470+0000","last_fullsized":"2024-03-07T10:23:58.020470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912772+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:24:05.912772+0000","last_peered":"2024-03-07T10:24:05.912772+0000","last_clean":"2024-03-07T10:24:05.912772+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:05.912772+0000","last_undegraded":"2024-03-07T10:24:05.912772+0000","last_fullsized":"2024-03-07T10:24:05.912772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023010+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:23:58.023010+0000","last_peered":"2024-03-07T10:23:58.023010+0000","last_clean":"2024-03-07T10:23:58.023010+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:23:58.023010+0000","last_undegraded":"2024-03-07T10:23:58.023010+0000","last_fullsized":"2024-03-07T10:23:58.023010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.888725+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:24:05.888725+0000","last_peered":"2024-03-07T10:24:05.888725+0000","last_clean":"2024-03-07T10:24:05.888725+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:05.888725+0000","last_undegraded":"2024-03-07T10:24:05.888725+0000","last_fullsized":"2024-03-07T10:24:05.888725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027030+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:23:58.027030+0000","last_peered":"2024-03-07T10:23:58.027030+0000","last_clean":"2024-03-07T10:23:58.027030+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:23:58.027030+0000","last_undegraded":"2024-03-07T10:23:58.027030+0000","last_fullsized":"2024-03-07T10:23:58.027030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912442+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:24:05.912442+0000","last_peered":"2024-03-07T10:24:05.912442+0000","last_clean":"2024-03-07T10:24:05.912442+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:05.912442+0000","last_undegraded":"2024-03-07T10:24:05.912442+0000","last_fullsized":"2024-03-07T10:24:05.912442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023651+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:23:58.023651+0000","last_peered":"2024-03-07T10:23:58.023651+0000","last_clean":"2024-03-07T10:23:58.023651+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:23:58.023651+0000","last_undegraded":"2024-03-07T10:23:58.023651+0000","last_fullsized":"2024-03-07T10:23:58.023651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905520+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:24:05.905520+0000","last_peered":"2024-03-07T10:24:05.905520+0000","last_clean":"2024-03-07T10:24:05.905520+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:05.905520+0000","last_undegraded":"2024-03-07T10:24:05.905520+0000","last_fullsized":"2024-03-07T10:24:05.905520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047336+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:23:58.047336+0000","last_peered":"2024-03-07T10:23:58.047336+0000","last_clean":"2024-03-07T10:23:58.047336+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:23:58.047336+0000","last_undegraded":"2024-03-07T10:23:58.047336+0000","last_fullsized":"2024-03-07T10:23:58.047336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905368+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:24:05.905368+0000","last_peered":"2024-03-07T10:24:05.905368+0000","last_clean":"2024-03-07T10:24:05.905368+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:05.905368+0000","last_undegraded":"2024-03-07T10:24:05.905368+0000","last_fullsized":"2024-03-07T10:24:05.905368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024979+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:23:58.024979+0000","last_peered":"2024-03-07T10:23:58.024979+0000","last_clean":"2024-03-07T10:23:58.024979+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:23:58.024979+0000","last_undegraded":"2024-03-07T10:23:58.024979+0000","last_fullsized":"2024-03-07T10:23:58.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907474+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:24:05.907474+0000","last_peered":"2024-03-07T10:24:05.907474+0000","last_clean":"2024-03-07T10:24:05.907474+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:05.907474+0000","last_undegraded":"2024-03-07T10:24:05.907474+0000","last_fullsized":"2024-03-07T10:24:05.907474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047223+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:23:58.047223+0000","last_peered":"2024-03-07T10:23:58.047223+0000","last_clean":"2024-03-07T10:23:58.047223+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:23:58.047223+0000","last_undegraded":"2024-03-07T10:23:58.047223+0000","last_fullsized":"2024-03-07T10:23:58.047223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907491+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:24:05.907491+0000","last_peered":"2024-03-07T10:24:05.907491+0000","last_clean":"2024-03-07T10:24:05.907491+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:05.907491+0000","last_undegraded":"2024-03-07T10:24:05.907491+0000","last_fullsized":"2024-03-07T10:24:05.907491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036645+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:23:58.036645+0000","last_peered":"2024-03-07T10:23:58.036645+0000","last_clean":"2024-03-07T10:23:58.036645+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:23:58.036645+0000","last_undegraded":"2024-03-07T10:23:58.036645+0000","last_fullsized":"2024-03-07T10:23:58.036645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.884818+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:24:05.884818+0000","last_peered":"2024-03-07T10:24:05.884818+0000","last_clean":"2024-03-07T10:24:05.884818+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:05.884818+0000","last_undegraded":"2024-03-07T10:24:05.884818+0000","last_fullsized":"2024-03-07T10:24:05.884818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020310+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:23:58.020310+0000","last_peered":"2024-03-07T10:23:58.020310+0000","last_clean":"2024-03-07T10:23:58.020310+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:23:58.020310+0000","last_undegraded":"2024-03-07T10:23:58.020310+0000","last_fullsized":"2024-03-07T10:23:58.020310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.889451+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:24:05.889451+0000","last_peered":"2024-03-07T10:24:05.889451+0000","last_clean":"2024-03-07T10:24:05.889451+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:05.889451+0000","last_undegraded":"2024-03-07T10:24:05.889451+0000","last_fullsized":"2024-03-07T10:24:05.889451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048487+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:23:58.048487+0000","last_peered":"2024-03-07T10:23:58.048487+0000","last_clean":"2024-03-07T10:23:58.048487+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:23:58.048487+0000","last_undegraded":"2024-03-07T10:23:58.048487+0000","last_fullsized":"2024-03-07T10:23:58.048487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910340+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:24:05.910340+0000","last_peered":"2024-03-07T10:24:05.910340+0000","last_clean":"2024-03-07T10:24:05.910340+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:05.910340+0000","last_undegraded":"2024-03-07T10:24:05.910340+0000","last_fullsized":"2024-03-07T10:24:05.910340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021108+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:23:58.021108+0000","last_peered":"2024-03-07T10:23:58.021108+0000","last_clean":"2024-03-07T10:23:58.021108+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:23:58.021108+0000","last_undegraded":"2024-03-07T10:23:58.021108+0000","last_fullsized":"2024-03-07T10:23:58.021108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.900198+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:24:05.900198+0000","last_peered":"2024-03-07T10:24:05.900198+0000","last_clean":"2024-03-07T10:24:05.900198+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:05.900198+0000","last_undegraded":"2024-03-07T10:24:05.900198+0000","last_fullsized":"2024-03-07T10:24:05.900198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018065+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:23:58.018065+0000","last_peered":"2024-03-07T10:23:58.018065+0000","last_clean":"2024-03-07T10:23:58.018065+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:23:58.018065+0000","last_undegraded":"2024-03-07T10:23:58.018065+0000","last_fullsized":"2024-03-07T10:23:58.018065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911579+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:24:05.911579+0000","last_peered":"2024-03-07T10:24:05.911579+0000","last_clean":"2024-03-07T10:24:05.911579+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:05.911579+0000","last_undegraded":"2024-03-07T10:24:05.911579+0000","last_fullsized":"2024-03-07T10:24:05.911579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024597+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:23:58.024597+0000","last_peered":"2024-03-07T10:23:58.024597+0000","last_clean":"2024-03-07T10:23:58.024597+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:23:58.024597+0000","last_undegraded":"2024-03-07T10:23:58.024597+0000","last_fullsized":"2024-03-07T10:23:58.024597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907976+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:24:05.907976+0000","last_peered":"2024-03-07T10:24:05.907976+0000","last_clean":"2024-03-07T10:24:05.907976+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:05.907976+0000","last_undegraded":"2024-03-07T10:24:05.907976+0000","last_fullsized":"2024-03-07T10:24:05.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024868+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:23:58.024868+0000","last_peered":"2024-03-07T10:23:58.024868+0000","last_clean":"2024-03-07T10:23:58.024868+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:23:58.024868+0000","last_undegraded":"2024-03-07T10:23:58.024868+0000","last_fullsized":"2024-03-07T10:23:58.024868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893801+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:24:05.893801+0000","last_peered":"2024-03-07T10:24:05.893801+0000","last_clean":"2024-03-07T10:24:05.893801+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:05.893801+0000","last_undegraded":"2024-03-07T10:24:05.893801+0000","last_fullsized":"2024-03-07T10:24:05.893801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025108+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:23:58.025108+0000","last_peered":"2024-03-07T10:23:58.025108+0000","last_clean":"2024-03-07T10:23:58.025108+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:23:58.025108+0000","last_undegraded":"2024-03-07T10:23:58.025108+0000","last_fullsized":"2024-03-07T10:23:58.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.895901+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:24:05.895901+0000","last_peered":"2024-03-07T10:24:05.895901+0000","last_clean":"2024-03-07T10:24:05.895901+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:05.895901+0000","last_undegraded":"2024-03-07T10:24:05.895901+0000","last_fullsized":"2024-03-07T10:24:05.895901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029175+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:23:58.029175+0000","last_peered":"2024-03-07T10:23:58.029175+0000","last_clean":"2024-03-07T10:23:58.029175+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:23:58.029175+0000","last_undegraded":"2024-03-07T10:23:58.029175+0000","last_fullsized":"2024-03-07T10:23:58.029175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.898971+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:24:05.898971+0000","last_peered":"2024-03-07T10:24:05.898971+0000","last_clean":"2024-03-07T10:24:05.898971+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:05.898971+0000","last_undegraded":"2024-03-07T10:24:05.898971+0000","last_fullsized":"2024-03-07T10:24:05.898971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023002+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:23:58.023002+0000","last_peered":"2024-03-07T10:23:58.023002+0000","last_clean":"2024-03-07T10:23:58.023002+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:23:58.023002+0000","last_undegraded":"2024-03-07T10:23:58.023002+0000","last_fullsized":"2024-03-07T10:23:58.023002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911103+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:24:05.911103+0000","last_peered":"2024-03-07T10:24:05.911103+0000","last_clean":"2024-03-07T10:24:05.911103+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:05.911103+0000","last_undegraded":"2024-03-07T10:24:05.911103+0000","last_fullsized":"2024-03-07T10:24:05.911103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025459+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:23:58.025459+0000","last_peered":"2024-03-07T10:23:58.025459+0000","last_clean":"2024-03-07T10:23:58.025459+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:23:58.025459+0000","last_undegraded":"2024-03-07T10:23:58.025459+0000","last_fullsized":"2024-03-07T10:23:58.025459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.883013+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:24:05.883013+0000","last_peered":"2024-03-07T10:24:05.883013+0000","last_clean":"2024-03-07T10:24:05.883013+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:05.883013+0000","last_undegraded":"2024-03-07T10:24:05.883013+0000","last_fullsized":"2024-03-07T10:24:05.883013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026942+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:23:58.026942+0000","last_peered":"2024-03-07T10:23:58.026942+0000","last_clean":"2024-03-07T10:23:58.026942+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:23:58.026942+0000","last_undegraded":"2024-03-07T10:23:58.026942+0000","last_fullsized":"2024-03-07T10:23:58.026942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905219+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:24:05.905219+0000","last_peered":"2024-03-07T10:24:05.905219+0000","last_clean":"2024-03-07T10:24:05.905219+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:05.905219+0000","last_undegraded":"2024-03-07T10:24:05.905219+0000","last_fullsized":"2024-03-07T10:24:05.905219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048174+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:23:58.048174+0000","last_peered":"2024-03-07T10:23:58.048174+0000","last_clean":"2024-03-07T10:23:58.048174+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:23:58.048174+0000","last_undegraded":"2024-03-07T10:23:58.048174+0000","last_fullsized":"2024-03-07T10:23:58.048174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905669+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:24:05.905669+0000","last_peered":"2024-03-07T10:24:05.905669+0000","last_clean":"2024-03-07T10:24:05.905669+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:05.905669+0000","last_undegraded":"2024-03-07T10:24:05.905669+0000","last_fullsized":"2024-03-07T10:24:05.905669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016530+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:23:58.016530+0000","last_peered":"2024-03-07T10:23:58.016530+0000","last_clean":"2024-03-07T10:23:58.016530+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:23:58.016530+0000","last_undegraded":"2024-03-07T10:23:58.016530+0000","last_fullsized":"2024-03-07T10:23:58.016530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906195+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:24:05.906195+0000","last_peered":"2024-03-07T10:24:05.906195+0000","last_clean":"2024-03-07T10:24:05.906195+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:05.906195+0000","last_undegraded":"2024-03-07T10:24:05.906195+0000","last_fullsized":"2024-03-07T10:24:05.906195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020179+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:23:58.020179+0000","last_peered":"2024-03-07T10:23:58.020179+0000","last_clean":"2024-03-07T10:23:58.020179+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:23:58.020179+0000","last_undegraded":"2024-03-07T10:23:58.020179+0000","last_fullsized":"2024-03-07T10:23:58.020179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.914163+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:24:05.914163+0000","last_peered":"2024-03-07T10:24:05.914163+0000","last_clean":"2024-03-07T10:24:05.914163+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:05.914163+0000","last_undegraded":"2024-03-07T10:24:05.914163+0000","last_fullsized":"2024-03-07T10:24:05.914163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047776+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:23:58.047776+0000","last_peered":"2024-03-07T10:23:58.047776+0000","last_clean":"2024-03-07T10:23:58.047776+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:23:58.047776+0000","last_undegraded":"2024-03-07T10:23:58.047776+0000","last_fullsized":"2024-03-07T10:23:58.047776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.915299+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:24:05.915299+0000","last_peered":"2024-03-07T10:24:05.915299+0000","last_clean":"2024-03-07T10:24:05.915299+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:05.915299+0000","last_undegraded":"2024-03-07T10:24:05.915299+0000","last_fullsized":"2024-03-07T10:24:05.915299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025799+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:23:58.025799+0000","last_peered":"2024-03-07T10:23:58.025799+0000","last_clean":"2024-03-07T10:23:58.025799+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:23:58.025799+0000","last_undegraded":"2024-03-07T10:23:58.025799+0000","last_fullsized":"2024-03-07T10:23:58.025799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910637+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:24:05.910637+0000","last_peered":"2024-03-07T10:24:05.910637+0000","last_clean":"2024-03-07T10:24:05.910637+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:05.910637+0000","last_undegraded":"2024-03-07T10:24:05.910637+0000","last_fullsized":"2024-03-07T10:24:05.910637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020148+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:23:58.020148+0000","last_peered":"2024-03-07T10:23:58.020148+0000","last_clean":"2024-03-07T10:23:58.020148+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:23:58.020148+0000","last_undegraded":"2024-03-07T10:23:58.020148+0000","last_fullsized":"2024-03-07T10:23:58.020148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911655+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:24:05.911655+0000","last_peered":"2024-03-07T10:24:05.911655+0000","last_clean":"2024-03-07T10:24:05.911655+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:05.911655+0000","last_undegraded":"2024-03-07T10:24:05.911655+0000","last_fullsized":"2024-03-07T10:24:05.911655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037509+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:23:58.037509+0000","last_peered":"2024-03-07T10:23:58.037509+0000","last_clean":"2024-03-07T10:23:58.037509+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:23:58.037509+0000","last_undegraded":"2024-03-07T10:23:58.037509+0000","last_fullsized":"2024-03-07T10:23:58.037509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912205+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:24:05.912205+0000","last_peered":"2024-03-07T10:24:05.912205+0000","last_clean":"2024-03-07T10:24:05.912205+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:05.912205+0000","last_undegraded":"2024-03-07T10:24:05.912205+0000","last_fullsized":"2024-03-07T10:24:05.912205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018365+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:23:58.018365+0000","last_peered":"2024-03-07T10:23:58.018365+0000","last_clean":"2024-03-07T10:23:58.018365+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:23:58.018365+0000","last_undegraded":"2024-03-07T10:23:58.018365+0000","last_fullsized":"2024-03-07T10:23:58.018365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911281+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:24:05.911281+0000","last_peered":"2024-03-07T10:24:05.911281+0000","last_clean":"2024-03-07T10:24:05.911281+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:05.911281+0000","last_undegraded":"2024-03-07T10:24:05.911281+0000","last_fullsized":"2024-03-07T10:24:05.911281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027137+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:23:58.027137+0000","last_peered":"2024-03-07T10:23:58.027137+0000","last_clean":"2024-03-07T10:23:58.027137+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:23:58.027137+0000","last_undegraded":"2024-03-07T10:23:58.027137+0000","last_fullsized":"2024-03-07T10:23:58.027137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.887465+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:24:05.887465+0000","last_peered":"2024-03-07T10:24:05.887465+0000","last_clean":"2024-03-07T10:24:05.887465+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:05.887465+0000","last_undegraded":"2024-03-07T10:24:05.887465+0000","last_fullsized":"2024-03-07T10:24:05.887465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015194+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:23:58.015194+0000","last_peered":"2024-03-07T10:23:58.015194+0000","last_clean":"2024-03-07T10:23:58.015194+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:23:58.015194+0000","last_undegraded":"2024-03-07T10:23:58.015194+0000","last_fullsized":"2024-03-07T10:23:58.015194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913448+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:24:05.913448+0000","last_peered":"2024-03-07T10:24:05.913448+0000","last_clean":"2024-03-07T10:24:05.913448+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:05.913448+0000","last_undegraded":"2024-03-07T10:24:05.913448+0000","last_fullsized":"2024-03-07T10:24:05.913448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019986+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:23:58.019986+0000","last_peered":"2024-03-07T10:23:58.019986+0000","last_clean":"2024-03-07T10:23:58.019986+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:23:58.019986+0000","last_undegraded":"2024-03-07T10:23:58.019986+0000","last_fullsized":"2024-03-07T10:23:58.019986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909442+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:24:05.909442+0000","last_peered":"2024-03-07T10:24:05.909442+0000","last_clean":"2024-03-07T10:24:05.909442+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:05.909442+0000","last_undegraded":"2024-03-07T10:24:05.909442+0000","last_fullsized":"2024-03-07T10:24:05.909442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047140+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:23:58.047140+0000","last_peered":"2024-03-07T10:23:58.047140+0000","last_clean":"2024-03-07T10:23:58.047140+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:23:58.047140+0000","last_undegraded":"2024-03-07T10:23:58.047140+0000","last_fullsized":"2024-03-07T10:23:58.047140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893171+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:24:05.893171+0000","last_peered":"2024-03-07T10:24:05.893171+0000","last_clean":"2024-03-07T10:24:05.893171+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:05.893171+0000","last_undegraded":"2024-03-07T10:24:05.893171+0000","last_fullsized":"2024-03-07T10:24:05.893171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047261+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:23:58.047261+0000","last_peered":"2024-03-07T10:23:58.047261+0000","last_clean":"2024-03-07T10:23:58.047261+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:23:58.047261+0000","last_undegraded":"2024-03-07T10:23:58.047261+0000","last_fullsized":"2024-03-07T10:23:58.047261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907990+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:24:05.907990+0000","last_peered":"2024-03-07T10:24:05.907990+0000","last_clean":"2024-03-07T10:24:05.907990+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:05.907990+0000","last_undegraded":"2024-03-07T10:24:05.907990+0000","last_fullsized":"2024-03-07T10:24:05.907990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":41000,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":157,"num_read_kb":199,"num_write":90,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":82000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":134893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":212696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":174441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:24:10.466 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:24:10.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.712+0000 7fbe3a800640 1 Processor -- start 2024-03-07T10:24:10.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.712+0000 7fbe3a800640 1 -- start start 2024-03-07T10:24:10.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.713+0000 7fbe3a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe340a8df0 0x7fbe3406c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.713+0000 7fbe3a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe3406c5d0 0x7fbe34158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.713+0000 7fbe3a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe34153160 con 0x7fbe34152d80 2024-03-07T10:24:10.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.713+0000 7fbe3a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3406f7a0 con 0x7fbe340a8df0 2024-03-07T10:24:10.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.713+0000 7fbe3a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c2bd0 con 0x7fbe3406c5d0 2024-03-07T10:24:10.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe32a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe340a8df0 0x7fbe3406c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe33400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fbe34152d80 0x7fbe34066eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42974/0 (socket says 172.21.15.194:42974) 2024-03-07T10:24:10.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe33400640 1 -- 172.21.15.194:0/1792645671 learned_addr learned my addr 172.21.15.194:0/1792645671 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:10.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe33e00640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe3406c5d0 0x7fbe34158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe32a00640 1 -- 172.21.15.194:0/1792645671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe3406c5d0 msgr2=0x7fbe34158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe32a00640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe3406c5d0 0x7fbe34158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.714+0000 7fbe32a00640 1 -- 172.21.15.194:0/1792645671 >> v1:172.21.15.194:6789/0 conn(0x7fbe34152d80 legacy=0x7fbe34066eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.715+0000 7fbe32a00640 1 -- 172.21.15.194:0/1792645671 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3406f9f0 con 0x7fbe340a8df0 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.715+0000 7fbe32000640 1 -- 172.21.15.194:0/1792645671 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630177452 0 0) 0x7fbe24001110 con 0x7fbe34152d80 2024-03-07T10:24:10.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.716+0000 7fbe32a00640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe340a8df0 0x7fbe3406c090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe200097a0 tx=0x7fbe2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7fdff5a2925f71 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe32000640 1 -- 172.21.15.194:0/1792645671 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200315a0 con 0x7fbe340a8df0 2024-03-07T10:24:10.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe32000640 1 -- 172.21.15.194:0/1792645671 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe20037070 con 0x7fbe340a8df0 2024-03-07T10:24:10.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe32000640 1 -- 172.21.15.194:0/1792645671 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20031960 con 0x7fbe340a8df0 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 -- 172.21.15.194:0/1792645671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe340a8df0 msgr2=0x7fbe3406c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe340a8df0 0x7fbe3406c090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbe200097a0 tx=0x7fbe2002b840 comp rx=0 tx=0).stop 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 -- 172.21.15.194:0/1792645671 shutdown_connections 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe3406c5d0 0x7fbe34158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 --2- 172.21.15.194:0/1792645671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe340a8df0 0x7fbe3406c090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 -- 172.21.15.194:0/1792645671 >> 172.21.15.194:0/1792645671 conn(0x7fbe340c41a0 msgr2=0x7fbe340c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 -- 172.21.15.194:0/1792645671 shutdown_connections 2024-03-07T10:24:10.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.717+0000 7fbe3a800640 1 -- 172.21.15.194:0/1792645671 wait complete. 2024-03-07T10:24:10.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.719+0000 7fbe3a800640 1 Processor -- start 2024-03-07T10:24:10.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.719+0000 7fbe3a800640 1 -- start start 2024-03-07T10:24:10.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.721 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe340a8df0 0x7fbe341ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 0x7fbe3414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c2860 con 0x7fbe3406c5d0 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe340c2580 con 0x7fbe340a8df0 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe3a800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe34159230 con 0x7fbe34152d80 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe33400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe33400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60796/0 (socket says 172.21.15.194:60796) 2024-03-07T10:24:10.722 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.720+0000 7fbe33400640 1 -- 172.21.15.194:0/36590195 learned_addr learned my addr 172.21.15.194:0/36590195 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:10.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33e00640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 0x7fbe3414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.723 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe32a00640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe340a8df0 0x7fbe341ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 -- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 msgr2=0x7fbe3414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 0x7fbe3414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 -- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe340a8df0 msgr2=0x7fbe341ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe340a8df0 0x7fbe341ef520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 -- 172.21.15.194:0/36590195 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe341efa60 con 0x7fbe3406c5d0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33e00640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 0x7fbe3414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe33400640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c430 tx=0x7fbe2400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe240074e0 con 0x7fbe3406c5d0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240047e0 con 0x7fbe3406c5d0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe340c6bd0 con 0x7fbe3406c5d0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24004bd0 con 0x7fbe3406c5d0 2024-03-07T10:24:10.724 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.721+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe341eb950 con 0x7fbe3406c5d0 2024-03-07T10:24:10.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.723+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe34068170 con 0x7fbe3406c5d0 2024-03-07T10:24:10.725 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.724+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fbe24011070 con 0x7fbe3406c5d0 2024-03-07T10:24:10.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.725+0000 7fbe2b400640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 0x7fbe1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:10.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.725+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fbe2408a320 con 0x7fbe3406c5d0 2024-03-07T10:24:10.726 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.725+0000 7fbe32a00640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 0x7fbe1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:10.727 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.726+0000 7fbe32a00640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 0x7fbe1406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe20036000 tx=0x7fbe20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:10.730 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.729+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fbe34153160 con 0x7fbe3406c5d0 2024-03-07T10:24:10.923 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.921+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe3406bfa0 con 0x7fbe1406b4d0 2024-03-07T10:24:10.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.956+0000 7fbe2b400640 1 -- 172.21.15.194:0/36590195 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490607 (secure 0 0 0) 0x7fbe3406bfa0 con 0x7fbe1406b4d0 2024-03-07T10:24:10.963 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:10.966 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 msgr2=0x7fbe1406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 0x7fbe1406d990 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe20036000 tx=0x7fbe20008030 comp rx=0 tx=0).stop 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 msgr2=0x7fbe341ec150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c430 tx=0x7fbe2400c8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 shutdown_connections 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fbe1406b4d0 0x7fbe1406d990 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fbe34152d80 0x7fbe3414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.968 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fbe340a8df0 0x7fbe341ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 --2- 172.21.15.194:0/36590195 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe3406c5d0 0x7fbe341ec150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:10.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 >> 172.21.15.194:0/36590195 conn(0x7fbe340c41a0 msgr2=0x7fbe34150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:10.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 shutdown_connections 2024-03-07T10:24:10.969 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:10.962+0000 7fbe3a800640 1 -- 172.21.15.194:0/36590195 wait complete. 2024-03-07T10:24:10.984 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-03-07T10:24:10.488949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670581,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":353,"num_read_kb":387,"num_write":342,"num_write_kb":2568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":804,"ondisk_log_size":804,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220044,"kb_used_data":3912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754676,"statfs":{"total":773094113280,"available":772868788224,"internally_reserved":0,"allocated":4005888,"data_stored":2416042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7528,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":111,"num_write":14,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005792"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024280+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:23:58.024280+0000","last_peered":"2024-03-07T10:23:58.024280+0000","last_clean":"2024-03-07T10:23:58.024280+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:23:58.024280+0000","last_undegraded":"2024-03-07T10:23:58.024280+0000","last_fullsized":"2024-03-07T10:23:58.024280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030677+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:23:58.030677+0000","last_peered":"2024-03-07T10:23:58.030677+0000","last_clean":"2024-03-07T10:23:58.030677+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:23:58.030677+0000","last_undegraded":"2024-03-07T10:23:58.030677+0000","last_fullsized":"2024-03-07T10:23:58.030677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903986+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:24:05.903986+0000","last_peered":"2024-03-07T10:24:05.903986+0000","last_clean":"2024-03-07T10:24:05.903986+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:05.903986+0000","last_undegraded":"2024-03-07T10:24:05.903986+0000","last_fullsized":"2024-03-07T10:24:05.903986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015730+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:23:58.015730+0000","last_peered":"2024-03-07T10:23:58.015730+0000","last_clean":"2024-03-07T10:23:58.015730+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:23:58.015730+0000","last_undegraded":"2024-03-07T10:23:58.015730+0000","last_fullsized":"2024-03-07T10:23:58.015730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019525+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:23:58.019525+0000","last_peered":"2024-03-07T10:23:58.019525+0000","last_clean":"2024-03-07T10:23:58.019525+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:23:58.019525+0000","last_undegraded":"2024-03-07T10:23:58.019525+0000","last_fullsized":"2024-03-07T10:23:58.019525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021122+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:23:58.021122+0000","last_peered":"2024-03-07T10:23:58.021122+0000","last_clean":"2024-03-07T10:23:58.021122+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:23:58.021122+0000","last_undegraded":"2024-03-07T10:23:58.021122+0000","last_fullsized":"2024-03-07T10:23:58.021122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908428+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:24:05.908428+0000","last_peered":"2024-03-07T10:24:05.908428+0000","last_clean":"2024-03-07T10:24:05.908428+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:05.908428+0000","last_undegraded":"2024-03-07T10:24:05.908428+0000","last_fullsized":"2024-03-07T10:24:05.908428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024431+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:23:58.024431+0000","last_peered":"2024-03-07T10:23:58.024431+0000","last_clean":"2024-03-07T10:23:58.024431+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:23:58.024431+0000","last_undegraded":"2024-03-07T10:23:58.024431+0000","last_fullsized":"2024-03-07T10:23:58.024431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047467+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:23:58.047467+0000","last_peered":"2024-03-07T10:23:58.047467+0000","last_clean":"2024-03-07T10:23:58.047467+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:23:58.047467+0000","last_undegraded":"2024-03-07T10:23:58.047467+0000","last_fullsized":"2024-03-07T10:23:58.047467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048385+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:23:58.048385+0000","last_peered":"2024-03-07T10:23:58.048385+0000","last_clean":"2024-03-07T10:23:58.048385+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:23:58.048385+0000","last_undegraded":"2024-03-07T10:23:58.048385+0000","last_fullsized":"2024-03-07T10:23:58.048385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907846+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:24:05.907846+0000","last_peered":"2024-03-07T10:24:05.907846+0000","last_clean":"2024-03-07T10:24:05.907846+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:05.907846+0000","last_undegraded":"2024-03-07T10:24:05.907846+0000","last_fullsized":"2024-03-07T10:24:05.907846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025165+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:23:58.025165+0000","last_peered":"2024-03-07T10:23:58.025165+0000","last_clean":"2024-03-07T10:23:58.025165+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:23:58.025165+0000","last_undegraded":"2024-03-07T10:23:58.025165+0000","last_fullsized":"2024-03-07T10:23:58.025165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048028+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:23:58.048028+0000","last_peered":"2024-03-07T10:23:58.048028+0000","last_clean":"2024-03-07T10:23:58.048028+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:23:58.048028+0000","last_undegraded":"2024-03-07T10:23:58.048028+0000","last_fullsized":"2024-03-07T10:23:58.048028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902537+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:24:05.902537+0000","last_peered":"2024-03-07T10:24:05.902537+0000","last_clean":"2024-03-07T10:24:05.902537+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:05.902537+0000","last_undegraded":"2024-03-07T10:24:05.902537+0000","last_fullsized":"2024-03-07T10:24:05.902537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024932+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:23:58.024932+0000","last_peered":"2024-03-07T10:23:58.024932+0000","last_clean":"2024-03-07T10:23:58.024932+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:23:58.024932+0000","last_undegraded":"2024-03-07T10:23:58.024932+0000","last_fullsized":"2024-03-07T10:23:58.024932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018731+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:23:58.018731+0000","last_peered":"2024-03-07T10:23:58.018731+0000","last_clean":"2024-03-07T10:23:58.018731+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:23:58.018731+0000","last_undegraded":"2024-03-07T10:23:58.018731+0000","last_fullsized":"2024-03-07T10:23:58.018731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912919+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:24:05.912919+0000","last_peered":"2024-03-07T10:24:05.912919+0000","last_clean":"2024-03-07T10:24:05.912919+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:05.912919+0000","last_undegraded":"2024-03-07T10:24:05.912919+0000","last_fullsized":"2024-03-07T10:24:05.912919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047794+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:23:58.047794+0000","last_peered":"2024-03-07T10:23:58.047794+0000","last_clean":"2024-03-07T10:23:58.047794+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:23:58.047794+0000","last_undegraded":"2024-03-07T10:23:58.047794+0000","last_fullsized":"2024-03-07T10:23:58.047794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026019+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:23:58.026019+0000","last_peered":"2024-03-07T10:23:58.026019+0000","last_clean":"2024-03-07T10:23:58.026019+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:23:58.026019+0000","last_undegraded":"2024-03-07T10:23:58.026019+0000","last_fullsized":"2024-03-07T10:23:58.026019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021488+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:23:58.021488+0000","last_peered":"2024-03-07T10:23:58.021488+0000","last_clean":"2024-03-07T10:23:58.021488+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:23:58.021488+0000","last_undegraded":"2024-03-07T10:23:58.021488+0000","last_fullsized":"2024-03-07T10:23:58.021488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909235+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:24:05.909235+0000","last_peered":"2024-03-07T10:24:05.909235+0000","last_clean":"2024-03-07T10:24:05.909235+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:05.909235+0000","last_undegraded":"2024-03-07T10:24:05.909235+0000","last_fullsized":"2024-03-07T10:24:05.909235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021928+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:23:58.021928+0000","last_peered":"2024-03-07T10:23:58.021928+0000","last_clean":"2024-03-07T10:23:58.021928+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:23:58.021928+0000","last_undegraded":"2024-03-07T10:23:58.021928+0000","last_fullsized":"2024-03-07T10:23:58.021928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025697+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:23:58.025697+0000","last_peered":"2024-03-07T10:23:58.025697+0000","last_clean":"2024-03-07T10:23:58.025697+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:23:58.025697+0000","last_undegraded":"2024-03-07T10:23:58.025697+0000","last_fullsized":"2024-03-07T10:23:58.025697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025370+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:23:58.025370+0000","last_peered":"2024-03-07T10:23:58.025370+0000","last_clean":"2024-03-07T10:23:58.025370+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:23:58.025370+0000","last_undegraded":"2024-03-07T10:23:58.025370+0000","last_fullsized":"2024-03-07T10:23:58.025370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905051+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:24:05.905051+0000","last_peered":"2024-03-07T10:24:05.905051+0000","last_clean":"2024-03-07T10:24:05.905051+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:05.905051+0000","last_undegraded":"2024-03-07T10:24:05.905051+0000","last_fullsized":"2024-03-07T10:24:05.905051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020557+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:23:58.020557+0000","last_peered":"2024-03-07T10:23:58.020557+0000","last_clean":"2024-03-07T10:23:58.020557+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:23:58.020557+0000","last_undegraded":"2024-03-07T10:23:58.020557+0000","last_fullsized":"2024-03-07T10:23:58.020557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023377+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:23:58.023377+0000","last_peered":"2024-03-07T10:23:58.023377+0000","last_clean":"2024-03-07T10:23:58.023377+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:23:58.023377+0000","last_undegraded":"2024-03-07T10:23:58.023377+0000","last_fullsized":"2024-03-07T10:23:58.023377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027741+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:23:58.027741+0000","last_peered":"2024-03-07T10:23:58.027741+0000","last_clean":"2024-03-07T10:23:58.027741+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:23:58.027741+0000","last_undegraded":"2024-03-07T10:23:58.027741+0000","last_fullsized":"2024-03-07T10:23:58.027741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.851798+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:24:05.851798+0000","last_peered":"2024-03-07T10:24:05.851798+0000","last_clean":"2024-03-07T10:24:05.851798+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:05.851798+0000","last_undegraded":"2024-03-07T10:24:05.851798+0000","last_fullsized":"2024-03-07T10:24:05.851798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047943+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:23:58.047943+0000","last_peered":"2024-03-07T10:23:58.047943+0000","last_clean":"2024-03-07T10:23:58.047943+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:23:58.047943+0000","last_undegraded":"2024-03-07T10:23:58.047943+0000","last_fullsized":"2024-03-07T10:23:58.047943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.036887+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:24:01.036887+0000","last_peered":"2024-03-07T10:24:01.036887+0000","last_clean":"2024-03-07T10:24:01.036887+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:01.036887+0000","last_undegraded":"2024-03-07T10:24:01.036887+0000","last_fullsized":"2024-03-07T10:24:01.036887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016321+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:23:58.016321+0000","last_peered":"2024-03-07T10:23:58.016321+0000","last_clean":"2024-03-07T10:23:58.016321+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:23:58.016321+0000","last_undegraded":"2024-03-07T10:23:58.016321+0000","last_fullsized":"2024-03-07T10:23:58.016321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906780+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:24:05.906780+0000","last_peered":"2024-03-07T10:24:05.906780+0000","last_clean":"2024-03-07T10:24:05.906780+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:05.906780+0000","last_undegraded":"2024-03-07T10:24:05.906780+0000","last_fullsized":"2024-03-07T10:24:05.906780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037774+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:23:58.037774+0000","last_peered":"2024-03-07T10:23:58.037774+0000","last_clean":"2024-03-07T10:23:58.037774+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:23:58.037774+0000","last_undegraded":"2024-03-07T10:23:58.037774+0000","last_fullsized":"2024-03-07T10:23:58.037774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024779+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:23:58.024779+0000","last_peered":"2024-03-07T10:23:58.024779+0000","last_clean":"2024-03-07T10:23:58.024779+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:23:58.024779+0000","last_undegraded":"2024-03-07T10:23:58.024779+0000","last_fullsized":"2024-03-07T10:23:58.024779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024293+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:23:58.024293+0000","last_peered":"2024-03-07T10:23:58.024293+0000","last_clean":"2024-03-07T10:23:58.024293+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:23:58.024293+0000","last_undegraded":"2024-03-07T10:23:58.024293+0000","last_fullsized":"2024-03-07T10:23:58.024293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906157+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:24:05.906157+0000","last_peered":"2024-03-07T10:24:05.906157+0000","last_clean":"2024-03-07T10:24:05.906157+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:05.906157+0000","last_undegraded":"2024-03-07T10:24:05.906157+0000","last_fullsized":"2024-03-07T10:24:05.906157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023629+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:23:58.023629+0000","last_peered":"2024-03-07T10:23:58.023629+0000","last_clean":"2024-03-07T10:23:58.023629+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:23:58.023629+0000","last_undegraded":"2024-03-07T10:23:58.023629+0000","last_fullsized":"2024-03-07T10:23:58.023629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015274+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:23:58.015274+0000","last_peered":"2024-03-07T10:23:58.015274+0000","last_clean":"2024-03-07T10:23:58.015274+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:23:58.015274+0000","last_undegraded":"2024-03-07T10:23:58.015274+0000","last_fullsized":"2024-03-07T10:23:58.015274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036766+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:23:58.036766+0000","last_peered":"2024-03-07T10:23:58.036766+0000","last_clean":"2024-03-07T10:23:58.036766+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:23:58.036766+0000","last_undegraded":"2024-03-07T10:23:58.036766+0000","last_fullsized":"2024-03-07T10:23:58.036766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.894099+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:24:05.894099+0000","last_peered":"2024-03-07T10:24:05.894099+0000","last_clean":"2024-03-07T10:24:05.894099+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:05.894099+0000","last_undegraded":"2024-03-07T10:24:05.894099+0000","last_fullsized":"2024-03-07T10:24:05.894099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048513+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:23:58.048513+0000","last_peered":"2024-03-07T10:23:58.048513+0000","last_clean":"2024-03-07T10:23:58.048513+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:23:58.048513+0000","last_undegraded":"2024-03-07T10:23:58.048513+0000","last_fullsized":"2024-03-07T10:23:58.048513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030079+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:23:58.030079+0000","last_peered":"2024-03-07T10:23:58.030079+0000","last_clean":"2024-03-07T10:23:58.030079+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:23:58.030079+0000","last_undegraded":"2024-03-07T10:23:58.030079+0000","last_fullsized":"2024-03-07T10:23:58.030079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030683+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:23:58.030683+0000","last_peered":"2024-03-07T10:23:58.030683+0000","last_clean":"2024-03-07T10:23:58.030683+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:23:58.030683+0000","last_undegraded":"2024-03-07T10:23:58.030683+0000","last_fullsized":"2024-03-07T10:23:58.030683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912092+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:24:05.912092+0000","last_peered":"2024-03-07T10:24:05.912092+0000","last_clean":"2024-03-07T10:24:05.912092+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:05.912092+0000","last_undegraded":"2024-03-07T10:24:05.912092+0000","last_fullsized":"2024-03-07T10:24:05.912092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022761+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:23:58.022761+0000","last_peered":"2024-03-07T10:23:58.022761+0000","last_clean":"2024-03-07T10:23:58.022761+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:23:58.022761+0000","last_undegraded":"2024-03-07T10:23:58.022761+0000","last_fullsized":"2024-03-07T10:23:58.022761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021237+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:23:58.021237+0000","last_peered":"2024-03-07T10:23:58.021237+0000","last_clean":"2024-03-07T10:23:58.021237+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:23:58.021237+0000","last_undegraded":"2024-03-07T10:23:58.021237+0000","last_fullsized":"2024-03-07T10:23:58.021237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029730+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:23:58.029730+0000","last_peered":"2024-03-07T10:23:58.029730+0000","last_clean":"2024-03-07T10:23:58.029730+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:23:58.029730+0000","last_undegraded":"2024-03-07T10:23:58.029730+0000","last_fullsized":"2024-03-07T10:23:58.029730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906576+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:24:05.906576+0000","last_peered":"2024-03-07T10:24:05.906576+0000","last_clean":"2024-03-07T10:24:05.906576+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:05.906576+0000","last_undegraded":"2024-03-07T10:24:05.906576+0000","last_fullsized":"2024-03-07T10:24:05.906576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026748+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:23:58.026748+0000","last_peered":"2024-03-07T10:23:58.026748+0000","last_clean":"2024-03-07T10:23:58.026748+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:23:58.026748+0000","last_undegraded":"2024-03-07T10:23:58.026748+0000","last_fullsized":"2024-03-07T10:23:58.026748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022319+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:23:58.022319+0000","last_peered":"2024-03-07T10:23:58.022319+0000","last_clean":"2024-03-07T10:23:58.022319+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:23:58.022319+0000","last_undegraded":"2024-03-07T10:23:58.022319+0000","last_fullsized":"2024-03-07T10:23:58.022319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021571+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:23:58.021571+0000","last_peered":"2024-03-07T10:23:58.021571+0000","last_clean":"2024-03-07T10:23:58.021571+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:23:58.021571+0000","last_undegraded":"2024-03-07T10:23:58.021571+0000","last_fullsized":"2024-03-07T10:23:58.021571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893529+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:24:05.893529+0000","last_peered":"2024-03-07T10:24:05.893529+0000","last_clean":"2024-03-07T10:24:05.893529+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:05.893529+0000","last_undegraded":"2024-03-07T10:24:05.893529+0000","last_fullsized":"2024-03-07T10:24:05.893529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020619+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:23:58.020619+0000","last_peered":"2024-03-07T10:23:58.020619+0000","last_clean":"2024-03-07T10:23:58.020619+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:23:58.020619+0000","last_undegraded":"2024-03-07T10:23:58.020619+0000","last_fullsized":"2024-03-07T10:23:58.020619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.038168+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:24:01.038168+0000","last_peered":"2024-03-07T10:24:01.038168+0000","last_clean":"2024-03-07T10:24:01.038168+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:01.038168+0000","last_undegraded":"2024-03-07T10:24:01.038168+0000","last_fullsized":"2024-03-07T10:24:01.038168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027870+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:23:58.027870+0000","last_peered":"2024-03-07T10:23:58.027870+0000","last_clean":"2024-03-07T10:23:58.027870+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:23:58.027870+0000","last_undegraded":"2024-03-07T10:23:58.027870+0000","last_fullsized":"2024-03-07T10:23:58.027870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903468+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:24:05.903468+0000","last_peered":"2024-03-07T10:24:05.903468+0000","last_clean":"2024-03-07T10:24:05.903468+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:05.903468+0000","last_undegraded":"2024-03-07T10:24:05.903468+0000","last_fullsized":"2024-03-07T10:24:05.903468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047603+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:23:58.047603+0000","last_peered":"2024-03-07T10:23:58.047603+0000","last_clean":"2024-03-07T10:23:58.047603+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:23:58.047603+0000","last_undegraded":"2024-03-07T10:23:58.047603+0000","last_fullsized":"2024-03-07T10:23:58.047603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.023491+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:24:02.023491+0000","last_peered":"2024-03-07T10:24:02.023491+0000","last_clean":"2024-03-07T10:24:02.023491+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:02.023491+0000","last_undegraded":"2024-03-07T10:24:02.023491+0000","last_fullsized":"2024-03-07T10:24:02.023491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047787+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:23:58.047787+0000","last_peered":"2024-03-07T10:23:58.047787+0000","last_clean":"2024-03-07T10:23:58.047787+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:23:58.047787+0000","last_undegraded":"2024-03-07T10:23:58.047787+0000","last_fullsized":"2024-03-07T10:23:58.047787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907310+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:24:05.907310+0000","last_peered":"2024-03-07T10:24:05.907310+0000","last_clean":"2024-03-07T10:24:05.907310+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:05.907310+0000","last_undegraded":"2024-03-07T10:24:05.907310+0000","last_fullsized":"2024-03-07T10:24:05.907310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047898+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:23:58.047898+0000","last_peered":"2024-03-07T10:23:58.047898+0000","last_clean":"2024-03-07T10:23:58.047898+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:23:58.047898+0000","last_undegraded":"2024-03-07T10:23:58.047898+0000","last_fullsized":"2024-03-07T10:23:58.047898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037197+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:23:58.037197+0000","last_peered":"2024-03-07T10:23:58.037197+0000","last_clean":"2024-03-07T10:23:58.037197+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:23:58.037197+0000","last_undegraded":"2024-03-07T10:23:58.037197+0000","last_fullsized":"2024-03-07T10:23:58.037197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020468+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:23:58.020468+0000","last_peered":"2024-03-07T10:23:58.020468+0000","last_clean":"2024-03-07T10:23:58.020468+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:23:58.020468+0000","last_undegraded":"2024-03-07T10:23:58.020468+0000","last_fullsized":"2024-03-07T10:23:58.020468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911873+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:24:05.911873+0000","last_peered":"2024-03-07T10:24:05.911873+0000","last_clean":"2024-03-07T10:24:05.911873+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:05.911873+0000","last_undegraded":"2024-03-07T10:24:05.911873+0000","last_fullsized":"2024-03-07T10:24:05.911873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021748+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:23:58.021748+0000","last_peered":"2024-03-07T10:23:58.021748+0000","last_clean":"2024-03-07T10:23:58.021748+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:23:58.021748+0000","last_undegraded":"2024-03-07T10:23:58.021748+0000","last_fullsized":"2024-03-07T10:23:58.021748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036726+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:23:58.036726+0000","last_peered":"2024-03-07T10:23:58.036726+0000","last_clean":"2024-03-07T10:23:58.036726+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:23:58.036726+0000","last_undegraded":"2024-03-07T10:23:58.036726+0000","last_fullsized":"2024-03-07T10:23:58.036726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019729+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:23:58.019729+0000","last_peered":"2024-03-07T10:23:58.019729+0000","last_clean":"2024-03-07T10:23:58.019729+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:23:58.019729+0000","last_undegraded":"2024-03-07T10:23:58.019729+0000","last_fullsized":"2024-03-07T10:23:58.019729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913110+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:24:05.913110+0000","last_peered":"2024-03-07T10:24:05.913110+0000","last_clean":"2024-03-07T10:24:05.913110+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:05.913110+0000","last_undegraded":"2024-03-07T10:24:05.913110+0000","last_fullsized":"2024-03-07T10:24:05.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024183+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:23:58.024183+0000","last_peered":"2024-03-07T10:23:58.024183+0000","last_clean":"2024-03-07T10:23:58.024183+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:23:58.024183+0000","last_undegraded":"2024-03-07T10:23:58.024183+0000","last_fullsized":"2024-03-07T10:23:58.024183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031695+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:23:58.031695+0000","last_peered":"2024-03-07T10:23:58.031695+0000","last_clean":"2024-03-07T10:23:58.031695+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:23:58.031695+0000","last_undegraded":"2024-03-07T10:23:58.031695+0000","last_fullsized":"2024-03-07T10:23:58.031695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047240+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:23:58.047240+0000","last_peered":"2024-03-07T10:23:58.047240+0000","last_clean":"2024-03-07T10:23:58.047240+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:23:58.047240+0000","last_undegraded":"2024-03-07T10:23:58.047240+0000","last_fullsized":"2024-03-07T10:23:58.047240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905249+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:24:05.905249+0000","last_peered":"2024-03-07T10:24:05.905249+0000","last_clean":"2024-03-07T10:24:05.905249+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:05.905249+0000","last_undegraded":"2024-03-07T10:24:05.905249+0000","last_fullsized":"2024-03-07T10:24:05.905249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021976+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:23:58.021976+0000","last_peered":"2024-03-07T10:23:58.021976+0000","last_clean":"2024-03-07T10:23:58.021976+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:23:58.021976+0000","last_undegraded":"2024-03-07T10:23:58.021976+0000","last_fullsized":"2024-03-07T10:23:58.021976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024972+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:23:58.024972+0000","last_peered":"2024-03-07T10:23:58.024972+0000","last_clean":"2024-03-07T10:23:58.024972+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:23:58.024972+0000","last_undegraded":"2024-03-07T10:23:58.024972+0000","last_fullsized":"2024-03-07T10:23:58.024972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020868+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:23:58.020868+0000","last_peered":"2024-03-07T10:23:58.020868+0000","last_clean":"2024-03-07T10:23:58.020868+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:23:58.020868+0000","last_undegraded":"2024-03-07T10:23:58.020868+0000","last_fullsized":"2024-03-07T10:23:58.020868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904960+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:24:05.904960+0000","last_peered":"2024-03-07T10:24:05.904960+0000","last_clean":"2024-03-07T10:24:05.904960+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:05.904960+0000","last_undegraded":"2024-03-07T10:24:05.904960+0000","last_fullsized":"2024-03-07T10:24:05.904960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025874+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:23:58.025874+0000","last_peered":"2024-03-07T10:23:58.025874+0000","last_clean":"2024-03-07T10:23:58.025874+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:23:58.025874+0000","last_undegraded":"2024-03-07T10:23:58.025874+0000","last_fullsized":"2024-03-07T10:23:58.025874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024476+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:23:58.024476+0000","last_peered":"2024-03-07T10:23:58.024476+0000","last_clean":"2024-03-07T10:23:58.024476+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:23:58.024476+0000","last_undegraded":"2024-03-07T10:23:58.024476+0000","last_fullsized":"2024-03-07T10:23:58.024476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019285+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:23:58.019285+0000","last_peered":"2024-03-07T10:23:58.019285+0000","last_clean":"2024-03-07T10:23:58.019285+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:23:58.019285+0000","last_undegraded":"2024-03-07T10:23:58.019285+0000","last_fullsized":"2024-03-07T10:23:58.019285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905323+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:24:05.905323+0000","last_peered":"2024-03-07T10:24:05.905323+0000","last_clean":"2024-03-07T10:24:05.905323+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:05.905323+0000","last_undegraded":"2024-03-07T10:24:05.905323+0000","last_fullsized":"2024-03-07T10:24:05.905323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019013+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:23:58.019013+0000","last_peered":"2024-03-07T10:23:58.019013+0000","last_clean":"2024-03-07T10:23:58.019013+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:23:58.019013+0000","last_undegraded":"2024-03-07T10:23:58.019013+0000","last_fullsized":"2024-03-07T10:23:58.019013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030524+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:23:58.030524+0000","last_peered":"2024-03-07T10:23:58.030524+0000","last_clean":"2024-03-07T10:23:58.030524+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:23:58.030524+0000","last_undegraded":"2024-03-07T10:23:58.030524+0000","last_fullsized":"2024-03-07T10:23:58.030524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026481+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:23:58.026481+0000","last_peered":"2024-03-07T10:23:58.026481+0000","last_clean":"2024-03-07T10:23:58.026481+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:23:58.026481+0000","last_undegraded":"2024-03-07T10:23:58.026481+0000","last_fullsized":"2024-03-07T10:23:58.026481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908498+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:24:05.908498+0000","last_peered":"2024-03-07T10:24:05.908498+0000","last_clean":"2024-03-07T10:24:05.908498+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:05.908498+0000","last_undegraded":"2024-03-07T10:24:05.908498+0000","last_fullsized":"2024-03-07T10:24:05.908498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036847+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:23:58.036847+0000","last_peered":"2024-03-07T10:23:58.036847+0000","last_clean":"2024-03-07T10:23:58.036847+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:23:58.036847+0000","last_undegraded":"2024-03-07T10:23:58.036847+0000","last_fullsized":"2024-03-07T10:23:58.036847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019400+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:23:58.019400+0000","last_peered":"2024-03-07T10:23:58.019400+0000","last_clean":"2024-03-07T10:23:58.019400+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:23:58.019400+0000","last_undegraded":"2024-03-07T10:23:58.019400+0000","last_fullsized":"2024-03-07T10:23:58.019400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026935+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:23:58.026935+0000","last_peered":"2024-03-07T10:23:58.026935+0000","last_clean":"2024-03-07T10:23:58.026935+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:23:58.026935+0000","last_undegraded":"2024-03-07T10:23:58.026935+0000","last_fullsized":"2024-03-07T10:23:58.026935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906429+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:24:05.906429+0000","last_peered":"2024-03-07T10:24:05.906429+0000","last_clean":"2024-03-07T10:24:05.906429+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:05.906429+0000","last_undegraded":"2024-03-07T10:24:05.906429+0000","last_fullsized":"2024-03-07T10:24:05.906429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026621+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:23:58.026621+0000","last_peered":"2024-03-07T10:23:58.026621+0000","last_clean":"2024-03-07T10:23:58.026621+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:23:58.026621+0000","last_undegraded":"2024-03-07T10:23:58.026621+0000","last_fullsized":"2024-03-07T10:23:58.026621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.512699+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:24:02.512699+0000","last_peered":"2024-03-07T10:24:02.512699+0000","last_clean":"2024-03-07T10:24:02.512699+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:02.512699+0000","last_undegraded":"2024-03-07T10:24:02.512699+0000","last_fullsized":"2024-03-07T10:24:02.512699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39899,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":28,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016723+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:23:58.016723+0000","last_peered":"2024-03-07T10:23:58.016723+0000","last_clean":"2024-03-07T10:23:58.016723+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:23:58.016723+0000","last_undegraded":"2024-03-07T10:23:58.016723+0000","last_fullsized":"2024-03-07T10:23:58.016723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903527+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:24:05.903527+0000","last_peered":"2024-03-07T10:24:05.903527+0000","last_clean":"2024-03-07T10:24:05.903527+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:05.903527+0000","last_undegraded":"2024-03-07T10:24:05.903527+0000","last_fullsized":"2024-03-07T10:24:05.903527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031125+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:23:58.031125+0000","last_peered":"2024-03-07T10:23:58.031125+0000","last_clean":"2024-03-07T10:23:58.031125+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:23:58.031125+0000","last_undegraded":"2024-03-07T10:23:58.031125+0000","last_fullsized":"2024-03-07T10:23:58.031125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.030282+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:24:01.030282+0000","last_peered":"2024-03-07T10:24:01.030282+0000","last_clean":"2024-03-07T10:24:01.030282+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:01.030282+0000","last_undegraded":"2024-03-07T10:24:01.030282+0000","last_fullsized":"2024-03-07T10:24:01.030282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017016+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:23:58.017016+0000","last_peered":"2024-03-07T10:23:58.017016+0000","last_clean":"2024-03-07T10:23:58.017016+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:23:58.017016+0000","last_undegraded":"2024-03-07T10:23:58.017016+0000","last_fullsized":"2024-03-07T10:23:58.017016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901641+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:24:05.901641+0000","last_peered":"2024-03-07T10:24:05.901641+0000","last_clean":"2024-03-07T10:24:05.901641+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:05.901641+0000","last_undegraded":"2024-03-07T10:24:05.901641+0000","last_fullsized":"2024-03-07T10:24:05.901641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.845529+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:24:05.845529+0000","last_peered":"2024-03-07T10:24:05.845529+0000","last_clean":"2024-03-07T10:24:05.845529+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:05.845529+0000","last_undegraded":"2024-03-07T10:24:05.845529+0000","last_fullsized":"2024-03-07T10:24:05.845529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021023+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:23:58.021023+0000","last_peered":"2024-03-07T10:23:58.021023+0000","last_clean":"2024-03-07T10:23:58.021023+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:23:58.021023+0000","last_undegraded":"2024-03-07T10:23:58.021023+0000","last_fullsized":"2024-03-07T10:23:58.021023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021596+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:23:58.021596+0000","last_peered":"2024-03-07T10:23:58.021596+0000","last_clean":"2024-03-07T10:23:58.021596+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:23:58.021596+0000","last_undegraded":"2024-03-07T10:23:58.021596+0000","last_fullsized":"2024-03-07T10:23:58.021596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902224+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:24:05.902224+0000","last_peered":"2024-03-07T10:24:05.902224+0000","last_clean":"2024-03-07T10:24:05.902224+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:05.902224+0000","last_undegraded":"2024-03-07T10:24:05.902224+0000","last_fullsized":"2024-03-07T10:24:05.902224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024117+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:23:58.024117+0000","last_peered":"2024-03-07T10:23:58.024117+0000","last_clean":"2024-03-07T10:23:58.024117+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:23:58.024117+0000","last_undegraded":"2024-03-07T10:23:58.024117+0000","last_fullsized":"2024-03-07T10:23:58.024117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026448+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:23:58.026448+0000","last_peered":"2024-03-07T10:23:58.026448+0000","last_clean":"2024-03-07T10:23:58.026448+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:23:58.026448+0000","last_undegraded":"2024-03-07T10:23:58.026448+0000","last_fullsized":"2024-03-07T10:23:58.026448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036723+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:23:58.036723+0000","last_peered":"2024-03-07T10:23:58.036723+0000","last_clean":"2024-03-07T10:23:58.036723+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:23:58.036723+0000","last_undegraded":"2024-03-07T10:23:58.036723+0000","last_fullsized":"2024-03-07T10:23:58.036723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908330+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:24:05.908330+0000","last_peered":"2024-03-07T10:24:05.908330+0000","last_clean":"2024-03-07T10:24:05.908330+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:05.908330+0000","last_undegraded":"2024-03-07T10:24:05.908330+0000","last_fullsized":"2024-03-07T10:24:05.908330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027480+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:23:58.027480+0000","last_peered":"2024-03-07T10:23:58.027480+0000","last_clean":"2024-03-07T10:23:58.027480+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:23:58.027480+0000","last_undegraded":"2024-03-07T10:23:58.027480+0000","last_fullsized":"2024-03-07T10:23:58.027480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.043454+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:24:01.043454+0000","last_peered":"2024-03-07T10:24:01.043454+0000","last_clean":"2024-03-07T10:24:01.043454+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:01.043454+0000","last_undegraded":"2024-03-07T10:24:01.043454+0000","last_fullsized":"2024-03-07T10:24:01.043454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047262+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:23:58.047262+0000","last_peered":"2024-03-07T10:23:58.047262+0000","last_clean":"2024-03-07T10:23:58.047262+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:23:58.047262+0000","last_undegraded":"2024-03-07T10:23:58.047262+0000","last_fullsized":"2024-03-07T10:23:58.047262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901905+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:24:05.901905+0000","last_peered":"2024-03-07T10:24:05.901905+0000","last_clean":"2024-03-07T10:24:05.901905+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:05.901905+0000","last_undegraded":"2024-03-07T10:24:05.901905+0000","last_fullsized":"2024-03-07T10:24:05.901905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037698+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:23:58.037698+0000","last_peered":"2024-03-07T10:23:58.037698+0000","last_clean":"2024-03-07T10:23:58.037698+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:23:58.037698+0000","last_undegraded":"2024-03-07T10:23:58.037698+0000","last_fullsized":"2024-03-07T10:23:58.037698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015385+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:23:58.015385+0000","last_peered":"2024-03-07T10:23:58.015385+0000","last_clean":"2024-03-07T10:23:58.015385+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:23:58.015385+0000","last_undegraded":"2024-03-07T10:23:58.015385+0000","last_fullsized":"2024-03-07T10:23:58.015385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037601+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:23:58.037601+0000","last_peered":"2024-03-07T10:23:58.037601+0000","last_clean":"2024-03-07T10:23:58.037601+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:23:58.037601+0000","last_undegraded":"2024-03-07T10:23:58.037601+0000","last_fullsized":"2024-03-07T10:23:58.037601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030304+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:23:58.030304+0000","last_peered":"2024-03-07T10:23:58.030304+0000","last_clean":"2024-03-07T10:23:58.030304+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:23:58.030304+0000","last_undegraded":"2024-03-07T10:23:58.030304+0000","last_fullsized":"2024-03-07T10:23:58.030304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910547+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:24:05.910547+0000","last_peered":"2024-03-07T10:24:05.910547+0000","last_clean":"2024-03-07T10:24:05.910547+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:05.910547+0000","last_undegraded":"2024-03-07T10:24:05.910547+0000","last_fullsized":"2024-03-07T10:24:05.910547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025312+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:23:58.025312+0000","last_peered":"2024-03-07T10:23:58.025312+0000","last_clean":"2024-03-07T10:23:58.025312+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:23:58.025312+0000","last_undegraded":"2024-03-07T10:23:58.025312+0000","last_fullsized":"2024-03-07T10:23:58.025312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030072+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:23:58.030072+0000","last_peered":"2024-03-07T10:23:58.030072+0000","last_clean":"2024-03-07T10:23:58.030072+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:23:58.030072+0000","last_undegraded":"2024-03-07T10:23:58.030072+0000","last_fullsized":"2024-03-07T10:23:58.030072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.044936+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:23:58.044936+0000","last_peered":"2024-03-07T10:23:58.044936+0000","last_clean":"2024-03-07T10:23:58.044936+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:23:58.044936+0000","last_undegraded":"2024-03-07T10:23:58.044936+0000","last_fullsized":"2024-03-07T10:23:58.044936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911084+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:24:05.911084+0000","last_peered":"2024-03-07T10:24:05.911084+0000","last_clean":"2024-03-07T10:24:05.911084+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:05.911084+0000","last_undegraded":"2024-03-07T10:24:05.911084+0000","last_fullsized":"2024-03-07T10:24:05.911084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016397+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:23:58.016397+0000","last_peered":"2024-03-07T10:23:58.016397+0000","last_clean":"2024-03-07T10:23:58.016397+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:23:58.016397+0000","last_undegraded":"2024-03-07T10:23:58.016397+0000","last_fullsized":"2024-03-07T10:23:58.016397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023755+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:23:58.023755+0000","last_peered":"2024-03-07T10:23:58.023755+0000","last_clean":"2024-03-07T10:23:58.023755+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:23:58.023755+0000","last_undegraded":"2024-03-07T10:23:58.023755+0000","last_fullsized":"2024-03-07T10:23:58.023755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037173+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:23:58.037173+0000","last_peered":"2024-03-07T10:23:58.037173+0000","last_clean":"2024-03-07T10:23:58.037173+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:23:58.037173+0000","last_undegraded":"2024-03-07T10:23:58.037173+0000","last_fullsized":"2024-03-07T10:23:58.037173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910066+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:24:05.910066+0000","last_peered":"2024-03-07T10:24:05.910066+0000","last_clean":"2024-03-07T10:24:05.910066+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:05.910066+0000","last_undegraded":"2024-03-07T10:24:05.910066+0000","last_fullsized":"2024-03-07T10:24:05.910066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.035701+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:24:01.035701+0000","last_peered":"2024-03-07T10:24:01.035701+0000","last_clean":"2024-03-07T10:24:01.035701+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:01.035701+0000","last_undegraded":"2024-03-07T10:24:01.035701+0000","last_fullsized":"2024-03-07T10:24:01.035701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025302+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:23:58.025302+0000","last_peered":"2024-03-07T10:23:58.025302+0000","last_clean":"2024-03-07T10:23:58.025302+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:23:58.025302+0000","last_undegraded":"2024-03-07T10:23:58.025302+0000","last_fullsized":"2024-03-07T10:23:58.025302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017526+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:23:58.017526+0000","last_peered":"2024-03-07T10:23:58.017526+0000","last_clean":"2024-03-07T10:23:58.017526+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:23:58.017526+0000","last_undegraded":"2024-03-07T10:23:58.017526+0000","last_fullsized":"2024-03-07T10:23:58.017526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.890051+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:24:05.890051+0000","last_peered":"2024-03-07T10:24:05.890051+0000","last_clean":"2024-03-07T10:24:05.890051+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:05.890051+0000","last_undegraded":"2024-03-07T10:24:05.890051+0000","last_fullsized":"2024-03-07T10:24:05.890051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.031368+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:24:01.031368+0000","last_peered":"2024-03-07T10:24:01.031368+0000","last_clean":"2024-03-07T10:24:01.031368+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:01.031368+0000","last_undegraded":"2024-03-07T10:24:01.031368+0000","last_fullsized":"2024-03-07T10:24:01.031368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020470+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:23:58.020470+0000","last_peered":"2024-03-07T10:23:58.020470+0000","last_clean":"2024-03-07T10:23:58.020470+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:23:58.020470+0000","last_undegraded":"2024-03-07T10:23:58.020470+0000","last_fullsized":"2024-03-07T10:23:58.020470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912772+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:24:05.912772+0000","last_peered":"2024-03-07T10:24:05.912772+0000","last_clean":"2024-03-07T10:24:05.912772+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:05.912772+0000","last_undegraded":"2024-03-07T10:24:05.912772+0000","last_fullsized":"2024-03-07T10:24:05.912772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023010+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:23:58.023010+0000","last_peered":"2024-03-07T10:23:58.023010+0000","last_clean":"2024-03-07T10:23:58.023010+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:23:58.023010+0000","last_undegraded":"2024-03-07T10:23:58.023010+0000","last_fullsized":"2024-03-07T10:23:58.023010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.888725+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:24:05.888725+0000","last_peered":"2024-03-07T10:24:05.888725+0000","last_clean":"2024-03-07T10:24:05.888725+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:05.888725+0000","last_undegraded":"2024-03-07T10:24:05.888725+0000","last_fullsized":"2024-03-07T10:24:05.888725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027030+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:23:58.027030+0000","last_peered":"2024-03-07T10:23:58.027030+0000","last_clean":"2024-03-07T10:23:58.027030+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:23:58.027030+0000","last_undegraded":"2024-03-07T10:23:58.027030+0000","last_fullsized":"2024-03-07T10:23:58.027030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912442+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:24:05.912442+0000","last_peered":"2024-03-07T10:24:05.912442+0000","last_clean":"2024-03-07T10:24:05.912442+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:05.912442+0000","last_undegraded":"2024-03-07T10:24:05.912442+0000","last_fullsized":"2024-03-07T10:24:05.912442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023651+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:23:58.023651+0000","last_peered":"2024-03-07T10:23:58.023651+0000","last_clean":"2024-03-07T10:23:58.023651+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:23:58.023651+0000","last_undegraded":"2024-03-07T10:23:58.023651+0000","last_fullsized":"2024-03-07T10:23:58.023651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905520+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:24:05.905520+0000","last_peered":"2024-03-07T10:24:05.905520+0000","last_clean":"2024-03-07T10:24:05.905520+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:05.905520+0000","last_undegraded":"2024-03-07T10:24:05.905520+0000","last_fullsized":"2024-03-07T10:24:05.905520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047336+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:23:58.047336+0000","last_peered":"2024-03-07T10:23:58.047336+0000","last_clean":"2024-03-07T10:23:58.047336+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:23:58.047336+0000","last_undegraded":"2024-03-07T10:23:58.047336+0000","last_fullsized":"2024-03-07T10:23:58.047336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905368+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:24:05.905368+0000","last_peered":"2024-03-07T10:24:05.905368+0000","last_clean":"2024-03-07T10:24:05.905368+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:05.905368+0000","last_undegraded":"2024-03-07T10:24:05.905368+0000","last_fullsized":"2024-03-07T10:24:05.905368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024979+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:23:58.024979+0000","last_peered":"2024-03-07T10:23:58.024979+0000","last_clean":"2024-03-07T10:23:58.024979+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:23:58.024979+0000","last_undegraded":"2024-03-07T10:23:58.024979+0000","last_fullsized":"2024-03-07T10:23:58.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907474+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:24:05.907474+0000","last_peered":"2024-03-07T10:24:05.907474+0000","last_clean":"2024-03-07T10:24:05.907474+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:05.907474+0000","last_undegraded":"2024-03-07T10:24:05.907474+0000","last_fullsized":"2024-03-07T10:24:05.907474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047223+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:23:58.047223+0000","last_peered":"2024-03-07T10:23:58.047223+0000","last_clean":"2024-03-07T10:23:58.047223+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:23:58.047223+0000","last_undegraded":"2024-03-07T10:23:58.047223+0000","last_fullsized":"2024-03-07T10:23:58.047223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907491+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:24:05.907491+0000","last_peered":"2024-03-07T10:24:05.907491+0000","last_clean":"2024-03-07T10:24:05.907491+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:05.907491+0000","last_undegraded":"2024-03-07T10:24:05.907491+0000","last_fullsized":"2024-03-07T10:24:05.907491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036645+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:23:58.036645+0000","last_peered":"2024-03-07T10:23:58.036645+0000","last_clean":"2024-03-07T10:23:58.036645+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:23:58.036645+0000","last_undegraded":"2024-03-07T10:23:58.036645+0000","last_fullsized":"2024-03-07T10:23:58.036645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.884818+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:24:05.884818+0000","last_peered":"2024-03-07T10:24:05.884818+0000","last_clean":"2024-03-07T10:24:05.884818+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:05.884818+0000","last_undegraded":"2024-03-07T10:24:05.884818+0000","last_fullsized":"2024-03-07T10:24:05.884818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020310+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:23:58.020310+0000","last_peered":"2024-03-07T10:23:58.020310+0000","last_clean":"2024-03-07T10:23:58.020310+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:23:58.020310+0000","last_undegraded":"2024-03-07T10:23:58.020310+0000","last_fullsized":"2024-03-07T10:23:58.020310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.889451+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:24:05.889451+0000","last_peered":"2024-03-07T10:24:05.889451+0000","last_clean":"2024-03-07T10:24:05.889451+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:05.889451+0000","last_undegraded":"2024-03-07T10:24:05.889451+0000","last_fullsized":"2024-03-07T10:24:05.889451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048487+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:23:58.048487+0000","last_peered":"2024-03-07T10:23:58.048487+0000","last_clean":"2024-03-07T10:23:58.048487+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:23:58.048487+0000","last_undegraded":"2024-03-07T10:23:58.048487+0000","last_fullsized":"2024-03-07T10:23:58.048487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910340+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:24:05.910340+0000","last_peered":"2024-03-07T10:24:05.910340+0000","last_clean":"2024-03-07T10:24:05.910340+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:05.910340+0000","last_undegraded":"2024-03-07T10:24:05.910340+0000","last_fullsized":"2024-03-07T10:24:05.910340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021108+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:23:58.021108+0000","last_peered":"2024-03-07T10:23:58.021108+0000","last_clean":"2024-03-07T10:23:58.021108+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:23:58.021108+0000","last_undegraded":"2024-03-07T10:23:58.021108+0000","last_fullsized":"2024-03-07T10:23:58.021108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.900198+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:24:05.900198+0000","last_peered":"2024-03-07T10:24:05.900198+0000","last_clean":"2024-03-07T10:24:05.900198+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:05.900198+0000","last_undegraded":"2024-03-07T10:24:05.900198+0000","last_fullsized":"2024-03-07T10:24:05.900198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018065+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:23:58.018065+0000","last_peered":"2024-03-07T10:23:58.018065+0000","last_clean":"2024-03-07T10:23:58.018065+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:23:58.018065+0000","last_undegraded":"2024-03-07T10:23:58.018065+0000","last_fullsized":"2024-03-07T10:23:58.018065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911579+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:24:05.911579+0000","last_peered":"2024-03-07T10:24:05.911579+0000","last_clean":"2024-03-07T10:24:05.911579+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:05.911579+0000","last_undegraded":"2024-03-07T10:24:05.911579+0000","last_fullsized":"2024-03-07T10:24:05.911579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024597+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:23:58.024597+0000","last_peered":"2024-03-07T10:23:58.024597+0000","last_clean":"2024-03-07T10:23:58.024597+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:23:58.024597+0000","last_undegraded":"2024-03-07T10:23:58.024597+0000","last_fullsized":"2024-03-07T10:23:58.024597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907976+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:24:05.907976+0000","last_peered":"2024-03-07T10:24:05.907976+0000","last_clean":"2024-03-07T10:24:05.907976+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:05.907976+0000","last_undegraded":"2024-03-07T10:24:05.907976+0000","last_fullsized":"2024-03-07T10:24:05.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024868+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:23:58.024868+0000","last_peered":"2024-03-07T10:23:58.024868+0000","last_clean":"2024-03-07T10:23:58.024868+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:23:58.024868+0000","last_undegraded":"2024-03-07T10:23:58.024868+0000","last_fullsized":"2024-03-07T10:23:58.024868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893801+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:24:05.893801+0000","last_peered":"2024-03-07T10:24:05.893801+0000","last_clean":"2024-03-07T10:24:05.893801+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:05.893801+0000","last_undegraded":"2024-03-07T10:24:05.893801+0000","last_fullsized":"2024-03-07T10:24:05.893801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025108+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:23:58.025108+0000","last_peered":"2024-03-07T10:23:58.025108+0000","last_clean":"2024-03-07T10:23:58.025108+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:23:58.025108+0000","last_undegraded":"2024-03-07T10:23:58.025108+0000","last_fullsized":"2024-03-07T10:23:58.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.895901+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:24:05.895901+0000","last_peered":"2024-03-07T10:24:05.895901+0000","last_clean":"2024-03-07T10:24:05.895901+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:05.895901+0000","last_undegraded":"2024-03-07T10:24:05.895901+0000","last_fullsized":"2024-03-07T10:24:05.895901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029175+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:23:58.029175+0000","last_peered":"2024-03-07T10:23:58.029175+0000","last_clean":"2024-03-07T10:23:58.029175+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:23:58.029175+0000","last_undegraded":"2024-03-07T10:23:58.029175+0000","last_fullsized":"2024-03-07T10:23:58.029175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.898971+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:24:05.898971+0000","last_peered":"2024-03-07T10:24:05.898971+0000","last_clean":"2024-03-07T10:24:05.898971+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:05.898971+0000","last_undegraded":"2024-03-07T10:24:05.898971+0000","last_fullsized":"2024-03-07T10:24:05.898971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023002+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:23:58.023002+0000","last_peered":"2024-03-07T10:23:58.023002+0000","last_clean":"2024-03-07T10:23:58.023002+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:23:58.023002+0000","last_undegraded":"2024-03-07T10:23:58.023002+0000","last_fullsized":"2024-03-07T10:23:58.023002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911103+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:24:05.911103+0000","last_peered":"2024-03-07T10:24:05.911103+0000","last_clean":"2024-03-07T10:24:05.911103+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:05.911103+0000","last_undegraded":"2024-03-07T10:24:05.911103+0000","last_fullsized":"2024-03-07T10:24:05.911103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025459+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:23:58.025459+0000","last_peered":"2024-03-07T10:23:58.025459+0000","last_clean":"2024-03-07T10:23:58.025459+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:23:58.025459+0000","last_undegraded":"2024-03-07T10:23:58.025459+0000","last_fullsized":"2024-03-07T10:23:58.025459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.883013+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:24:05.883013+0000","last_peered":"2024-03-07T10:24:05.883013+0000","last_clean":"2024-03-07T10:24:05.883013+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:05.883013+0000","last_undegraded":"2024-03-07T10:24:05.883013+0000","last_fullsized":"2024-03-07T10:24:05.883013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026942+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:23:58.026942+0000","last_peered":"2024-03-07T10:23:58.026942+0000","last_clean":"2024-03-07T10:23:58.026942+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:23:58.026942+0000","last_undegraded":"2024-03-07T10:23:58.026942+0000","last_fullsized":"2024-03-07T10:23:58.026942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905219+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:24:05.905219+0000","last_peered":"2024-03-07T10:24:05.905219+0000","last_clean":"2024-03-07T10:24:05.905219+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:05.905219+0000","last_undegraded":"2024-03-07T10:24:05.905219+0000","last_fullsized":"2024-03-07T10:24:05.905219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048174+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:23:58.048174+0000","last_peered":"2024-03-07T10:23:58.048174+0000","last_clean":"2024-03-07T10:23:58.048174+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:23:58.048174+0000","last_undegraded":"2024-03-07T10:23:58.048174+0000","last_fullsized":"2024-03-07T10:23:58.048174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905669+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:24:05.905669+0000","last_peered":"2024-03-07T10:24:05.905669+0000","last_clean":"2024-03-07T10:24:05.905669+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:05.905669+0000","last_undegraded":"2024-03-07T10:24:05.905669+0000","last_fullsized":"2024-03-07T10:24:05.905669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016530+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:23:58.016530+0000","last_peered":"2024-03-07T10:23:58.016530+0000","last_clean":"2024-03-07T10:23:58.016530+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:23:58.016530+0000","last_undegraded":"2024-03-07T10:23:58.016530+0000","last_fullsized":"2024-03-07T10:23:58.016530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906195+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:24:05.906195+0000","last_peered":"2024-03-07T10:24:05.906195+0000","last_clean":"2024-03-07T10:24:05.906195+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:05.906195+0000","last_undegraded":"2024-03-07T10:24:05.906195+0000","last_fullsized":"2024-03-07T10:24:05.906195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020179+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:23:58.020179+0000","last_peered":"2024-03-07T10:23:58.020179+0000","last_clean":"2024-03-07T10:23:58.020179+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:23:58.020179+0000","last_undegraded":"2024-03-07T10:23:58.020179+0000","last_fullsized":"2024-03-07T10:23:58.020179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.914163+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:24:05.914163+0000","last_peered":"2024-03-07T10:24:05.914163+0000","last_clean":"2024-03-07T10:24:05.914163+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:05.914163+0000","last_undegraded":"2024-03-07T10:24:05.914163+0000","last_fullsized":"2024-03-07T10:24:05.914163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047776+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:23:58.047776+0000","last_peered":"2024-03-07T10:23:58.047776+0000","last_clean":"2024-03-07T10:23:58.047776+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:23:58.047776+0000","last_undegraded":"2024-03-07T10:23:58.047776+0000","last_fullsized":"2024-03-07T10:23:58.047776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.915299+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:24:05.915299+0000","last_peered":"2024-03-07T10:24:05.915299+0000","last_clean":"2024-03-07T10:24:05.915299+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:05.915299+0000","last_undegraded":"2024-03-07T10:24:05.915299+0000","last_fullsized":"2024-03-07T10:24:05.915299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025799+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:23:58.025799+0000","last_peered":"2024-03-07T10:23:58.025799+0000","last_clean":"2024-03-07T10:23:58.025799+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:23:58.025799+0000","last_undegraded":"2024-03-07T10:23:58.025799+0000","last_fullsized":"2024-03-07T10:23:58.025799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910637+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:24:05.910637+0000","last_peered":"2024-03-07T10:24:05.910637+0000","last_clean":"2024-03-07T10:24:05.910637+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:05.910637+0000","last_undegraded":"2024-03-07T10:24:05.910637+0000","last_fullsized":"2024-03-07T10:24:05.910637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020148+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:23:58.020148+0000","last_peered":"2024-03-07T10:23:58.020148+0000","last_clean":"2024-03-07T10:23:58.020148+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:23:58.020148+0000","last_undegraded":"2024-03-07T10:23:58.020148+0000","last_fullsized":"2024-03-07T10:23:58.020148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911655+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:24:05.911655+0000","last_peered":"2024-03-07T10:24:05.911655+0000","last_clean":"2024-03-07T10:24:05.911655+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:05.911655+0000","last_undegraded":"2024-03-07T10:24:05.911655+0000","last_fullsized":"2024-03-07T10:24:05.911655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037509+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:23:58.037509+0000","last_peered":"2024-03-07T10:23:58.037509+0000","last_clean":"2024-03-07T10:23:58.037509+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:23:58.037509+0000","last_undegraded":"2024-03-07T10:23:58.037509+0000","last_fullsized":"2024-03-07T10:23:58.037509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912205+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:24:05.912205+0000","last_peered":"2024-03-07T10:24:05.912205+0000","last_clean":"2024-03-07T10:24:05.912205+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:05.912205+0000","last_undegraded":"2024-03-07T10:24:05.912205+0000","last_fullsized":"2024-03-07T10:24:05.912205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018365+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:23:58.018365+0000","last_peered":"2024-03-07T10:23:58.018365+0000","last_clean":"2024-03-07T10:23:58.018365+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:23:58.018365+0000","last_undegraded":"2024-03-07T10:23:58.018365+0000","last_fullsized":"2024-03-07T10:23:58.018365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911281+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:24:05.911281+0000","last_peered":"2024-03-07T10:24:05.911281+0000","last_clean":"2024-03-07T10:24:05.911281+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:05.911281+0000","last_undegraded":"2024-03-07T10:24:05.911281+0000","last_fullsized":"2024-03-07T10:24:05.911281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027137+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:23:58.027137+0000","last_peered":"2024-03-07T10:23:58.027137+0000","last_clean":"2024-03-07T10:23:58.027137+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:23:58.027137+0000","last_undegraded":"2024-03-07T10:23:58.027137+0000","last_fullsized":"2024-03-07T10:23:58.027137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.887465+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:24:05.887465+0000","last_peered":"2024-03-07T10:24:05.887465+0000","last_clean":"2024-03-07T10:24:05.887465+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:05.887465+0000","last_undegraded":"2024-03-07T10:24:05.887465+0000","last_fullsized":"2024-03-07T10:24:05.887465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015194+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:23:58.015194+0000","last_peered":"2024-03-07T10:23:58.015194+0000","last_clean":"2024-03-07T10:23:58.015194+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:23:58.015194+0000","last_undegraded":"2024-03-07T10:23:58.015194+0000","last_fullsized":"2024-03-07T10:23:58.015194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913448+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:24:05.913448+0000","last_peered":"2024-03-07T10:24:05.913448+0000","last_clean":"2024-03-07T10:24:05.913448+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:05.913448+0000","last_undegraded":"2024-03-07T10:24:05.913448+0000","last_fullsized":"2024-03-07T10:24:05.913448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019986+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:23:58.019986+0000","last_peered":"2024-03-07T10:23:58.019986+0000","last_clean":"2024-03-07T10:23:58.019986+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:23:58.019986+0000","last_undegraded":"2024-03-07T10:23:58.019986+0000","last_fullsized":"2024-03-07T10:23:58.019986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909442+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:24:05.909442+0000","last_peered":"2024-03-07T10:24:05.909442+0000","last_clean":"2024-03-07T10:24:05.909442+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:05.909442+0000","last_undegraded":"2024-03-07T10:24:05.909442+0000","last_fullsized":"2024-03-07T10:24:05.909442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047140+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:23:58.047140+0000","last_peered":"2024-03-07T10:23:58.047140+0000","last_clean":"2024-03-07T10:23:58.047140+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:23:58.047140+0000","last_undegraded":"2024-03-07T10:23:58.047140+0000","last_fullsized":"2024-03-07T10:23:58.047140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893171+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:24:05.893171+0000","last_peered":"2024-03-07T10:24:05.893171+0000","last_clean":"2024-03-07T10:24:05.893171+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:05.893171+0000","last_undegraded":"2024-03-07T10:24:05.893171+0000","last_fullsized":"2024-03-07T10:24:05.893171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047261+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:23:58.047261+0000","last_peered":"2024-03-07T10:23:58.047261+0000","last_clean":"2024-03-07T10:23:58.047261+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:23:58.047261+0000","last_undegraded":"2024-03-07T10:23:58.047261+0000","last_fullsized":"2024-03-07T10:23:58.047261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907990+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:24:05.907990+0000","last_peered":"2024-03-07T10:24:05.907990+0000","last_clean":"2024-03-07T10:24:05.907990+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:05.907990+0000","last_undegraded":"2024-03-07T10:24:05.907990+0000","last_fullsized":"2024-03-07T10:24:05.907990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":41000,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":157,"num_read_kb":199,"num_write":90,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":82000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":134893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":212696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":174441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:24:10.990 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-07T10:24:10.991 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:24:11.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.233+0000 7fd303000640 1 Processor -- start 2024-03-07T10:24:11.235 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.233+0000 7fd303000640 1 -- start start 2024-03-07T10:24:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd303000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd2fc150b70 0x7fd2fc0a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd303000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd303000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc153980 con 0x7fd2fc0a9a10 2024-03-07T10:24:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd303000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc06e550 con 0x7fd2fc150b70 2024-03-07T10:24:11.236 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd303000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc153c60 con 0x7fd2fc156c20 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd2fb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd2fb400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:43782/0 (socket says 172.21.15.194:43782) 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd2fb400640 1 -- 172.21.15.194:0/2701772216 learned_addr learned my addr 172.21.15.194:0/2701772216 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.235+0000 7fd2fbe00640 1 --2- 172.21.15.194:0/2701772216 >> v2:172.21.15.196:3300/0 conn(0x7fd2fc150b70 0x7fd2fc0a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.236+0000 7fd2fb400640 1 -- 172.21.15.194:0/2701772216 >> v2:172.21.15.196:3300/0 conn(0x7fd2fc150b70 msgr2=0x7fd2fc0a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:11.237 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.236+0000 7fd2fb400640 1 --2- 172.21.15.194:0/2701772216 >> v2:172.21.15.196:3300/0 conn(0x7fd2fc150b70 0x7fd2fc0a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.236+0000 7fd2fb400640 1 -- 172.21.15.194:0/2701772216 >> v1:172.21.15.196:6789/0 conn(0x7fd2fc0a9a10 legacy=0x7fd2fc06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.236+0000 7fd2fb400640 1 -- 172.21.15.194:0/2701772216 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc153f40 con 0x7fd2fc156c20 2024-03-07T10:24:11.238 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.237+0000 7fd2fb400640 1 --2- 172.21.15.194:0/2701772216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f29b2a5107857967 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd2faa00640 1 -- 172.21.15.194:0/2701772216 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8035020 con 0x7fd2fc156c20 2024-03-07T10:24:11.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd2faa00640 1 -- 172.21.15.194:0/2701772216 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e8031640 con 0x7fd2fc156c20 2024-03-07T10:24:11.239 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd2faa00640 1 -- 172.21.15.194:0/2701772216 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e802d040 con 0x7fd2fc156c20 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 -- 172.21.15.194:0/2701772216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 msgr2=0x7fd2fc06d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 --2- 172.21.15.194:0/2701772216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009870 tx=0x7fd2e802b8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 -- 172.21.15.194:0/2701772216 shutdown_connections 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 --2- 172.21.15.194:0/2701772216 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc156c20 0x7fd2fc06d900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 --2- 172.21.15.194:0/2701772216 >> v2:172.21.15.196:3300/0 conn(0x7fd2fc150b70 0x7fd2fc0a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 -- 172.21.15.194:0/2701772216 >> 172.21.15.194:0/2701772216 conn(0x7fd2fc06b840 msgr2=0x7fd2fc0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:11.240 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.238+0000 7fd303000640 1 -- 172.21.15.194:0/2701772216 shutdown_connections 2024-03-07T10:24:11.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.239+0000 7fd303000640 1 -- 172.21.15.194:0/2701772216 wait complete. 2024-03-07T10:24:11.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.240+0000 7fd303000640 1 Processor -- start 2024-03-07T10:24:11.241 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.240+0000 7fd303000640 1 -- start start 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 0x7fd2fc0c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2fc150b70 0x7fd2fc1eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc153630 con 0x7fd2fc156c20 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0c7a30 con 0x7fd2fc150b70 2024-03-07T10:24:11.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd303000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ac460 con 0x7fd2fc0a9a10 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd301000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd301000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60802/0 (socket says 172.21.15.194:60802) 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.241+0000 7fd301000640 1 -- 172.21.15.194:0/2526585854 learned_addr learned my addr 172.21.15.194:0/2526585854 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd2fbe00640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 0x7fd2fc0c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd2fb400640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2fc150b70 0x7fd2fc1eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 -- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 msgr2=0x7fd2fc0c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 0x7fd2fc0c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 -- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2fc150b70 msgr2=0x7fd2fc1eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2fc150b70 0x7fd2fc1eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 -- 172.21.15.194:0/2526585854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc149c90 con 0x7fd2fc156c20 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd2fbe00640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 0x7fd2fc0c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.242+0000 7fd301000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c730 tx=0x7fd2f400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.243+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4016020 con 0x7fd2fc156c20 2024-03-07T10:24:11.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.243+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4006d50 con 0x7fd2fc156c20 2024-03-07T10:24:11.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.243+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4003bb0 con 0x7fd2fc156c20 2024-03-07T10:24:11.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.243+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc1515d0 con 0x7fd2fc156c20 2024-03-07T10:24:11.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.243+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc0c6ce0 con 0x7fd2fc156c20 2024-03-07T10:24:11.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.244+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc068170 con 0x7fd2fc156c20 2024-03-07T10:24:11.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.245+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd2f40050d0 con 0x7fd2fc156c20 2024-03-07T10:24:11.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.246+0000 7fd2f3e00640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 0x7fd2dc06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.246+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fd2f408a290 con 0x7fd2fc156c20 2024-03-07T10:24:11.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.246+0000 7fd2fbe00640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 0x7fd2dc06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.248 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.247+0000 7fd2fbe00640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 0x7fd2dc06d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c2a20 tx=0x7fd2ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.251 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.250+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd2f4020020 con 0x7fd2fc156c20 2024-03-07T10:24:11.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.441+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2fc06cd20 con 0x7fd2dc06b4d0 2024-03-07T10:24:11.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.475+0000 7fd2f3e00640 1 -- 172.21.15.194:0/2526585854 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490607 (secure 0 0 0) 0x7fd2fc06cd20 con 0x7fd2dc06b4d0 2024-03-07T10:24:11.483 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:11.487 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:24:11.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 msgr2=0x7fd2dc06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 0x7fd2dc06d990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0c2a20 tx=0x7fd2ec008040 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 msgr2=0x7fd2fc143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400c730 tx=0x7fd2f400cb30 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 shutdown_connections 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd2dc06b4d0 0x7fd2dc06d990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2fc156c20 0x7fd2fc143370 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd2fc150b70 0x7fd2fc1eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 --2- 172.21.15.194:0/2526585854 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd2fc0a9a10 0x7fd2fc0c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.484+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 >> 172.21.15.194:0/2526585854 conn(0x7fd2fc06b840 msgr2=0x7fd2fc0c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.485+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 shutdown_connections 2024-03-07T10:24:11.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.485+0000 7fd303000640 1 -- 172.21.15.194:0/2526585854 wait complete. 2024-03-07T10:24:11.510 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-03-07T10:24:10.488949+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":670581,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":353,"num_read_kb":387,"num_write":342,"num_write_kb":2568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":804,"ondisk_log_size":804,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220044,"kb_used_data":3912,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754676,"statfs":{"total":773094113280,"available":772868788224,"internally_reserved":0,"allocated":4005888,"data_stored":2416042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7528,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":111,"num_write":14,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005792"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024280+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:23:58.024280+0000","last_peered":"2024-03-07T10:23:58.024280+0000","last_clean":"2024-03-07T10:23:58.024280+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:23:58.024280+0000","last_undegraded":"2024-03-07T10:23:58.024280+0000","last_fullsized":"2024-03-07T10:23:58.024280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030677+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:23:58.030677+0000","last_peered":"2024-03-07T10:23:58.030677+0000","last_clean":"2024-03-07T10:23:58.030677+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:23:58.030677+0000","last_undegraded":"2024-03-07T10:23:58.030677+0000","last_fullsized":"2024-03-07T10:23:58.030677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903986+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:24:05.903986+0000","last_peered":"2024-03-07T10:24:05.903986+0000","last_clean":"2024-03-07T10:24:05.903986+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:05.903986+0000","last_undegraded":"2024-03-07T10:24:05.903986+0000","last_fullsized":"2024-03-07T10:24:05.903986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015730+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:23:58.015730+0000","last_peered":"2024-03-07T10:23:58.015730+0000","last_clean":"2024-03-07T10:23:58.015730+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:23:58.015730+0000","last_undegraded":"2024-03-07T10:23:58.015730+0000","last_fullsized":"2024-03-07T10:23:58.015730+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019525+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:23:58.019525+0000","last_peered":"2024-03-07T10:23:58.019525+0000","last_clean":"2024-03-07T10:23:58.019525+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:23:58.019525+0000","last_undegraded":"2024-03-07T10:23:58.019525+0000","last_fullsized":"2024-03-07T10:23:58.019525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021122+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:23:58.021122+0000","last_peered":"2024-03-07T10:23:58.021122+0000","last_clean":"2024-03-07T10:23:58.021122+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:23:58.021122+0000","last_undegraded":"2024-03-07T10:23:58.021122+0000","last_fullsized":"2024-03-07T10:23:58.021122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:54:55.185608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908428+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:24:05.908428+0000","last_peered":"2024-03-07T10:24:05.908428+0000","last_clean":"2024-03-07T10:24:05.908428+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:05.908428+0000","last_undegraded":"2024-03-07T10:24:05.908428+0000","last_fullsized":"2024-03-07T10:24:05.908428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024431+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:23:58.024431+0000","last_peered":"2024-03-07T10:23:58.024431+0000","last_clean":"2024-03-07T10:23:58.024431+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:23:58.024431+0000","last_undegraded":"2024-03-07T10:23:58.024431+0000","last_fullsized":"2024-03-07T10:23:58.024431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047467+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:23:58.047467+0000","last_peered":"2024-03-07T10:23:58.047467+0000","last_clean":"2024-03-07T10:23:58.047467+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:23:58.047467+0000","last_undegraded":"2024-03-07T10:23:58.047467+0000","last_fullsized":"2024-03-07T10:23:58.047467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048385+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:23:58.048385+0000","last_peered":"2024-03-07T10:23:58.048385+0000","last_clean":"2024-03-07T10:23:58.048385+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:23:58.048385+0000","last_undegraded":"2024-03-07T10:23:58.048385+0000","last_fullsized":"2024-03-07T10:23:58.048385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907846+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:24:05.907846+0000","last_peered":"2024-03-07T10:24:05.907846+0000","last_clean":"2024-03-07T10:24:05.907846+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:05.907846+0000","last_undegraded":"2024-03-07T10:24:05.907846+0000","last_fullsized":"2024-03-07T10:24:05.907846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025165+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:23:58.025165+0000","last_peered":"2024-03-07T10:23:58.025165+0000","last_clean":"2024-03-07T10:23:58.025165+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:23:58.025165+0000","last_undegraded":"2024-03-07T10:23:58.025165+0000","last_fullsized":"2024-03-07T10:23:58.025165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048028+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:23:58.048028+0000","last_peered":"2024-03-07T10:23:58.048028+0000","last_clean":"2024-03-07T10:23:58.048028+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:23:58.048028+0000","last_undegraded":"2024-03-07T10:23:58.048028+0000","last_fullsized":"2024-03-07T10:23:58.048028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902537+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:24:05.902537+0000","last_peered":"2024-03-07T10:24:05.902537+0000","last_clean":"2024-03-07T10:24:05.902537+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:05.902537+0000","last_undegraded":"2024-03-07T10:24:05.902537+0000","last_fullsized":"2024-03-07T10:24:05.902537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024932+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:23:58.024932+0000","last_peered":"2024-03-07T10:23:58.024932+0000","last_clean":"2024-03-07T10:23:58.024932+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:23:58.024932+0000","last_undegraded":"2024-03-07T10:23:58.024932+0000","last_fullsized":"2024-03-07T10:23:58.024932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018731+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:23:58.018731+0000","last_peered":"2024-03-07T10:23:58.018731+0000","last_clean":"2024-03-07T10:23:58.018731+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:23:58.018731+0000","last_undegraded":"2024-03-07T10:23:58.018731+0000","last_fullsized":"2024-03-07T10:23:58.018731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912919+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:24:05.912919+0000","last_peered":"2024-03-07T10:24:05.912919+0000","last_clean":"2024-03-07T10:24:05.912919+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:05.912919+0000","last_undegraded":"2024-03-07T10:24:05.912919+0000","last_fullsized":"2024-03-07T10:24:05.912919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047794+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:23:58.047794+0000","last_peered":"2024-03-07T10:23:58.047794+0000","last_clean":"2024-03-07T10:23:58.047794+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:23:58.047794+0000","last_undegraded":"2024-03-07T10:23:58.047794+0000","last_fullsized":"2024-03-07T10:23:58.047794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026019+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:23:58.026019+0000","last_peered":"2024-03-07T10:23:58.026019+0000","last_clean":"2024-03-07T10:23:58.026019+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:23:58.026019+0000","last_undegraded":"2024-03-07T10:23:58.026019+0000","last_fullsized":"2024-03-07T10:23:58.026019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021488+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:23:58.021488+0000","last_peered":"2024-03-07T10:23:58.021488+0000","last_clean":"2024-03-07T10:23:58.021488+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:23:58.021488+0000","last_undegraded":"2024-03-07T10:23:58.021488+0000","last_fullsized":"2024-03-07T10:23:58.021488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:30.958613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909235+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:24:05.909235+0000","last_peered":"2024-03-07T10:24:05.909235+0000","last_clean":"2024-03-07T10:24:05.909235+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:05.909235+0000","last_undegraded":"2024-03-07T10:24:05.909235+0000","last_fullsized":"2024-03-07T10:24:05.909235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:52:56.187806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021928+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:23:58.021928+0000","last_peered":"2024-03-07T10:23:58.021928+0000","last_clean":"2024-03-07T10:23:58.021928+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:23:58.021928+0000","last_undegraded":"2024-03-07T10:23:58.021928+0000","last_fullsized":"2024-03-07T10:23:58.021928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025697+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:23:58.025697+0000","last_peered":"2024-03-07T10:23:58.025697+0000","last_clean":"2024-03-07T10:23:58.025697+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:23:58.025697+0000","last_undegraded":"2024-03-07T10:23:58.025697+0000","last_fullsized":"2024-03-07T10:23:58.025697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025370+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:23:58.025370+0000","last_peered":"2024-03-07T10:23:58.025370+0000","last_clean":"2024-03-07T10:23:58.025370+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:23:58.025370+0000","last_undegraded":"2024-03-07T10:23:58.025370+0000","last_fullsized":"2024-03-07T10:23:58.025370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905051+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:24:05.905051+0000","last_peered":"2024-03-07T10:24:05.905051+0000","last_clean":"2024-03-07T10:24:05.905051+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:05.905051+0000","last_undegraded":"2024-03-07T10:24:05.905051+0000","last_fullsized":"2024-03-07T10:24:05.905051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020557+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:23:58.020557+0000","last_peered":"2024-03-07T10:23:58.020557+0000","last_clean":"2024-03-07T10:23:58.020557+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:23:58.020557+0000","last_undegraded":"2024-03-07T10:23:58.020557+0000","last_fullsized":"2024-03-07T10:23:58.020557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023377+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:23:58.023377+0000","last_peered":"2024-03-07T10:23:58.023377+0000","last_clean":"2024-03-07T10:23:58.023377+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:23:58.023377+0000","last_undegraded":"2024-03-07T10:23:58.023377+0000","last_fullsized":"2024-03-07T10:23:58.023377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:47.744390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027741+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:23:58.027741+0000","last_peered":"2024-03-07T10:23:58.027741+0000","last_clean":"2024-03-07T10:23:58.027741+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:23:58.027741+0000","last_undegraded":"2024-03-07T10:23:58.027741+0000","last_fullsized":"2024-03-07T10:23:58.027741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.851798+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:24:05.851798+0000","last_peered":"2024-03-07T10:24:05.851798+0000","last_clean":"2024-03-07T10:24:05.851798+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:05.851798+0000","last_undegraded":"2024-03-07T10:24:05.851798+0000","last_fullsized":"2024-03-07T10:24:05.851798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047943+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:23:58.047943+0000","last_peered":"2024-03-07T10:23:58.047943+0000","last_clean":"2024-03-07T10:23:58.047943+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:23:58.047943+0000","last_undegraded":"2024-03-07T10:23:58.047943+0000","last_fullsized":"2024-03-07T10:23:58.047943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.036887+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:24:01.036887+0000","last_peered":"2024-03-07T10:24:01.036887+0000","last_clean":"2024-03-07T10:24:01.036887+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:01.036887+0000","last_undegraded":"2024-03-07T10:24:01.036887+0000","last_fullsized":"2024-03-07T10:24:01.036887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016321+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:23:58.016321+0000","last_peered":"2024-03-07T10:23:58.016321+0000","last_clean":"2024-03-07T10:23:58.016321+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:23:58.016321+0000","last_undegraded":"2024-03-07T10:23:58.016321+0000","last_fullsized":"2024-03-07T10:23:58.016321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906780+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:24:05.906780+0000","last_peered":"2024-03-07T10:24:05.906780+0000","last_clean":"2024-03-07T10:24:05.906780+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:05.906780+0000","last_undegraded":"2024-03-07T10:24:05.906780+0000","last_fullsized":"2024-03-07T10:24:05.906780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:14.623320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037774+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:23:58.037774+0000","last_peered":"2024-03-07T10:23:58.037774+0000","last_clean":"2024-03-07T10:23:58.037774+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:23:58.037774+0000","last_undegraded":"2024-03-07T10:23:58.037774+0000","last_fullsized":"2024-03-07T10:23:58.037774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024779+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:23:58.024779+0000","last_peered":"2024-03-07T10:23:58.024779+0000","last_clean":"2024-03-07T10:23:58.024779+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:23:58.024779+0000","last_undegraded":"2024-03-07T10:23:58.024779+0000","last_fullsized":"2024-03-07T10:23:58.024779+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":303,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024293+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:23:58.024293+0000","last_peered":"2024-03-07T10:23:58.024293+0000","last_clean":"2024-03-07T10:23:58.024293+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:23:58.024293+0000","last_undegraded":"2024-03-07T10:23:58.024293+0000","last_fullsized":"2024-03-07T10:23:58.024293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906157+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:24:05.906157+0000","last_peered":"2024-03-07T10:24:05.906157+0000","last_clean":"2024-03-07T10:24:05.906157+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:05.906157+0000","last_undegraded":"2024-03-07T10:24:05.906157+0000","last_fullsized":"2024-03-07T10:24:05.906157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023629+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:23:58.023629+0000","last_peered":"2024-03-07T10:23:58.023629+0000","last_clean":"2024-03-07T10:23:58.023629+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:23:58.023629+0000","last_undegraded":"2024-03-07T10:23:58.023629+0000","last_fullsized":"2024-03-07T10:23:58.023629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015274+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:23:58.015274+0000","last_peered":"2024-03-07T10:23:58.015274+0000","last_clean":"2024-03-07T10:23:58.015274+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:23:58.015274+0000","last_undegraded":"2024-03-07T10:23:58.015274+0000","last_fullsized":"2024-03-07T10:23:58.015274+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:43.615393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036766+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:23:58.036766+0000","last_peered":"2024-03-07T10:23:58.036766+0000","last_clean":"2024-03-07T10:23:58.036766+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:23:58.036766+0000","last_undegraded":"2024-03-07T10:23:58.036766+0000","last_fullsized":"2024-03-07T10:23:58.036766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.894099+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:24:05.894099+0000","last_peered":"2024-03-07T10:24:05.894099+0000","last_clean":"2024-03-07T10:24:05.894099+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:05.894099+0000","last_undegraded":"2024-03-07T10:24:05.894099+0000","last_fullsized":"2024-03-07T10:24:05.894099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048513+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:23:58.048513+0000","last_peered":"2024-03-07T10:23:58.048513+0000","last_clean":"2024-03-07T10:23:58.048513+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:23:58.048513+0000","last_undegraded":"2024-03-07T10:23:58.048513+0000","last_fullsized":"2024-03-07T10:23:58.048513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030079+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:23:58.030079+0000","last_peered":"2024-03-07T10:23:58.030079+0000","last_clean":"2024-03-07T10:23:58.030079+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:23:58.030079+0000","last_undegraded":"2024-03-07T10:23:58.030079+0000","last_fullsized":"2024-03-07T10:23:58.030079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030683+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:23:58.030683+0000","last_peered":"2024-03-07T10:23:58.030683+0000","last_clean":"2024-03-07T10:23:58.030683+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:23:58.030683+0000","last_undegraded":"2024-03-07T10:23:58.030683+0000","last_fullsized":"2024-03-07T10:23:58.030683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912092+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:24:05.912092+0000","last_peered":"2024-03-07T10:24:05.912092+0000","last_clean":"2024-03-07T10:24:05.912092+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:05.912092+0000","last_undegraded":"2024-03-07T10:24:05.912092+0000","last_fullsized":"2024-03-07T10:24:05.912092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022761+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:23:58.022761+0000","last_peered":"2024-03-07T10:23:58.022761+0000","last_clean":"2024-03-07T10:23:58.022761+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:23:58.022761+0000","last_undegraded":"2024-03-07T10:23:58.022761+0000","last_fullsized":"2024-03-07T10:23:58.022761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021237+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:23:58.021237+0000","last_peered":"2024-03-07T10:23:58.021237+0000","last_clean":"2024-03-07T10:23:58.021237+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:23:58.021237+0000","last_undegraded":"2024-03-07T10:23:58.021237+0000","last_fullsized":"2024-03-07T10:23:58.021237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029730+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:23:58.029730+0000","last_peered":"2024-03-07T10:23:58.029730+0000","last_clean":"2024-03-07T10:23:58.029730+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:23:58.029730+0000","last_undegraded":"2024-03-07T10:23:58.029730+0000","last_fullsized":"2024-03-07T10:23:58.029730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906576+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:24:05.906576+0000","last_peered":"2024-03-07T10:24:05.906576+0000","last_clean":"2024-03-07T10:24:05.906576+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:05.906576+0000","last_undegraded":"2024-03-07T10:24:05.906576+0000","last_fullsized":"2024-03-07T10:24:05.906576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026748+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:23:58.026748+0000","last_peered":"2024-03-07T10:23:58.026748+0000","last_clean":"2024-03-07T10:23:58.026748+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:23:58.026748+0000","last_undegraded":"2024-03-07T10:23:58.026748+0000","last_fullsized":"2024-03-07T10:23:58.026748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022319+0000","last_change":"2024-03-07T10:21:08.275807+0000","last_active":"2024-03-07T10:23:58.022319+0000","last_peered":"2024-03-07T10:23:58.022319+0000","last_clean":"2024-03-07T10:23:58.022319+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:23:58.022319+0000","last_undegraded":"2024-03-07T10:23:58.022319+0000","last_fullsized":"2024-03-07T10:23:58.022319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021571+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:23:58.021571+0000","last_peered":"2024-03-07T10:23:58.021571+0000","last_clean":"2024-03-07T10:23:58.021571+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:23:58.021571+0000","last_undegraded":"2024-03-07T10:23:58.021571+0000","last_fullsized":"2024-03-07T10:23:58.021571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:43.594676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893529+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:24:05.893529+0000","last_peered":"2024-03-07T10:24:05.893529+0000","last_clean":"2024-03-07T10:24:05.893529+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:05.893529+0000","last_undegraded":"2024-03-07T10:24:05.893529+0000","last_fullsized":"2024-03-07T10:24:05.893529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020619+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:23:58.020619+0000","last_peered":"2024-03-07T10:23:58.020619+0000","last_clean":"2024-03-07T10:23:58.020619+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:23:58.020619+0000","last_undegraded":"2024-03-07T10:23:58.020619+0000","last_fullsized":"2024-03-07T10:23:58.020619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.038168+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:24:01.038168+0000","last_peered":"2024-03-07T10:24:01.038168+0000","last_clean":"2024-03-07T10:24:01.038168+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:01.038168+0000","last_undegraded":"2024-03-07T10:24:01.038168+0000","last_fullsized":"2024-03-07T10:24:01.038168+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027870+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:23:58.027870+0000","last_peered":"2024-03-07T10:23:58.027870+0000","last_clean":"2024-03-07T10:23:58.027870+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:23:58.027870+0000","last_undegraded":"2024-03-07T10:23:58.027870+0000","last_fullsized":"2024-03-07T10:23:58.027870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903468+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:24:05.903468+0000","last_peered":"2024-03-07T10:24:05.903468+0000","last_clean":"2024-03-07T10:24:05.903468+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:05.903468+0000","last_undegraded":"2024-03-07T10:24:05.903468+0000","last_fullsized":"2024-03-07T10:24:05.903468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:23:23.947800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047603+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:23:58.047603+0000","last_peered":"2024-03-07T10:23:58.047603+0000","last_clean":"2024-03-07T10:23:58.047603+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:23:58.047603+0000","last_undegraded":"2024-03-07T10:23:58.047603+0000","last_fullsized":"2024-03-07T10:23:58.047603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.023491+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:24:02.023491+0000","last_peered":"2024-03-07T10:24:02.023491+0000","last_clean":"2024-03-07T10:24:02.023491+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:02.023491+0000","last_undegraded":"2024-03-07T10:24:02.023491+0000","last_fullsized":"2024-03-07T10:24:02.023491+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:46.390752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047787+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:23:58.047787+0000","last_peered":"2024-03-07T10:23:58.047787+0000","last_clean":"2024-03-07T10:23:58.047787+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:23:58.047787+0000","last_undegraded":"2024-03-07T10:23:58.047787+0000","last_fullsized":"2024-03-07T10:23:58.047787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907310+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:24:05.907310+0000","last_peered":"2024-03-07T10:24:05.907310+0000","last_clean":"2024-03-07T10:24:05.907310+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:05.907310+0000","last_undegraded":"2024-03-07T10:24:05.907310+0000","last_fullsized":"2024-03-07T10:24:05.907310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047898+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:23:58.047898+0000","last_peered":"2024-03-07T10:23:58.047898+0000","last_clean":"2024-03-07T10:23:58.047898+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:23:58.047898+0000","last_undegraded":"2024-03-07T10:23:58.047898+0000","last_fullsized":"2024-03-07T10:23:58.047898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037197+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:23:58.037197+0000","last_peered":"2024-03-07T10:23:58.037197+0000","last_clean":"2024-03-07T10:23:58.037197+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:23:58.037197+0000","last_undegraded":"2024-03-07T10:23:58.037197+0000","last_fullsized":"2024-03-07T10:23:58.037197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020468+0000","last_change":"2024-03-07T10:21:09.307977+0000","last_active":"2024-03-07T10:23:58.020468+0000","last_peered":"2024-03-07T10:23:58.020468+0000","last_clean":"2024-03-07T10:23:58.020468+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:23:58.020468+0000","last_undegraded":"2024-03-07T10:23:58.020468+0000","last_fullsized":"2024-03-07T10:23:58.020468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:18.800784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911873+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:24:05.911873+0000","last_peered":"2024-03-07T10:24:05.911873+0000","last_clean":"2024-03-07T10:24:05.911873+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:05.911873+0000","last_undegraded":"2024-03-07T10:24:05.911873+0000","last_fullsized":"2024-03-07T10:24:05.911873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021748+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:23:58.021748+0000","last_peered":"2024-03-07T10:23:58.021748+0000","last_clean":"2024-03-07T10:23:58.021748+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:23:58.021748+0000","last_undegraded":"2024-03-07T10:23:58.021748+0000","last_fullsized":"2024-03-07T10:23:58.021748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036726+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:23:58.036726+0000","last_peered":"2024-03-07T10:23:58.036726+0000","last_clean":"2024-03-07T10:23:58.036726+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:23:58.036726+0000","last_undegraded":"2024-03-07T10:23:58.036726+0000","last_fullsized":"2024-03-07T10:23:58.036726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019729+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:23:58.019729+0000","last_peered":"2024-03-07T10:23:58.019729+0000","last_clean":"2024-03-07T10:23:58.019729+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:23:58.019729+0000","last_undegraded":"2024-03-07T10:23:58.019729+0000","last_fullsized":"2024-03-07T10:23:58.019729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:41.813341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913110+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:24:05.913110+0000","last_peered":"2024-03-07T10:24:05.913110+0000","last_clean":"2024-03-07T10:24:05.913110+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:05.913110+0000","last_undegraded":"2024-03-07T10:24:05.913110+0000","last_fullsized":"2024-03-07T10:24:05.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024183+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:23:58.024183+0000","last_peered":"2024-03-07T10:23:58.024183+0000","last_clean":"2024-03-07T10:23:58.024183+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:23:58.024183+0000","last_undegraded":"2024-03-07T10:23:58.024183+0000","last_fullsized":"2024-03-07T10:23:58.024183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031695+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:23:58.031695+0000","last_peered":"2024-03-07T10:23:58.031695+0000","last_clean":"2024-03-07T10:23:58.031695+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:23:58.031695+0000","last_undegraded":"2024-03-07T10:23:58.031695+0000","last_fullsized":"2024-03-07T10:23:58.031695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047240+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:23:58.047240+0000","last_peered":"2024-03-07T10:23:58.047240+0000","last_clean":"2024-03-07T10:23:58.047240+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:23:58.047240+0000","last_undegraded":"2024-03-07T10:23:58.047240+0000","last_fullsized":"2024-03-07T10:23:58.047240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905249+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:24:05.905249+0000","last_peered":"2024-03-07T10:24:05.905249+0000","last_clean":"2024-03-07T10:24:05.905249+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:05.905249+0000","last_undegraded":"2024-03-07T10:24:05.905249+0000","last_fullsized":"2024-03-07T10:24:05.905249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021976+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:23:58.021976+0000","last_peered":"2024-03-07T10:23:58.021976+0000","last_clean":"2024-03-07T10:23:58.021976+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:23:58.021976+0000","last_undegraded":"2024-03-07T10:23:58.021976+0000","last_fullsized":"2024-03-07T10:23:58.021976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024972+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:23:58.024972+0000","last_peered":"2024-03-07T10:23:58.024972+0000","last_clean":"2024-03-07T10:23:58.024972+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:23:58.024972+0000","last_undegraded":"2024-03-07T10:23:58.024972+0000","last_fullsized":"2024-03-07T10:23:58.024972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020868+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:23:58.020868+0000","last_peered":"2024-03-07T10:23:58.020868+0000","last_clean":"2024-03-07T10:23:58.020868+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:23:58.020868+0000","last_undegraded":"2024-03-07T10:23:58.020868+0000","last_fullsized":"2024-03-07T10:23:58.020868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:38.380912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904960+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:24:05.904960+0000","last_peered":"2024-03-07T10:24:05.904960+0000","last_clean":"2024-03-07T10:24:05.904960+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:05.904960+0000","last_undegraded":"2024-03-07T10:24:05.904960+0000","last_fullsized":"2024-03-07T10:24:05.904960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025874+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:23:58.025874+0000","last_peered":"2024-03-07T10:23:58.025874+0000","last_clean":"2024-03-07T10:23:58.025874+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:23:58.025874+0000","last_undegraded":"2024-03-07T10:23:58.025874+0000","last_fullsized":"2024-03-07T10:23:58.025874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024476+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:23:58.024476+0000","last_peered":"2024-03-07T10:23:58.024476+0000","last_clean":"2024-03-07T10:23:58.024476+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:23:58.024476+0000","last_undegraded":"2024-03-07T10:23:58.024476+0000","last_fullsized":"2024-03-07T10:23:58.024476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019285+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:23:58.019285+0000","last_peered":"2024-03-07T10:23:58.019285+0000","last_clean":"2024-03-07T10:23:58.019285+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:23:58.019285+0000","last_undegraded":"2024-03-07T10:23:58.019285+0000","last_fullsized":"2024-03-07T10:23:58.019285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:37:50.822817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905323+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:24:05.905323+0000","last_peered":"2024-03-07T10:24:05.905323+0000","last_clean":"2024-03-07T10:24:05.905323+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:05.905323+0000","last_undegraded":"2024-03-07T10:24:05.905323+0000","last_fullsized":"2024-03-07T10:24:05.905323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019013+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:23:58.019013+0000","last_peered":"2024-03-07T10:23:58.019013+0000","last_clean":"2024-03-07T10:23:58.019013+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:23:58.019013+0000","last_undegraded":"2024-03-07T10:23:58.019013+0000","last_fullsized":"2024-03-07T10:23:58.019013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030524+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:23:58.030524+0000","last_peered":"2024-03-07T10:23:58.030524+0000","last_clean":"2024-03-07T10:23:58.030524+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:23:58.030524+0000","last_undegraded":"2024-03-07T10:23:58.030524+0000","last_fullsized":"2024-03-07T10:23:58.030524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:17.239721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026481+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:23:58.026481+0000","last_peered":"2024-03-07T10:23:58.026481+0000","last_clean":"2024-03-07T10:23:58.026481+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:23:58.026481+0000","last_undegraded":"2024-03-07T10:23:58.026481+0000","last_fullsized":"2024-03-07T10:23:58.026481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908498+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:24:05.908498+0000","last_peered":"2024-03-07T10:24:05.908498+0000","last_clean":"2024-03-07T10:24:05.908498+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:05.908498+0000","last_undegraded":"2024-03-07T10:24:05.908498+0000","last_fullsized":"2024-03-07T10:24:05.908498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036847+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:23:58.036847+0000","last_peered":"2024-03-07T10:23:58.036847+0000","last_clean":"2024-03-07T10:23:58.036847+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:23:58.036847+0000","last_undegraded":"2024-03-07T10:23:58.036847+0000","last_fullsized":"2024-03-07T10:23:58.036847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019400+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:23:58.019400+0000","last_peered":"2024-03-07T10:23:58.019400+0000","last_clean":"2024-03-07T10:23:58.019400+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:23:58.019400+0000","last_undegraded":"2024-03-07T10:23:58.019400+0000","last_fullsized":"2024-03-07T10:23:58.019400+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:53.314550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026935+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:23:58.026935+0000","last_peered":"2024-03-07T10:23:58.026935+0000","last_clean":"2024-03-07T10:23:58.026935+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:23:58.026935+0000","last_undegraded":"2024-03-07T10:23:58.026935+0000","last_fullsized":"2024-03-07T10:23:58.026935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906429+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:24:05.906429+0000","last_peered":"2024-03-07T10:24:05.906429+0000","last_clean":"2024-03-07T10:24:05.906429+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:05.906429+0000","last_undegraded":"2024-03-07T10:24:05.906429+0000","last_fullsized":"2024-03-07T10:24:05.906429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026621+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:23:58.026621+0000","last_peered":"2024-03-07T10:23:58.026621+0000","last_clean":"2024-03-07T10:23:58.026621+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:23:58.026621+0000","last_undegraded":"2024-03-07T10:23:58.026621+0000","last_fullsized":"2024-03-07T10:23:58.026621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'31","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:02.512699+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:24:02.512699+0000","last_peered":"2024-03-07T10:24:02.512699+0000","last_clean":"2024-03-07T10:24:02.512699+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:02.512699+0000","last_undegraded":"2024-03-07T10:24:02.512699+0000","last_fullsized":"2024-03-07T10:24:02.512699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39899,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":28,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016723+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:23:58.016723+0000","last_peered":"2024-03-07T10:23:58.016723+0000","last_clean":"2024-03-07T10:23:58.016723+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:23:58.016723+0000","last_undegraded":"2024-03-07T10:23:58.016723+0000","last_fullsized":"2024-03-07T10:23:58.016723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903527+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:24:05.903527+0000","last_peered":"2024-03-07T10:24:05.903527+0000","last_clean":"2024-03-07T10:24:05.903527+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:05.903527+0000","last_undegraded":"2024-03-07T10:24:05.903527+0000","last_fullsized":"2024-03-07T10:24:05.903527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031125+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:23:58.031125+0000","last_peered":"2024-03-07T10:23:58.031125+0000","last_clean":"2024-03-07T10:23:58.031125+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:23:58.031125+0000","last_undegraded":"2024-03-07T10:23:58.031125+0000","last_fullsized":"2024-03-07T10:23:58.031125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.030282+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:24:01.030282+0000","last_peered":"2024-03-07T10:24:01.030282+0000","last_clean":"2024-03-07T10:24:01.030282+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:01.030282+0000","last_undegraded":"2024-03-07T10:24:01.030282+0000","last_fullsized":"2024-03-07T10:24:01.030282+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017016+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:23:58.017016+0000","last_peered":"2024-03-07T10:23:58.017016+0000","last_clean":"2024-03-07T10:23:58.017016+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:23:58.017016+0000","last_undegraded":"2024-03-07T10:23:58.017016+0000","last_fullsized":"2024-03-07T10:23:58.017016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901641+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:24:05.901641+0000","last_peered":"2024-03-07T10:24:05.901641+0000","last_clean":"2024-03-07T10:24:05.901641+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:05.901641+0000","last_undegraded":"2024-03-07T10:24:05.901641+0000","last_fullsized":"2024-03-07T10:24:05.901641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.845529+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:24:05.845529+0000","last_peered":"2024-03-07T10:24:05.845529+0000","last_clean":"2024-03-07T10:24:05.845529+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:05.845529+0000","last_undegraded":"2024-03-07T10:24:05.845529+0000","last_fullsized":"2024-03-07T10:24:05.845529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021023+0000","last_change":"2024-03-07T10:21:08.280447+0000","last_active":"2024-03-07T10:23:58.021023+0000","last_peered":"2024-03-07T10:23:58.021023+0000","last_clean":"2024-03-07T10:23:58.021023+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:23:58.021023+0000","last_undegraded":"2024-03-07T10:23:58.021023+0000","last_fullsized":"2024-03-07T10:23:58.021023+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021596+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:23:58.021596+0000","last_peered":"2024-03-07T10:23:58.021596+0000","last_clean":"2024-03-07T10:23:58.021596+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:23:58.021596+0000","last_undegraded":"2024-03-07T10:23:58.021596+0000","last_fullsized":"2024-03-07T10:23:58.021596+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902224+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:24:05.902224+0000","last_peered":"2024-03-07T10:24:05.902224+0000","last_clean":"2024-03-07T10:24:05.902224+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:05.902224+0000","last_undegraded":"2024-03-07T10:24:05.902224+0000","last_fullsized":"2024-03-07T10:24:05.902224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024117+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:23:58.024117+0000","last_peered":"2024-03-07T10:23:58.024117+0000","last_clean":"2024-03-07T10:23:58.024117+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:23:58.024117+0000","last_undegraded":"2024-03-07T10:23:58.024117+0000","last_fullsized":"2024-03-07T10:23:58.024117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026448+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:23:58.026448+0000","last_peered":"2024-03-07T10:23:58.026448+0000","last_clean":"2024-03-07T10:23:58.026448+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:23:58.026448+0000","last_undegraded":"2024-03-07T10:23:58.026448+0000","last_fullsized":"2024-03-07T10:23:58.026448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036723+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:23:58.036723+0000","last_peered":"2024-03-07T10:23:58.036723+0000","last_clean":"2024-03-07T10:23:58.036723+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:23:58.036723+0000","last_undegraded":"2024-03-07T10:23:58.036723+0000","last_fullsized":"2024-03-07T10:23:58.036723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908330+0000","last_change":"2024-03-07T10:20:58.164216+0000","last_active":"2024-03-07T10:24:05.908330+0000","last_peered":"2024-03-07T10:24:05.908330+0000","last_clean":"2024-03-07T10:24:05.908330+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:05.908330+0000","last_undegraded":"2024-03-07T10:24:05.908330+0000","last_fullsized":"2024-03-07T10:24:05.908330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027480+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:23:58.027480+0000","last_peered":"2024-03-07T10:23:58.027480+0000","last_clean":"2024-03-07T10:23:58.027480+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:23:58.027480+0000","last_undegraded":"2024-03-07T10:23:58.027480+0000","last_fullsized":"2024-03-07T10:23:58.027480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"23'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.043454+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:24:01.043454+0000","last_peered":"2024-03-07T10:24:01.043454+0000","last_clean":"2024-03-07T10:24:01.043454+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:01.043454+0000","last_undegraded":"2024-03-07T10:24:01.043454+0000","last_fullsized":"2024-03-07T10:24:01.043454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:19.960744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047262+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:23:58.047262+0000","last_peered":"2024-03-07T10:23:58.047262+0000","last_clean":"2024-03-07T10:23:58.047262+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:23:58.047262+0000","last_undegraded":"2024-03-07T10:23:58.047262+0000","last_fullsized":"2024-03-07T10:23:58.047262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901905+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:24:05.901905+0000","last_peered":"2024-03-07T10:24:05.901905+0000","last_clean":"2024-03-07T10:24:05.901905+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:05.901905+0000","last_undegraded":"2024-03-07T10:24:05.901905+0000","last_fullsized":"2024-03-07T10:24:05.901905+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:05.409118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037698+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:23:58.037698+0000","last_peered":"2024-03-07T10:23:58.037698+0000","last_clean":"2024-03-07T10:23:58.037698+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:23:58.037698+0000","last_undegraded":"2024-03-07T10:23:58.037698+0000","last_fullsized":"2024-03-07T10:23:58.037698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015385+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:23:58.015385+0000","last_peered":"2024-03-07T10:23:58.015385+0000","last_clean":"2024-03-07T10:23:58.015385+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:23:58.015385+0000","last_undegraded":"2024-03-07T10:23:58.015385+0000","last_fullsized":"2024-03-07T10:23:58.015385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037601+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:23:58.037601+0000","last_peered":"2024-03-07T10:23:58.037601+0000","last_clean":"2024-03-07T10:23:58.037601+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:23:58.037601+0000","last_undegraded":"2024-03-07T10:23:58.037601+0000","last_fullsized":"2024-03-07T10:23:58.037601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030304+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:23:58.030304+0000","last_peered":"2024-03-07T10:23:58.030304+0000","last_clean":"2024-03-07T10:23:58.030304+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:23:58.030304+0000","last_undegraded":"2024-03-07T10:23:58.030304+0000","last_fullsized":"2024-03-07T10:23:58.030304+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:35.816218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910547+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:24:05.910547+0000","last_peered":"2024-03-07T10:24:05.910547+0000","last_clean":"2024-03-07T10:24:05.910547+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:05.910547+0000","last_undegraded":"2024-03-07T10:24:05.910547+0000","last_fullsized":"2024-03-07T10:24:05.910547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025312+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:23:58.025312+0000","last_peered":"2024-03-07T10:23:58.025312+0000","last_clean":"2024-03-07T10:23:58.025312+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:23:58.025312+0000","last_undegraded":"2024-03-07T10:23:58.025312+0000","last_fullsized":"2024-03-07T10:23:58.025312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030072+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:23:58.030072+0000","last_peered":"2024-03-07T10:23:58.030072+0000","last_clean":"2024-03-07T10:23:58.030072+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:23:58.030072+0000","last_undegraded":"2024-03-07T10:23:58.030072+0000","last_fullsized":"2024-03-07T10:23:58.030072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.044936+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:23:58.044936+0000","last_peered":"2024-03-07T10:23:58.044936+0000","last_clean":"2024-03-07T10:23:58.044936+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:23:58.044936+0000","last_undegraded":"2024-03-07T10:23:58.044936+0000","last_fullsized":"2024-03-07T10:23:58.044936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911084+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:24:05.911084+0000","last_peered":"2024-03-07T10:24:05.911084+0000","last_clean":"2024-03-07T10:24:05.911084+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:05.911084+0000","last_undegraded":"2024-03-07T10:24:05.911084+0000","last_fullsized":"2024-03-07T10:24:05.911084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016397+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:23:58.016397+0000","last_peered":"2024-03-07T10:23:58.016397+0000","last_clean":"2024-03-07T10:23:58.016397+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:23:58.016397+0000","last_undegraded":"2024-03-07T10:23:58.016397+0000","last_fullsized":"2024-03-07T10:23:58.016397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:11:43.938740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023755+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:23:58.023755+0000","last_peered":"2024-03-07T10:23:58.023755+0000","last_clean":"2024-03-07T10:23:58.023755+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:23:58.023755+0000","last_undegraded":"2024-03-07T10:23:58.023755+0000","last_fullsized":"2024-03-07T10:23:58.023755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037173+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:23:58.037173+0000","last_peered":"2024-03-07T10:23:58.037173+0000","last_clean":"2024-03-07T10:23:58.037173+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:23:58.037173+0000","last_undegraded":"2024-03-07T10:23:58.037173+0000","last_fullsized":"2024-03-07T10:23:58.037173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910066+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:24:05.910066+0000","last_peered":"2024-03-07T10:24:05.910066+0000","last_clean":"2024-03-07T10:24:05.910066+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:05.910066+0000","last_undegraded":"2024-03-07T10:24:05.910066+0000","last_fullsized":"2024-03-07T10:24:05.910066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.035701+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:24:01.035701+0000","last_peered":"2024-03-07T10:24:01.035701+0000","last_clean":"2024-03-07T10:24:01.035701+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:01.035701+0000","last_undegraded":"2024-03-07T10:24:01.035701+0000","last_fullsized":"2024-03-07T10:24:01.035701+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:30:24.739503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025302+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:23:58.025302+0000","last_peered":"2024-03-07T10:23:58.025302+0000","last_clean":"2024-03-07T10:23:58.025302+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:23:58.025302+0000","last_undegraded":"2024-03-07T10:23:58.025302+0000","last_fullsized":"2024-03-07T10:23:58.025302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017526+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:23:58.017526+0000","last_peered":"2024-03-07T10:23:58.017526+0000","last_clean":"2024-03-07T10:23:58.017526+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:23:58.017526+0000","last_undegraded":"2024-03-07T10:23:58.017526+0000","last_fullsized":"2024-03-07T10:23:58.017526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.890051+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:24:05.890051+0000","last_peered":"2024-03-07T10:24:05.890051+0000","last_clean":"2024-03-07T10:24:05.890051+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:05.890051+0000","last_undegraded":"2024-03-07T10:24:05.890051+0000","last_fullsized":"2024-03-07T10:24:05.890051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"27'3","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.031368+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:24:01.031368+0000","last_peered":"2024-03-07T10:24:01.031368+0000","last_clean":"2024-03-07T10:24:01.031368+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:01.031368+0000","last_undegraded":"2024-03-07T10:24:01.031368+0000","last_fullsized":"2024-03-07T10:24:01.031368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:12.496450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020470+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:23:58.020470+0000","last_peered":"2024-03-07T10:23:58.020470+0000","last_clean":"2024-03-07T10:23:58.020470+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:23:58.020470+0000","last_undegraded":"2024-03-07T10:23:58.020470+0000","last_fullsized":"2024-03-07T10:23:58.020470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912772+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:24:05.912772+0000","last_peered":"2024-03-07T10:24:05.912772+0000","last_clean":"2024-03-07T10:24:05.912772+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:05.912772+0000","last_undegraded":"2024-03-07T10:24:05.912772+0000","last_fullsized":"2024-03-07T10:24:05.912772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023010+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:23:58.023010+0000","last_peered":"2024-03-07T10:23:58.023010+0000","last_clean":"2024-03-07T10:23:58.023010+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:23:58.023010+0000","last_undegraded":"2024-03-07T10:23:58.023010+0000","last_fullsized":"2024-03-07T10:23:58.023010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:32.263632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.888725+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:24:05.888725+0000","last_peered":"2024-03-07T10:24:05.888725+0000","last_clean":"2024-03-07T10:24:05.888725+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:05.888725+0000","last_undegraded":"2024-03-07T10:24:05.888725+0000","last_fullsized":"2024-03-07T10:24:05.888725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027030+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:23:58.027030+0000","last_peered":"2024-03-07T10:23:58.027030+0000","last_clean":"2024-03-07T10:23:58.027030+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:23:58.027030+0000","last_undegraded":"2024-03-07T10:23:58.027030+0000","last_fullsized":"2024-03-07T10:23:58.027030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912442+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:24:05.912442+0000","last_peered":"2024-03-07T10:24:05.912442+0000","last_clean":"2024-03-07T10:24:05.912442+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:05.912442+0000","last_undegraded":"2024-03-07T10:24:05.912442+0000","last_fullsized":"2024-03-07T10:24:05.912442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023651+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:23:58.023651+0000","last_peered":"2024-03-07T10:23:58.023651+0000","last_clean":"2024-03-07T10:23:58.023651+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:23:58.023651+0000","last_undegraded":"2024-03-07T10:23:58.023651+0000","last_fullsized":"2024-03-07T10:23:58.023651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905520+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:24:05.905520+0000","last_peered":"2024-03-07T10:24:05.905520+0000","last_clean":"2024-03-07T10:24:05.905520+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:05.905520+0000","last_undegraded":"2024-03-07T10:24:05.905520+0000","last_fullsized":"2024-03-07T10:24:05.905520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047336+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:23:58.047336+0000","last_peered":"2024-03-07T10:23:58.047336+0000","last_clean":"2024-03-07T10:23:58.047336+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:23:58.047336+0000","last_undegraded":"2024-03-07T10:23:58.047336+0000","last_fullsized":"2024-03-07T10:23:58.047336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905368+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:24:05.905368+0000","last_peered":"2024-03-07T10:24:05.905368+0000","last_clean":"2024-03-07T10:24:05.905368+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:05.905368+0000","last_undegraded":"2024-03-07T10:24:05.905368+0000","last_fullsized":"2024-03-07T10:24:05.905368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024979+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:23:58.024979+0000","last_peered":"2024-03-07T10:23:58.024979+0000","last_clean":"2024-03-07T10:23:58.024979+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:23:58.024979+0000","last_undegraded":"2024-03-07T10:23:58.024979+0000","last_fullsized":"2024-03-07T10:23:58.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907474+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:24:05.907474+0000","last_peered":"2024-03-07T10:24:05.907474+0000","last_clean":"2024-03-07T10:24:05.907474+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:05.907474+0000","last_undegraded":"2024-03-07T10:24:05.907474+0000","last_fullsized":"2024-03-07T10:24:05.907474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047223+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:23:58.047223+0000","last_peered":"2024-03-07T10:23:58.047223+0000","last_clean":"2024-03-07T10:23:58.047223+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:23:58.047223+0000","last_undegraded":"2024-03-07T10:23:58.047223+0000","last_fullsized":"2024-03-07T10:23:58.047223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907491+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:24:05.907491+0000","last_peered":"2024-03-07T10:24:05.907491+0000","last_clean":"2024-03-07T10:24:05.907491+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:05.907491+0000","last_undegraded":"2024-03-07T10:24:05.907491+0000","last_fullsized":"2024-03-07T10:24:05.907491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036645+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:23:58.036645+0000","last_peered":"2024-03-07T10:23:58.036645+0000","last_clean":"2024-03-07T10:23:58.036645+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:23:58.036645+0000","last_undegraded":"2024-03-07T10:23:58.036645+0000","last_fullsized":"2024-03-07T10:23:58.036645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.884818+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:24:05.884818+0000","last_peered":"2024-03-07T10:24:05.884818+0000","last_clean":"2024-03-07T10:24:05.884818+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:05.884818+0000","last_undegraded":"2024-03-07T10:24:05.884818+0000","last_fullsized":"2024-03-07T10:24:05.884818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020310+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:23:58.020310+0000","last_peered":"2024-03-07T10:23:58.020310+0000","last_clean":"2024-03-07T10:23:58.020310+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:23:58.020310+0000","last_undegraded":"2024-03-07T10:23:58.020310+0000","last_fullsized":"2024-03-07T10:23:58.020310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.889451+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:24:05.889451+0000","last_peered":"2024-03-07T10:24:05.889451+0000","last_clean":"2024-03-07T10:24:05.889451+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:05.889451+0000","last_undegraded":"2024-03-07T10:24:05.889451+0000","last_fullsized":"2024-03-07T10:24:05.889451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048487+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:23:58.048487+0000","last_peered":"2024-03-07T10:23:58.048487+0000","last_clean":"2024-03-07T10:23:58.048487+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:23:58.048487+0000","last_undegraded":"2024-03-07T10:23:58.048487+0000","last_fullsized":"2024-03-07T10:23:58.048487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910340+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:24:05.910340+0000","last_peered":"2024-03-07T10:24:05.910340+0000","last_clean":"2024-03-07T10:24:05.910340+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:05.910340+0000","last_undegraded":"2024-03-07T10:24:05.910340+0000","last_fullsized":"2024-03-07T10:24:05.910340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021108+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:23:58.021108+0000","last_peered":"2024-03-07T10:23:58.021108+0000","last_clean":"2024-03-07T10:23:58.021108+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:23:58.021108+0000","last_undegraded":"2024-03-07T10:23:58.021108+0000","last_fullsized":"2024-03-07T10:23:58.021108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:37.741023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.900198+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:24:05.900198+0000","last_peered":"2024-03-07T10:24:05.900198+0000","last_clean":"2024-03-07T10:24:05.900198+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:05.900198+0000","last_undegraded":"2024-03-07T10:24:05.900198+0000","last_fullsized":"2024-03-07T10:24:05.900198+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:09.731817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018065+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:23:58.018065+0000","last_peered":"2024-03-07T10:23:58.018065+0000","last_clean":"2024-03-07T10:23:58.018065+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:23:58.018065+0000","last_undegraded":"2024-03-07T10:23:58.018065+0000","last_fullsized":"2024-03-07T10:23:58.018065+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911579+0000","last_change":"2024-03-07T10:20:58.166453+0000","last_active":"2024-03-07T10:24:05.911579+0000","last_peered":"2024-03-07T10:24:05.911579+0000","last_clean":"2024-03-07T10:24:05.911579+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:05.911579+0000","last_undegraded":"2024-03-07T10:24:05.911579+0000","last_fullsized":"2024-03-07T10:24:05.911579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024597+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:23:58.024597+0000","last_peered":"2024-03-07T10:23:58.024597+0000","last_clean":"2024-03-07T10:23:58.024597+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:23:58.024597+0000","last_undegraded":"2024-03-07T10:23:58.024597+0000","last_fullsized":"2024-03-07T10:23:58.024597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907976+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:24:05.907976+0000","last_peered":"2024-03-07T10:24:05.907976+0000","last_clean":"2024-03-07T10:24:05.907976+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:05.907976+0000","last_undegraded":"2024-03-07T10:24:05.907976+0000","last_fullsized":"2024-03-07T10:24:05.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024868+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:23:58.024868+0000","last_peered":"2024-03-07T10:23:58.024868+0000","last_clean":"2024-03-07T10:23:58.024868+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:23:58.024868+0000","last_undegraded":"2024-03-07T10:23:58.024868+0000","last_fullsized":"2024-03-07T10:23:58.024868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893801+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:24:05.893801+0000","last_peered":"2024-03-07T10:24:05.893801+0000","last_clean":"2024-03-07T10:24:05.893801+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:05.893801+0000","last_undegraded":"2024-03-07T10:24:05.893801+0000","last_fullsized":"2024-03-07T10:24:05.893801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025108+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:23:58.025108+0000","last_peered":"2024-03-07T10:23:58.025108+0000","last_clean":"2024-03-07T10:23:58.025108+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:23:58.025108+0000","last_undegraded":"2024-03-07T10:23:58.025108+0000","last_fullsized":"2024-03-07T10:23:58.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.895901+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:24:05.895901+0000","last_peered":"2024-03-07T10:24:05.895901+0000","last_clean":"2024-03-07T10:24:05.895901+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:05.895901+0000","last_undegraded":"2024-03-07T10:24:05.895901+0000","last_fullsized":"2024-03-07T10:24:05.895901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029175+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:23:58.029175+0000","last_peered":"2024-03-07T10:23:58.029175+0000","last_clean":"2024-03-07T10:23:58.029175+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:23:58.029175+0000","last_undegraded":"2024-03-07T10:23:58.029175+0000","last_fullsized":"2024-03-07T10:23:58.029175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.898971+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:24:05.898971+0000","last_peered":"2024-03-07T10:24:05.898971+0000","last_clean":"2024-03-07T10:24:05.898971+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:05.898971+0000","last_undegraded":"2024-03-07T10:24:05.898971+0000","last_fullsized":"2024-03-07T10:24:05.898971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:43.198368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023002+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:23:58.023002+0000","last_peered":"2024-03-07T10:23:58.023002+0000","last_clean":"2024-03-07T10:23:58.023002+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:23:58.023002+0000","last_undegraded":"2024-03-07T10:23:58.023002+0000","last_fullsized":"2024-03-07T10:23:58.023002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911103+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:24:05.911103+0000","last_peered":"2024-03-07T10:24:05.911103+0000","last_clean":"2024-03-07T10:24:05.911103+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:05.911103+0000","last_undegraded":"2024-03-07T10:24:05.911103+0000","last_fullsized":"2024-03-07T10:24:05.911103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025459+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:23:58.025459+0000","last_peered":"2024-03-07T10:23:58.025459+0000","last_clean":"2024-03-07T10:23:58.025459+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:23:58.025459+0000","last_undegraded":"2024-03-07T10:23:58.025459+0000","last_fullsized":"2024-03-07T10:23:58.025459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.883013+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:24:05.883013+0000","last_peered":"2024-03-07T10:24:05.883013+0000","last_clean":"2024-03-07T10:24:05.883013+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:05.883013+0000","last_undegraded":"2024-03-07T10:24:05.883013+0000","last_fullsized":"2024-03-07T10:24:05.883013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026942+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:23:58.026942+0000","last_peered":"2024-03-07T10:23:58.026942+0000","last_clean":"2024-03-07T10:23:58.026942+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:23:58.026942+0000","last_undegraded":"2024-03-07T10:23:58.026942+0000","last_fullsized":"2024-03-07T10:23:58.026942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905219+0000","last_change":"2024-03-07T10:20:58.164606+0000","last_active":"2024-03-07T10:24:05.905219+0000","last_peered":"2024-03-07T10:24:05.905219+0000","last_clean":"2024-03-07T10:24:05.905219+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:05.905219+0000","last_undegraded":"2024-03-07T10:24:05.905219+0000","last_fullsized":"2024-03-07T10:24:05.905219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:39:44.036637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048174+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:23:58.048174+0000","last_peered":"2024-03-07T10:23:58.048174+0000","last_clean":"2024-03-07T10:23:58.048174+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:23:58.048174+0000","last_undegraded":"2024-03-07T10:23:58.048174+0000","last_fullsized":"2024-03-07T10:23:58.048174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905669+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:24:05.905669+0000","last_peered":"2024-03-07T10:24:05.905669+0000","last_clean":"2024-03-07T10:24:05.905669+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:05.905669+0000","last_undegraded":"2024-03-07T10:24:05.905669+0000","last_fullsized":"2024-03-07T10:24:05.905669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016530+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:23:58.016530+0000","last_peered":"2024-03-07T10:23:58.016530+0000","last_clean":"2024-03-07T10:23:58.016530+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:23:58.016530+0000","last_undegraded":"2024-03-07T10:23:58.016530+0000","last_fullsized":"2024-03-07T10:23:58.016530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906195+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:24:05.906195+0000","last_peered":"2024-03-07T10:24:05.906195+0000","last_clean":"2024-03-07T10:24:05.906195+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:05.906195+0000","last_undegraded":"2024-03-07T10:24:05.906195+0000","last_fullsized":"2024-03-07T10:24:05.906195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020179+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:23:58.020179+0000","last_peered":"2024-03-07T10:23:58.020179+0000","last_clean":"2024-03-07T10:23:58.020179+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:23:58.020179+0000","last_undegraded":"2024-03-07T10:23:58.020179+0000","last_fullsized":"2024-03-07T10:23:58.020179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:48.281155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.914163+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:24:05.914163+0000","last_peered":"2024-03-07T10:24:05.914163+0000","last_clean":"2024-03-07T10:24:05.914163+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:05.914163+0000","last_undegraded":"2024-03-07T10:24:05.914163+0000","last_fullsized":"2024-03-07T10:24:05.914163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047776+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:23:58.047776+0000","last_peered":"2024-03-07T10:23:58.047776+0000","last_clean":"2024-03-07T10:23:58.047776+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:23:58.047776+0000","last_undegraded":"2024-03-07T10:23:58.047776+0000","last_fullsized":"2024-03-07T10:23:58.047776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.915299+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:24:05.915299+0000","last_peered":"2024-03-07T10:24:05.915299+0000","last_clean":"2024-03-07T10:24:05.915299+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:05.915299+0000","last_undegraded":"2024-03-07T10:24:05.915299+0000","last_fullsized":"2024-03-07T10:24:05.915299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025799+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:23:58.025799+0000","last_peered":"2024-03-07T10:23:58.025799+0000","last_clean":"2024-03-07T10:23:58.025799+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:23:58.025799+0000","last_undegraded":"2024-03-07T10:23:58.025799+0000","last_fullsized":"2024-03-07T10:23:58.025799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910637+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:24:05.910637+0000","last_peered":"2024-03-07T10:24:05.910637+0000","last_clean":"2024-03-07T10:24:05.910637+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:05.910637+0000","last_undegraded":"2024-03-07T10:24:05.910637+0000","last_fullsized":"2024-03-07T10:24:05.910637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020148+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:23:58.020148+0000","last_peered":"2024-03-07T10:23:58.020148+0000","last_clean":"2024-03-07T10:23:58.020148+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:23:58.020148+0000","last_undegraded":"2024-03-07T10:23:58.020148+0000","last_fullsized":"2024-03-07T10:23:58.020148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911655+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:24:05.911655+0000","last_peered":"2024-03-07T10:24:05.911655+0000","last_clean":"2024-03-07T10:24:05.911655+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:05.911655+0000","last_undegraded":"2024-03-07T10:24:05.911655+0000","last_fullsized":"2024-03-07T10:24:05.911655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037509+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:23:58.037509+0000","last_peered":"2024-03-07T10:23:58.037509+0000","last_clean":"2024-03-07T10:23:58.037509+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:23:58.037509+0000","last_undegraded":"2024-03-07T10:23:58.037509+0000","last_fullsized":"2024-03-07T10:23:58.037509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912205+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:24:05.912205+0000","last_peered":"2024-03-07T10:24:05.912205+0000","last_clean":"2024-03-07T10:24:05.912205+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:05.912205+0000","last_undegraded":"2024-03-07T10:24:05.912205+0000","last_fullsized":"2024-03-07T10:24:05.912205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018365+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:23:58.018365+0000","last_peered":"2024-03-07T10:23:58.018365+0000","last_clean":"2024-03-07T10:23:58.018365+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:23:58.018365+0000","last_undegraded":"2024-03-07T10:23:58.018365+0000","last_fullsized":"2024-03-07T10:23:58.018365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911281+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:24:05.911281+0000","last_peered":"2024-03-07T10:24:05.911281+0000","last_clean":"2024-03-07T10:24:05.911281+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:05.911281+0000","last_undegraded":"2024-03-07T10:24:05.911281+0000","last_fullsized":"2024-03-07T10:24:05.911281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027137+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:23:58.027137+0000","last_peered":"2024-03-07T10:23:58.027137+0000","last_clean":"2024-03-07T10:23:58.027137+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:23:58.027137+0000","last_undegraded":"2024-03-07T10:23:58.027137+0000","last_fullsized":"2024-03-07T10:23:58.027137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.887465+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:24:05.887465+0000","last_peered":"2024-03-07T10:24:05.887465+0000","last_clean":"2024-03-07T10:24:05.887465+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:05.887465+0000","last_undegraded":"2024-03-07T10:24:05.887465+0000","last_fullsized":"2024-03-07T10:24:05.887465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015194+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:23:58.015194+0000","last_peered":"2024-03-07T10:23:58.015194+0000","last_clean":"2024-03-07T10:23:58.015194+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:23:58.015194+0000","last_undegraded":"2024-03-07T10:23:58.015194+0000","last_fullsized":"2024-03-07T10:23:58.015194+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913448+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:24:05.913448+0000","last_peered":"2024-03-07T10:24:05.913448+0000","last_clean":"2024-03-07T10:24:05.913448+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:05.913448+0000","last_undegraded":"2024-03-07T10:24:05.913448+0000","last_fullsized":"2024-03-07T10:24:05.913448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019986+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:23:58.019986+0000","last_peered":"2024-03-07T10:23:58.019986+0000","last_clean":"2024-03-07T10:23:58.019986+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:23:58.019986+0000","last_undegraded":"2024-03-07T10:23:58.019986+0000","last_fullsized":"2024-03-07T10:23:58.019986+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:39.316098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909442+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:24:05.909442+0000","last_peered":"2024-03-07T10:24:05.909442+0000","last_clean":"2024-03-07T10:24:05.909442+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:05.909442+0000","last_undegraded":"2024-03-07T10:24:05.909442+0000","last_fullsized":"2024-03-07T10:24:05.909442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047140+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:23:58.047140+0000","last_peered":"2024-03-07T10:23:58.047140+0000","last_clean":"2024-03-07T10:23:58.047140+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:23:58.047140+0000","last_undegraded":"2024-03-07T10:23:58.047140+0000","last_fullsized":"2024-03-07T10:23:58.047140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893171+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:24:05.893171+0000","last_peered":"2024-03-07T10:24:05.893171+0000","last_clean":"2024-03-07T10:24:05.893171+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:05.893171+0000","last_undegraded":"2024-03-07T10:24:05.893171+0000","last_fullsized":"2024-03-07T10:24:05.893171+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047261+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:23:58.047261+0000","last_peered":"2024-03-07T10:23:58.047261+0000","last_clean":"2024-03-07T10:23:58.047261+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:23:58.047261+0000","last_undegraded":"2024-03-07T10:23:58.047261+0000","last_fullsized":"2024-03-07T10:23:58.047261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907990+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:24:05.907990+0000","last_peered":"2024-03-07T10:24:05.907990+0000","last_clean":"2024-03-07T10:24:05.907990+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:05.907990+0000","last_undegraded":"2024-03-07T10:24:05.907990+0000","last_fullsized":"2024-03-07T10:24:05.907990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":41000,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":157,"num_read_kb":199,"num_write":90,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":82000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":339968,"data_stored":134893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":421888,"data_stored":212696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":376832,"data_stored":174441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":39921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:24:11.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:24:11.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.755+0000 7fc6b3400640 1 Processor -- start 2024-03-07T10:24:11.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.755+0000 7fc6b3400640 1 -- start start 2024-03-07T10:24:11.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b3400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fc6ac152da0 0x7fc6ac0c5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 0x7fc6ac155e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b3400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac159cd0 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b3400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ac159840 con 0x7fc6ac152da0 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac153180 con 0x7fc6ac0c5ec0 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6abe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fc6ac0c6e50 0x7fc6ac155780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:42990/0 (socket says 172.21.15.194:42990) 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6abe00640 1 -- 172.21.15.194:0/313718193 learned_addr learned my addr 172.21.15.194:0/313718193 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b1400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 0x7fc6ac155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.757+0000 7fc6b0a00640 1 --2- 172.21.15.194:0/313718193 >> v2:172.21.15.196:3300/0 conn(0x7fc6ac152da0 0x7fc6ac0c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568634052 0 0) 0x7fc6ac159cd0 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc694003520 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2232912313 0 0) 0x7fc694003520 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 msgr2=0x7fc6ac155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 0x7fc6ac155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.762 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 >> v2:172.21.15.196:3300/0 conn(0x7fc6ac152da0 msgr2=0x7fc6ac0c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 --2- 172.21.15.194:0/313718193 >> v2:172.21.15.196:3300/0 conn(0x7fc6ac152da0 0x7fc6ac0c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac158f10 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fc698001670 con 0x7fc6ac0c6e50 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 >> v1:172.21.15.194:6789/0 conn(0x7fc6ac0c6e50 legacy=0x7fc6ac155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6940039b0 0x7fc694003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc694004800 0x7fc694004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 0x7fc6940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac159840 con 0x7fc694004800 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac153180 con 0x7fc6940039b0 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69400ba10 con 0x7fc6ac0c5ec0 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.758+0000 7fc6abe00640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc694004800 0x7fc694004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6abe00640 1 -- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 msgr2=0x7fc6940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6b0a00640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6940039b0 0x7fc694003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.763 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6abe00640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc6ac0c5ec0 0x7fc6940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6abe00640 1 -- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6940039b0 msgr2=0x7fc694003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6abe00640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6940039b0 0x7fc694003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.759+0000 7fc6abe00640 1 -- 172.21.15.194:0/313718193 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694003520 con 0x7fc694004800 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.760+0000 7fc6abe00640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc694004800 0x7fc694004c80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c1c0 tx=0x7fc694005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac476fe55aeb86bf server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.760+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698007c80 con 0x7fc694004800 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.760+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698030070 con 0x7fc694004800 2024-03-07T10:24:11.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.760+0000 7fc6ab400640 1 -- 172.21.15.194:0/313718193 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698005d30 con 0x7fc694004800 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 -- 172.21.15.194:0/313718193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc694004800 msgr2=0x7fc694004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 --2- 172.21.15.194:0/313718193 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc694004800 0x7fc694004c80 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c1c0 tx=0x7fc694005830 comp rx=0 tx=0).stop 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b1400640 1 -- 172.21.15.194:0/313718193 reap_dead start 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 -- 172.21.15.194:0/313718193 shutdown_connections 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 -- 172.21.15.194:0/313718193 >> 172.21.15.194:0/313718193 conn(0x7fc6ac0c8f50 msgr2=0x7fc6ac0c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 -- 172.21.15.194:0/313718193 shutdown_connections 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.761+0000 7fc6b3400640 1 -- 172.21.15.194:0/313718193 wait complete. 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.763+0000 7fc6b3400640 1 Processor -- start 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.763+0000 7fc6b3400640 1 -- start start 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc694004800 0x7fc6ac0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6ac157e10 0x7fc6ac06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0c43d0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac1594d0 con 0x7fc6ac157e10 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b3400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac071500 con 0x7fc694004800 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6abe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6abe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60818/0 (socket says 172.21.15.194:60818) 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6abe00640 1 -- 172.21.15.194:0/1694360251 learned_addr learned my addr 172.21.15.194:0/1694360251 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b0a00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc694004800 0x7fc6ac0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.764+0000 7fc6b1400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6ac157e10 0x7fc6ac06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 -- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc694004800 msgr2=0x7fc6ac0abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc694004800 0x7fc6ac0abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 -- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6ac157e10 msgr2=0x7fc6ac06d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6ac157e10 0x7fc6ac06d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 -- 172.21.15.194:0/1694360251 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac1eeee0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6abe00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c2e0 tx=0x7fc698001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698001bc0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698004bf0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac1ef1c0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.765+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698007070 con 0x7fc6ac0707a0 2024-03-07T10:24:11.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.766+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac157610 con 0x7fc6ac0707a0 2024-03-07T10:24:11.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.767+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac068880 con 0x7fc6ac0707a0 2024-03-07T10:24:11.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.768+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fc698007210 con 0x7fc6ac0707a0 2024-03-07T10:24:11.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.769+0000 7fc6a8c00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 0x7fc68c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:11.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.769+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fc6980abcc0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.771 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.770+0000 7fc6b0a00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 0x7fc68c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:11.773 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.771+0000 7fc6b0a00640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 0x7fc68c06d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009a10 tx=0x7fc6a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:11.774 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.773+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fc69807a730 con 0x7fc6ac0707a0 2024-03-07T10:24:11.970 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.969+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ac0c67e0 con 0x7fc6ac0707a0 2024-03-07T10:24:11.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.972+0000 7fc6a8c00640 1 -- 172.21.15.194:0/1694360251 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21036 (secure 0 0 0) 0x7fc69807a030 con 0x7fc6ac0707a0 2024-03-07T10:24:11.974 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:11.974 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":29,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:23:58.005671+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.196:6835/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6832/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.196:6834/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6835/1436303034":"2024-03-08T10:22:52.989185+0000","172.21.15.194:6833/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.194:6834/1436303034":"2024-03-08T10:22:52.989185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 msgr2=0x7fc68c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 0x7fc68c06d990 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009a10 tx=0x7fc6a0008040 comp rx=0 tx=0).stop 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 msgr2=0x7fc6ac06ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c2e0 tx=0x7fc698001970 comp rx=0 tx=0).stop 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 shutdown_connections 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fc68c06b4d0 0x7fc68c06d990 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fc6ac157e10 0x7fc6ac06d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6ac0707a0 0x7fc6ac06ff70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 --2- 172.21.15.194:0/1694360251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fc694004800 0x7fc6ac0abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:11.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.975+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 >> 172.21.15.194:0/1694360251 conn(0x7fc6ac0c8f50 msgr2=0x7fc6ac151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:11.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.976+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 shutdown_connections 2024-03-07T10:24:11.978 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:11.976+0000 7fc6b3400640 1 -- 172.21.15.194:0/1694360251 wait complete. 2024-03-07T10:24:12.998 INFO:tasks.ceph:Scrubbing osd.0 2024-03-07T10:24:12.998 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:13.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.224+0000 7f4eee600640 1 Processor -- start 2024-03-07T10:24:13.226 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.224+0000 7f4eee600640 1 -- start start 2024-03-07T10:24:13.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4eee600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4ee80c08a0 0x7f4ee8159410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4eee600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee8155820 con 0x7f4ee80c03f0 2024-03-07T10:24:13.228 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4eee600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee8155b00 con 0x7f4ee814f6b0 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4eee600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee8155de0 con 0x7f4ee80c08a0 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4ee6a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f4ee80c03f0 0x7f4ee8158d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43002/0 (socket says 172.21.15.194:43002) 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4ee6a00640 1 -- 172.21.15.194:0/1647203995 learned_addr learned my addr 172.21.15.194:0/1647203995 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.225+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/1647203995 >> v2:172.21.15.194:3300/0 conn(0x7f4ee80c08a0 0x7f4ee8159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.226+0000 7f4ee6000640 1 -- 172.21.15.194:0/1647203995 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344508427 0 0) 0x7f4ee8155820 con 0x7f4ee80c03f0 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.226+0000 7f4ee6000640 1 -- 172.21.15.194:0/1647203995 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ecc003520 con 0x7f4ee80c03f0 2024-03-07T10:24:13.229 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.226+0000 7f4ee7e00640 1 -- 172.21.15.194:0/1647203995 >> v1:172.21.15.196:6789/0 conn(0x7f4ee814f6b0 legacy=0x7f4ee80c2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:13.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.226+0000 7f4ee7e00640 1 -- 172.21.15.194:0/1647203995 >> v1:172.21.15.194:6789/0 conn(0x7f4ee80c03f0 legacy=0x7f4ee8158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.230 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.226+0000 7f4ee7e00640 1 -- 172.21.15.194:0/1647203995 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee81560c0 con 0x7f4ee80c08a0 2024-03-07T10:24:13.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.228+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/1647203995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c08a0 0x7f4ee8159410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009d90 tx=0x7f4ee002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2029c58eac2baafb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.232 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.228+0000 7f4ee6000640 1 -- 172.21.15.194:0/1647203995 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0039070 con 0x7f4ee80c08a0 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.228+0000 7f4ee6000640 1 -- 172.21.15.194:0/1647203995 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee002cc60 con 0x7f4ee80c08a0 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.228+0000 7f4ee6000640 1 -- 172.21.15.194:0/1647203995 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0034660 con 0x7f4ee80c08a0 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 -- 172.21.15.194:0/1647203995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c08a0 msgr2=0x7f4ee8159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 --2- 172.21.15.194:0/1647203995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c08a0 0x7f4ee8159410 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0009d90 tx=0x7f4ee002beb0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 -- 172.21.15.194:0/1647203995 shutdown_connections 2024-03-07T10:24:13.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 --2- 172.21.15.194:0/1647203995 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c08a0 0x7f4ee8159410 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 -- 172.21.15.194:0/1647203995 >> 172.21.15.194:0/1647203995 conn(0x7f4ee80c6fc0 msgr2=0x7f4ee80c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 -- 172.21.15.194:0/1647203995 shutdown_connections 2024-03-07T10:24:13.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.229+0000 7f4eee600640 1 -- 172.21.15.194:0/1647203995 wait complete. 2024-03-07T10:24:13.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.231+0000 7f4eee600640 1 Processor -- start 2024-03-07T10:24:13.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.231+0000 7f4eee600640 1 -- start start 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 0x7f4ee8157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee80c08a0 0x7f4ee81ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee814f6b0 0x7f4ee8148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee814fa90 con 0x7f4ee80c03f0 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80c35a0 con 0x7f4ee814f6b0 2024-03-07T10:24:13.242 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4eee600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee814fc10 con 0x7f4ee80c08a0 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4ee7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 0x7f4ee8157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4ee7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 0x7f4ee8157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60830/0 (socket says 172.21.15.194:60830) 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.232+0000 7f4ee7400640 1 -- 172.21.15.194:0/3928368152 learned_addr learned my addr 172.21.15.194:0/3928368152 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee6a00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee80c08a0 0x7f4ee81ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee814f6b0 0x7f4ee8148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.243 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 -- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee80c08a0 msgr2=0x7f4ee81ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee80c08a0 0x7f4ee81ec3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 -- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee814f6b0 msgr2=0x7f4ee8148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee814f6b0 0x7f4ee8148bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80a9840 con 0x7f4ee80c03f0 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee6a00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f4ee80c08a0 0x7f4ee81ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:13.244 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f4ee814f6b0 0x7f4ee8148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4ee7400640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 0x7f4ee8157f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c3c0 tx=0x7f4ed800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80052d0 con 0x7f4ee80c03f0 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed8005490 con 0x7f4ee80c03f0 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8157440 con 0x7f4ee80c03f0 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8007260 con 0x7f4ee80c03f0 2024-03-07T10:24:13.245 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.233+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee8157a00 con 0x7f4ee80c03f0 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.234+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ee8157290 con 0x7f4ee80c03f0 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.236+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f4ed8007400 con 0x7f4ee80c03f0 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.236+0000 7f4edf400640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ec806b4d0 0x7f4ec806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f4ed8089af0 con 0x7f4ee80c03f0 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4edf400640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f4ec80760c0 0x7f4ec8078540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ed8009e50 con 0x7f4ec80760c0 2024-03-07T10:24:13.246 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed808e2c0 con 0x7f4ee80c03f0 2024-03-07T10:24:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4ee6a00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ec806b4d0 0x7f4ec806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.237+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f4ec80760c0 0x7f4ec8078540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.238+0000 7f4ee7e00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f4ec80760c0 0x7f4ec8078540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.238+0000 7f4ee6a00640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ec806b4d0 0x7f4ec806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ee81e8d00 tx=0x7f4ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.247 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.239+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== osd.0 v2:172.21.15.194:6808/1656769343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4ed8009e50 con 0x7f4ec80760c0 2024-03-07T10:24:13.254 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.253+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 --> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ee8068170 con 0x7f4ec80760c0 2024-03-07T10:24:13.255 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4edf400640 1 -- 172.21.15.194:0/3928368152 <== osd.0 v2:172.21.15.194:6808/1656769343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4ee8068170 con 0x7f4ec80760c0 2024-03-07T10:24:13.255 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:13.255 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:13.255 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:13.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f4ec80760c0 msgr2=0x7f4ec8078540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:6808/1656769343,v1:172.21.15.194:6809/1656769343] conn(0x7f4ec80760c0 0x7f4ec8078540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ec806b4d0 msgr2=0x7f4ec806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f4ec806b4d0 0x7f4ec806d990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4ee81e8d00 tx=0x7f4ed4009040 comp rx=0 tx=0).stop 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 msgr2=0x7f4ee8157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 --2- 172.21.15.194:0/3928368152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ee80c03f0 0x7f4ee8157f20 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800c3c0 tx=0x7f4ed800c880 comp rx=0 tx=0).stop 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4ee7e00640 1 -- 172.21.15.194:0/3928368152 reap_dead start 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 shutdown_connections 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.254+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 >> 172.21.15.194:0/3928368152 conn(0x7f4ee80c6fc0 msgr2=0x7f4ee80c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.255+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 shutdown_connections 2024-03-07T10:24:13.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.255+0000 7f4eee600640 1 -- 172.21.15.194:0/3928368152 wait complete. 2024-03-07T10:24:13.272 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-07T10:24:13.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.481+0000 7f31c7c00640 1 Processor -- start 2024-03-07T10:24:13.482 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.481+0000 7f31c7c00640 1 -- start start 2024-03-07T10:24:13.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.482+0000 7f31c7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.483 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.482+0000 7f31c7c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 0x7f31c006d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.482+0000 7f31c7c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c0153980 con 0x7f31c00a9a10 2024-03-07T10:24:13.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.482+0000 7f31c7c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c006e550 con 0x7f31c0156c20 2024-03-07T10:24:13.484 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.482+0000 7f31c7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0153c60 con 0x7f31c0150b70 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.483+0000 7f31bfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 0x7f31c006d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.483+0000 7f31c5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.483+0000 7f31c5200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:43846/0 (socket says 172.21.15.194:43846) 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.483+0000 7f31c5200640 1 -- 172.21.15.194:0/1942903384 learned_addr learned my addr 172.21.15.194:0/1942903384 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.483+0000 7f31bfe00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 0x7f31c006d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:51636/0 (socket says 172.21.15.194:51636) 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.484+0000 7f31c5200640 1 -- 172.21.15.194:0/1942903384 >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 msgr2=0x7f31c006d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:13.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.484+0000 7f31c5200640 1 --2- 172.21.15.194:0/1942903384 >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 0x7f31c006d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.484+0000 7f31c5200640 1 -- 172.21.15.194:0/1942903384 >> v1:172.21.15.196:6789/0 conn(0x7f31c00a9a10 legacy=0x7f31c006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.484+0000 7f31c5200640 1 -- 172.21.15.194:0/1942903384 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0153f40 con 0x7f31c0150b70 2024-03-07T10:24:13.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.485+0000 7f31c5200640 1 --2- 172.21.15.194:0/1942903384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009870 tx=0x7f31b402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4704266da6de7398 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.486+0000 7f31bf400640 1 -- 172.21.15.194:0/1942903384 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4035020 con 0x7f31c0150b70 2024-03-07T10:24:13.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.486+0000 7f31bf400640 1 -- 172.21.15.194:0/1942903384 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4031640 con 0x7f31c0150b70 2024-03-07T10:24:13.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.486+0000 7f31bf400640 1 -- 172.21.15.194:0/1942903384 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b402d040 con 0x7f31c0150b70 2024-03-07T10:24:13.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 -- 172.21.15.194:0/1942903384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 msgr2=0x7f31c00a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 --2- 172.21.15.194:0/1942903384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009870 tx=0x7f31b402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 -- 172.21.15.194:0/1942903384 shutdown_connections 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 --2- 172.21.15.194:0/1942903384 >> v2:172.21.15.196:3300/0 conn(0x7f31c0156c20 0x7f31c006d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 --2- 172.21.15.194:0/1942903384 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c0150b70 0x7f31c00a94d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 -- 172.21.15.194:0/1942903384 >> 172.21.15.194:0/1942903384 conn(0x7f31c006b840 msgr2=0x7f31c00c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 -- 172.21.15.194:0/1942903384 shutdown_connections 2024-03-07T10:24:13.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.487+0000 7f31c7c00640 1 -- 172.21.15.194:0/1942903384 wait complete. 2024-03-07T10:24:13.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.489+0000 7f31c7c00640 1 Processor -- start 2024-03-07T10:24:13.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.489+0000 7f31c7c00640 1 -- start start 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.490+0000 7f31c7c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c00a9a10 0x7f31c0072580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c7c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31c0150b70 0x7f31c01514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c7c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c7c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c0153630 con 0x7f31c0156c20 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c7c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00c7a30 con 0x7f31c0150b70 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c7c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c00ac460 con 0x7f31c00a9a10 2024-03-07T10:24:13.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60834/0 (socket says 172.21.15.194:60834) 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c5c00640 1 -- 172.21.15.194:0/4122455091 learned_addr learned my addr 172.21.15.194:0/4122455091 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31bfe00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31c0150b70 0x7f31c01514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.491+0000 7f31c5200640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c00a9a10 0x7f31c0072580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 -- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c00a9a10 msgr2=0x7f31c0072580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c00a9a10 0x7f31c0072580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 -- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31c0150b70 msgr2=0x7f31c01514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31c0150b70 0x7f31c01514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 -- 172.21.15.194:0/4122455091 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0071c50 con 0x7f31c0156c20 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c5c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c760 tx=0x7f31b800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8016020 con 0x7f31c0156c20 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b8006d50 con 0x7f31c0156c20 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c014fb40 con 0x7f31c0156c20 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.492+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8003bb0 con 0x7f31c0156c20 2024-03-07T10:24:13.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.493+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c00c4e60 con 0x7f31c0156c20 2024-03-07T10:24:13.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.494+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0068170 con 0x7f31c0156c20 2024-03-07T10:24:13.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.495+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f31b80050d0 con 0x7f31c0156c20 2024-03-07T10:24:13.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.496+0000 7f31bcc00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 0x7f31a006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.496+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f31b808a150 con 0x7f31c0156c20 2024-03-07T10:24:13.498 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.497+0000 7f31c5200640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 0x7f31a006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.498+0000 7f31c5200640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 0x7f31a006d9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31b4036000 tx=0x7f31b403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.501+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f31b8020020 con 0x7f31c0156c20 2024-03-07T10:24:13.697 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.696+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f31c006cd20 con 0x7f31a006b500 2024-03-07T10:24:13.698 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.697+0000 7f31bcc00640 1 -- 172.21.15.194:0/4122455091 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31c006cd20 con 0x7f31a006b500 2024-03-07T10:24:13.698 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 0 to deep-scrub 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 msgr2=0x7f31a006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 0x7f31a006d9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31b4036000 tx=0x7f31b403c040 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 msgr2=0x7f31c01519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f31b800c760 tx=0x7f31b800cb60 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 shutdown_connections 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f31a006b500 0x7f31a006d9c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f31c0156c20 0x7f31c01519e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f31c0150b70 0x7f31c01514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 --2- 172.21.15.194:0/4122455091 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f31c00a9a10 0x7f31c0072580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 >> 172.21.15.194:0/4122455091 conn(0x7f31c006b840 msgr2=0x7f31c00c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 shutdown_connections 2024-03-07T10:24:13.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.700+0000 7f31c7c00640 1 -- 172.21.15.194:0/4122455091 wait complete. 2024-03-07T10:24:13.720 INFO:tasks.ceph:Scrubbing osd.1 2024-03-07T10:24:13.720 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:13.925 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.924+0000 7f012f400640 1 Processor -- start 2024-03-07T10:24:13.926 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.924+0000 7f012f400640 1 -- start start 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.925+0000 7f012f400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f012814f890 0x7f01280c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.925+0000 7f012f400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280cb6e0 con 0x7f01281561d0 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.925+0000 7f012f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01280cb9c0 con 0x7f01280c5990 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.925+0000 7f012f400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012814fc70 con 0x7f012814f890 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.926+0000 7f011fe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f01281561d0 0x7f0128159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43014/0 (socket says 172.21.15.194:43014) 2024-03-07T10:24:13.927 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.926+0000 7f011fe00640 1 -- 172.21.15.194:0/3851125353 learned_addr learned my addr 172.21.15.194:0/3851125353 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:13.928 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.926+0000 7f012ca00640 1 --2- 172.21.15.194:0/3851125353 >> v2:172.21.15.196:3300/0 conn(0x7f012814f890 0x7f01280c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.926+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215975360 0 0) 0x7f01280cb6e0 con 0x7f01281561d0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.926+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f010c003520 con 0x7f01281561d0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 324999542 0 0) 0x7f010c003520 con 0x7f01281561d0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 >> v2:172.21.15.196:3300/0 conn(0x7f012814f890 msgr2=0x7f01280c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 --2- 172.21.15.194:0/3851125353 >> v2:172.21.15.196:3300/0 conn(0x7f012814f890 0x7f01280c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 >> v1:172.21.15.196:6789/0 conn(0x7f01280c5990 legacy=0x7f01281600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128158e70 con 0x7f01281561d0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f0110001670 con 0x7f01281561d0 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 >> v1:172.21.15.194:6789/0 conn(0x7f01281561d0 legacy=0x7f0128159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 0x7f010c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.930 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c004800 0x7f010c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f010c0052e0 0x7f010c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012814fc70 con 0x7f010c0039b0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c00c1b0 con 0x7f010c0052e0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.927+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c00c3b0 con 0x7f010c004800 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012d400640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f010c0052e0 0x7f010c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 0x7f010c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f011fe00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c004800 0x7f010c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 -- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c004800 msgr2=0x7f010c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c004800 0x7f010c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 -- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f010c0052e0 msgr2=0x7f010c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f010c0052e0 0x7f010c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012ca00640 1 -- 172.21.15.194:0/3851125353 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c003520 con 0x7f010c0039b0 2024-03-07T10:24:13.931 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.928+0000 7f012d400640 1 -- 172.21.15.194:0/3851125353 reap_dead start 2024-03-07T10:24:13.932 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.929+0000 7f012ca00640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 0x7f010c003dd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0118009f90 tx=0x7f010c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddf9eb710dd2e6f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118039070 con 0x7f010c0039b0 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011802cbd0 con 0x7f010c0039b0 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f0127e00640 1 -- 172.21.15.194:0/3851125353 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0118009c10 con 0x7f010c0039b0 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 -- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 msgr2=0x7f010c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 0x7f010c003dd0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0118009f90 tx=0x7f010c005830 comp rx=0 tx=0).stop 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 -- 172.21.15.194:0/3851125353 shutdown_connections 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 --2- 172.21.15.194:0/3851125353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c0039b0 0x7f010c003dd0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 -- 172.21.15.194:0/3851125353 >> 172.21.15.194:0/3851125353 conn(0x7f0128066f70 msgr2=0x7f0128067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 -- 172.21.15.194:0/3851125353 shutdown_connections 2024-03-07T10:24:13.933 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.930+0000 7f012f400640 1 -- 172.21.15.194:0/3851125353 wait complete. 2024-03-07T10:24:13.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.932+0000 7f012f400640 1 Processor -- start 2024-03-07T10:24:13.934 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.932+0000 7f012f400640 1 -- start start 2024-03-07T10:24:13.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c0039b0 0x7f01281ee430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 0x7f0128148db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01281492f0 0x7f01281ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01280cbca0 con 0x7f01281ee970 2024-03-07T10:24:13.935 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01281591e0 con 0x7f01281492f0 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f012f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0128156650 con 0x7f010c0039b0 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f011fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 0x7f0128148db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f011fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 0x7f0128148db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60852/0 (socket says 172.21.15.194:60852) 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.933+0000 7f011fe00640 1 -- 172.21.15.194:0/166088367 learned_addr learned my addr 172.21.15.194:0/166088367 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f012ca00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c0039b0 0x7f01281ee430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 -- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c0039b0 msgr2=0x7f01281ee430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f010c0039b0 0x7f01281ee430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 -- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01281492f0 msgr2=0x7f01281ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f01281492f0 0x7f01281ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01280ad840 con 0x7f01281ee970 2024-03-07T10:24:13.936 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f011fe00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 0x7f0128148db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0110007310 tx=0x7f01100077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000f8c0 con 0x7f01281ee970 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0110018070 con 0x7f01281ee970 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011000fca0 con 0x7f01281ee970 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012814e2a0 con 0x7f01281ee970 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.934+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01280ad280 con 0x7f01281ee970 2024-03-07T10:24:13.937 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.935+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0128068880 con 0x7f01281ee970 2024-03-07T10:24:13.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.937+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f011001d460 con 0x7f01281ee970 2024-03-07T10:24:13.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.938+0000 7f0125600640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f010406b4d0 0x7f010406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.938+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f011008a690 con 0x7f01281ee970 2024-03-07T10:24:13.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.939+0000 7f0125600640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f01040760b0 0x7f0104078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:13.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.939+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0110015e70 con 0x7f01040760b0 2024-03-07T10:24:13.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.939+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0110091050 con 0x7f01281ee970 2024-03-07T10:24:13.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.939+0000 7f012ca00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f010406b4d0 0x7f010406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.939+0000 7f012d400640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f01040760b0 0x7f0104078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:13.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.940+0000 7f012d400640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f01040760b0 0x7f0104078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.940+0000 7f012ca00640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f010406b4d0 0x7f010406d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0118036000 tx=0x7f011802e000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:13.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.940+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== osd.1 v2:172.21.15.194:6800/3579621358 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0110015e70 con 0x7f01040760b0 2024-03-07T10:24:13.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.956+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 --> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f01280c1bf0 con 0x7f01040760b0 2024-03-07T10:24:13.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f0125600640 1 -- 172.21.15.194:0/166088367 <== osd.1 v2:172.21.15.194:6800/3579621358 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f01280c1bf0 con 0x7f01040760b0 2024-03-07T10:24:13.959 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:13.959 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:13.959 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:13.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f01040760b0 msgr2=0x7f0104078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:6800/3579621358,v1:172.21.15.194:6801/3579621358] conn(0x7f01040760b0 0x7f0104078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f010406b4d0 msgr2=0x7f010406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f010406b4d0 0x7f010406d990 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0118036000 tx=0x7f011802e000 comp rx=0 tx=0).stop 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 msgr2=0x7f0128148db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 --2- 172.21.15.194:0/166088367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f01281ee970 0x7f0128148db0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0110007310 tx=0x7f01100077d0 comp rx=0 tx=0).stop 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012d400640 1 -- 172.21.15.194:0/166088367 reap_dead start 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 shutdown_connections 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 >> 172.21.15.194:0/166088367 conn(0x7f0128066f70 msgr2=0x7f0128067350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.957+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 shutdown_connections 2024-03-07T10:24:13.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:13.958+0000 7f012f400640 1 -- 172.21.15.194:0/166088367 wait complete. 2024-03-07T10:24:13.976 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-07T10:24:14.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.177+0000 7f09f6c00640 1 Processor -- start 2024-03-07T10:24:14.179 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.178+0000 7f09f6c00640 1 -- start start 2024-03-07T10:24:14.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.179+0000 7f09f6c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f09f0158430 0x7f09f0155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.180 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.179+0000 7f09f6c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 0x7f09f0072730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.179+0000 7f09f6c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f00c79f0 con 0x7f09f00be5d0 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.179+0000 7f09f6c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f00736e0 con 0x7f09f0158430 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.179+0000 7f09f6c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f01564f0 con 0x7f09f00722a0 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.180+0000 7f09f5800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f09f0158430 0x7f09f0155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.180+0000 7f09f6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 0x7f09f0072730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.181 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.180+0000 7f09f5800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f09f0158430 0x7f09f0155fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3300/0 says I am v2:172.21.15.194:51658/0 (socket says 172.21.15.194:51658) 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.180+0000 7f09f5800640 1 -- 172.21.15.194:0/35385287 learned_addr learned my addr 172.21.15.194:0/35385287 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.181+0000 7f09f5800640 1 -- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 msgr2=0x7f09f0072730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.181+0000 7f09f5800640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 0x7f09f0072730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.181+0000 7f09f5800640 1 -- 172.21.15.194:0/35385287 >> v1:172.21.15.196:6789/0 conn(0x7f09f00be5d0 legacy=0x7f09f00c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.181+0000 7f09f5800640 1 -- 172.21.15.194:0/35385287 --> v2:172.21.15.196:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00c7c90 con 0x7f09f0158430 2024-03-07T10:24:14.182 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.181+0000 7f09f6200640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 0x7f09f0072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:24:14.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.182+0000 7f09f5800640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f0158430 0x7f09f0155fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d633521a2f7747 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.182+0000 7f09efe00640 1 -- 172.21.15.194:0/35385287 <== mon.1 v2:172.21.15.196:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4035020 con 0x7f09f0158430 2024-03-07T10:24:14.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.182+0000 7f09efe00640 1 -- 172.21.15.194:0/35385287 <== mon.1 v2:172.21.15.196:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4031640 con 0x7f09f0158430 2024-03-07T10:24:14.184 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.182+0000 7f09efe00640 1 -- 172.21.15.194:0/35385287 <== mon.1 v2:172.21.15.196:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e402d040 con 0x7f09f0158430 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 -- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f0158430 msgr2=0x7f09f0155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f0158430 0x7f09f0155fb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f09e4009870 tx=0x7f09e402b8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 -- 172.21.15.194:0/35385287 shutdown_connections 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f00722a0 0x7f09f0072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 --2- 172.21.15.194:0/35385287 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f0158430 0x7f09f0155fb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 -- 172.21.15.194:0/35385287 >> 172.21.15.194:0/35385287 conn(0x7f09f00acc90 msgr2=0x7f09f00ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 -- 172.21.15.194:0/35385287 shutdown_connections 2024-03-07T10:24:14.185 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.183+0000 7f09f6c00640 1 -- 172.21.15.194:0/35385287 wait complete. 2024-03-07T10:24:14.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.185+0000 7f09f6c00640 1 Processor -- start 2024-03-07T10:24:14.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.186+0000 7f09f6c00640 1 -- start start 2024-03-07T10:24:14.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 0x7f09f00bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f0158430 0x7f09f01ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f0158810 con 0x7f09f00be5d0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00c8250 con 0x7f09f00722a0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f6c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f00c5fd0 con 0x7f09f0158430 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60866/0 (socket says 172.21.15.194:60866) 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f4e00640 1 -- 172.21.15.194:0/873106960 learned_addr learned my addr 172.21.15.194:0/873106960 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.187+0000 7f09f5800640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 0x7f09f00bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f6200640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f0158430 0x7f09f01ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 -- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f0158430 msgr2=0x7f09f01ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f0158430 0x7f09f01ed520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 -- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 msgr2=0x7f09f00bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 0x7f09f00bf440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 -- 172.21.15.194:0/873106960 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f00bf980 con 0x7f09f00be5d0 2024-03-07T10:24:14.190 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f5800640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 0x7f09f00bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:24:14.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09f4e00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c400 tx=0x7f09dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.188+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0052d0 con 0x7f09f00be5d0 2024-03-07T10:24:14.191 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.189+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc005490 con 0x7f09f00be5d0 2024-03-07T10:24:14.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.189+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f00bfc20 con 0x7f09f00be5d0 2024-03-07T10:24:14.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.189+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc007260 con 0x7f09f00be5d0 2024-03-07T10:24:14.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.189+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f01eca40 con 0x7f09f00be5d0 2024-03-07T10:24:14.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.190+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f01538f0 con 0x7f09f00be5d0 2024-03-07T10:24:14.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.191+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f09dc007400 con 0x7f09f00be5d0 2024-03-07T10:24:14.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.193+0000 7f09ed600640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 0x7f09d006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.193+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f09dc089b50 con 0x7f09f00be5d0 2024-03-07T10:24:14.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.194+0000 7f09f5800640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 0x7f09d006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.195+0000 7f09f5800640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 0x7f09d006d9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09e4036000 tx=0x7f09e403c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.200 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.199+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f09f01538f0 con 0x7f09f00be5d0 2024-03-07T10:24:14.556 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.555+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f09f00732d0 con 0x7f09d006b500 2024-03-07T10:24:14.557 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.556+0000 7f09ed600640 1 -- 172.21.15.194:0/873106960 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f09f00732d0 con 0x7f09d006b500 2024-03-07T10:24:14.557 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 1 to deep-scrub 2024-03-07T10:24:14.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.558+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 msgr2=0x7f09d006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.558+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 0x7f09d006d9c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f09e4036000 tx=0x7f09e403c040 comp rx=0 tx=0).stop 2024-03-07T10:24:14.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 msgr2=0x7f09f00bff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.560 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f09dc00c400 tx=0x7f09dc00c8c0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 shutdown_connections 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f09d006b500 0x7f09d006d9c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f09f0158430 0x7f09f01ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09f00be5d0 0x7f09f00bff50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 --2- 172.21.15.194:0/873106960 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f09f00722a0 0x7f09f00bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 >> 172.21.15.194:0/873106960 conn(0x7f09f00acc90 msgr2=0x7f09f00ac330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 shutdown_connections 2024-03-07T10:24:14.561 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.559+0000 7f09f6c00640 1 -- 172.21.15.194:0/873106960 wait complete. 2024-03-07T10:24:14.578 INFO:tasks.ceph:Scrubbing osd.2 2024-03-07T10:24:14.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:14.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.820+0000 7f7826400640 1 Processor -- start 2024-03-07T10:24:14.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.820+0000 7f7826400640 1 -- start start 2024-03-07T10:24:14.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.821+0000 7f7826400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.821+0000 7f7826400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 0x7f78200c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f7826400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7820151160 con 0x7f7820150d80 2024-03-07T10:24:14.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f7826400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78200aeab0 con 0x7f78200c5230 2024-03-07T10:24:14.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f7826400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78201534d0 con 0x7f7820156ac0 2024-03-07T10:24:14.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f781fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f781fe00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:43896/0 (socket says 172.21.15.194:43896) 2024-03-07T10:24:14.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f781fe00640 1 -- 172.21.15.194:0/2962026210 learned_addr learned my addr 172.21.15.194:0/2962026210 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:14.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.822+0000 7f7825a00640 1 --2- 172.21.15.194:0/2962026210 >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 0x7f78200c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.823+0000 7f781fe00640 1 -- 172.21.15.194:0/2962026210 >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 msgr2=0x7f78200c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:14.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.823+0000 7f781fe00640 1 --2- 172.21.15.194:0/2962026210 >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 0x7f78200c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.823+0000 7f781fe00640 1 -- 172.21.15.194:0/2962026210 >> v1:172.21.15.196:6789/0 conn(0x7f7820150d80 legacy=0x7f7820153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.823+0000 7f781fe00640 1 -- 172.21.15.194:0/2962026210 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200c5af0 con 0x7f7820156ac0 2024-03-07T10:24:14.825 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.823+0000 7f7825a00640 1 --2- 172.21.15.194:0/2962026210 >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 0x7f78200c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:24:14.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.825+0000 7f781fe00640 1 --2- 172.21.15.194:0/2962026210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43f74b3130f71b7a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.825+0000 7f781f400640 1 -- 172.21.15.194:0/2962026210 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c035020 con 0x7f7820156ac0 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f781f400640 1 -- 172.21.15.194:0/2962026210 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c031640 con 0x7f7820156ac0 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f781f400640 1 -- 172.21.15.194:0/2962026210 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c02d040 con 0x7f7820156ac0 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 -- 172.21.15.194:0/2962026210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 msgr2=0x7f78200c4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 --2- 172.21.15.194:0/2962026210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f780c009870 tx=0x7f780c02b8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 -- 172.21.15.194:0/2962026210 shutdown_connections 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 --2- 172.21.15.194:0/2962026210 >> v2:172.21.15.196:3300/0 conn(0x7f78200c5230 0x7f78200c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 --2- 172.21.15.194:0/2962026210 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820156ac0 0x7f78200c4cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 -- 172.21.15.194:0/2962026210 >> 172.21.15.194:0/2962026210 conn(0x7f782006d290 msgr2=0x7f782006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:14.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 -- 172.21.15.194:0/2962026210 shutdown_connections 2024-03-07T10:24:14.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.826+0000 7f7826400640 1 -- 172.21.15.194:0/2962026210 wait complete. 2024-03-07T10:24:14.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.828+0000 7f7826400640 1 Processor -- start 2024-03-07T10:24:14.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.828+0000 7f7826400640 1 -- start start 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78200c5230 0x7f78201498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820150d80 0x7f782014e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 0x7f78201e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7820154350 con 0x7f7820156ac0 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78200c60b0 con 0x7f78200c5230 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7826400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78200c5780 con 0x7f7820150d80 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.829+0000 7f7825a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 0x7f78201e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 0x7f78201e9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60876/0 (socket says 172.21.15.194:60876) 2024-03-07T10:24:14.831 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 -- 172.21.15.194:0/3200539163 learned_addr learned my addr 172.21.15.194:0/3200539163 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:14.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f781fe00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820150d80 0x7f782014e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.832 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825000640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78200c5230 0x7f78201498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 -- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820150d80 msgr2=0x7f782014e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7820150d80 0x7f782014e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 -- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78200c5230 msgr2=0x7f78201498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f78200c5230 0x7f78201498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.833 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200ab910 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f7825a00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 0x7f78201e9410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f781800efc0 tx=0x7f7818009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.830+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818018030 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.831+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800cde0 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.831+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782014bde0 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.831+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818003bb0 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.831+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78200ab2c0 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.832+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78200a9cd0 con 0x7f7820156ac0 2024-03-07T10:24:14.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.833+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7818005d10 con 0x7f7820156ac0 2024-03-07T10:24:14.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781cc00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f780006b4d0 0x7f780006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f781808bcb0 con 0x7f7820156ac0 2024-03-07T10:24:14.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781cc00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f78000760b0 0x7f7800078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:14.835 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7818009a50 con 0x7f78000760b0 2024-03-07T10:24:14.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f781808c060 con 0x7f7820156ac0 2024-03-07T10:24:14.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f781fe00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f78000760b0 0x7f7800078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.834+0000 7f7825000640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f780006b4d0 0x7f780006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:14.836 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.835+0000 7f781fe00640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f78000760b0 0x7f7800078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.835+0000 7f7825000640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f780006b4d0 0x7f780006d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7814001640 tx=0x7f7814009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:14.837 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.836+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== osd.2 v2:172.21.15.194:6816/1248623532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7818009a50 con 0x7f78000760b0 2024-03-07T10:24:14.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.849+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 --> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7820149e10 con 0x7f78000760b0 2024-03-07T10:24:14.851 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f781cc00640 1 -- 172.21.15.194:0/3200539163 <== osd.2 v2:172.21.15.194:6816/1248623532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f780c031610 con 0x7f78000760b0 2024-03-07T10:24:14.851 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:14.852 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:14.852 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:14.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f78000760b0 msgr2=0x7f7800078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:6816/1248623532,v1:172.21.15.194:6817/1248623532] conn(0x7f78000760b0 0x7f7800078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f780006b4d0 msgr2=0x7f780006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f780006b4d0 0x7f780006d990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7814001640 tx=0x7f7814009040 comp rx=0 tx=0).stop 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 msgr2=0x7f78201e9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.850+0000 7f7826400640 1 --2- 172.21.15.194:0/3200539163 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7820156ac0 0x7f78201e9410 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f781800efc0 tx=0x7f7818009f90 comp rx=0 tx=0).stop 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.851+0000 7f7825a00640 1 -- 172.21.15.194:0/3200539163 reap_dead start 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.851+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 shutdown_connections 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.851+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 >> 172.21.15.194:0/3200539163 conn(0x7f782006d290 msgr2=0x7f7820153c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.851+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 shutdown_connections 2024-03-07T10:24:14.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:14.851+0000 7f7826400640 1 -- 172.21.15.194:0/3200539163 wait complete. 2024-03-07T10:24:14.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-07T10:24:15.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.059+0000 7fcb1f400640 1 Processor -- start 2024-03-07T10:24:15.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.059+0000 7fcb1f400640 1 -- start start 2024-03-07T10:24:15.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18150b70 0x7fcb180a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb180a9a10 0x7fcb1806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1f400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb18153980 con 0x7fcb18156c20 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1f400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1806e550 con 0x7fcb180a9a10 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18153c60 con 0x7fcb18150b70 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb180a9a10 0x7fcb1806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcb180a9a10 0x7fcb1806e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60882/0 (socket says 172.21.15.194:60882) 2024-03-07T10:24:15.063 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.061+0000 7fcb1d400640 1 -- 172.21.15.194:0/999720730 learned_addr learned my addr 172.21.15.194:0/999720730 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:15.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.062+0000 7fcb1d400640 1 -- 172.21.15.194:0/999720730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18150b70 msgr2=0x7fcb180a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:15.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.062+0000 7fcb1ca00640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18150b70 0x7fcb180a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.062+0000 7fcb1d400640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18150b70 0x7fcb180a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.062+0000 7fcb1d400640 1 -- 172.21.15.194:0/999720730 >> v1:172.21.15.196:6789/0 conn(0x7fcb18156c20 legacy=0x7fcb1806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:15.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.062+0000 7fcb1d400640 1 -- 172.21.15.194:0/999720730 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18153f40 con 0x7fcb180a9a10 2024-03-07T10:24:15.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.063+0000 7fcb1d400640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1806e010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e69b5bec2916230 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.063+0000 7fcb17400640 1 -- 172.21.15.194:0/999720730 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1002c9e0 con 0x7fcb180a9a10 2024-03-07T10:24:15.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.063+0000 7fcb17400640 1 -- 172.21.15.194:0/999720730 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1002cb80 con 0x7fcb180a9a10 2024-03-07T10:24:15.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.063+0000 7fcb17400640 1 -- 172.21.15.194:0/999720730 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100343f0 con 0x7fcb180a9a10 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 -- 172.21.15.194:0/999720730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 msgr2=0x7fcb1806e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1806e010 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1002be40 comp rx=0 tx=0).stop 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 -- 172.21.15.194:0/999720730 shutdown_connections 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1806e010 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 --2- 172.21.15.194:0/999720730 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18150b70 0x7fcb180a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 -- 172.21.15.194:0/999720730 >> 172.21.15.194:0/999720730 conn(0x7fcb1806b840 msgr2=0x7fcb180c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 -- 172.21.15.194:0/999720730 shutdown_connections 2024-03-07T10:24:15.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.064+0000 7fcb1f400640 1 -- 172.21.15.194:0/999720730 wait complete. 2024-03-07T10:24:15.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.066+0000 7fcb1f400640 1 Processor -- start 2024-03-07T10:24:15.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.066+0000 7fcb1f400640 1 -- start start 2024-03-07T10:24:15.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.069 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb18150b70 0x7fcb18142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18156c20 0x7fcb18142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18153630 con 0x7fcb180a9a10 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180c7a30 con 0x7fcb18150b70 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1f400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180ac460 con 0x7fcb18156c20 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60886/0 (socket says 172.21.15.194:60886) 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 -- 172.21.15.194:0/4214702922 learned_addr learned my addr 172.21.15.194:0/4214702922 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 -- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18156c20 msgr2=0x7fcb18142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb17e00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb18150b70 0x7fcb18142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1d400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18156c20 0x7fcb18142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18156c20 0x7fcb18142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 -- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb18150b70 msgr2=0x7fcb18142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb18150b70 0x7fcb18142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.070 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.067+0000 7fcb1ca00640 1 -- 172.21.15.194:0/4214702922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180c12d0 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb1ca00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c7f0 tx=0x7fcb0c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c015070 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c004220 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c007620 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18143c00 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.068+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb181eb0d0 con 0x7fcb180a9a10 2024-03-07T10:24:15.071 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.069+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb181eaf00 con 0x7fcb180a9a10 2024-03-07T10:24:15.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.070+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcb0c0079d0 con 0x7fcb180a9a10 2024-03-07T10:24:15.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.071+0000 7fcb14c00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 0x7fcaf806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.072 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.071+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fcb0c08a9e0 con 0x7fcb180a9a10 2024-03-07T10:24:15.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.072+0000 7fcb17e00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 0x7fcaf806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.074 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.073+0000 7fcb17e00640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 0x7fcaf806d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcb18072dc0 tx=0x7fcb04008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.077 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.076+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcb0c0593b0 con 0x7fcb180a9a10 2024-03-07T10:24:15.273 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.272+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb18068170 con 0x7fcaf806b4d0 2024-03-07T10:24:15.275 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 2 to deep-scrub 2024-03-07T10:24:15.275 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.273+0000 7fcb14c00640 1 -- 172.21.15.194:0/4214702922 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcb18068170 con 0x7fcaf806b4d0 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 msgr2=0x7fcaf806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 0x7fcaf806d990 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcb18072dc0 tx=0x7fcb04008040 comp rx=0 tx=0).stop 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 msgr2=0x7fcb1814f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c00c7f0 tx=0x7fcb0c00ccb0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 shutdown_connections 2024-03-07T10:24:15.278 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcaf806b4d0 0x7fcaf806d990 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcb18156c20 0x7fcb18142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcb18150b70 0x7fcb18142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 --2- 172.21.15.194:0/4214702922 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcb180a9a10 0x7fcb1814f480 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 >> 172.21.15.194:0/4214702922 conn(0x7fcb1806b840 msgr2=0x7fcb180c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.276+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 shutdown_connections 2024-03-07T10:24:15.279 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.277+0000 7fcb1f400640 1 -- 172.21.15.194:0/4214702922 wait complete. 2024-03-07T10:24:15.297 INFO:tasks.ceph:Scrubbing osd.3 2024-03-07T10:24:15.297 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:15.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.499+0000 7f7293000640 1 Processor -- start 2024-03-07T10:24:15.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.499+0000 7f7293000640 1 -- start start 2024-03-07T10:24:15.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7293000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f728c0ac0a0 0x7f728c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7293000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f728c0c2030 0x7f728c0ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7293000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f728c14d9b0 con 0x7f728c0ac480 2024-03-07T10:24:15.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7293000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0673c0 con 0x7f728c0c2030 2024-03-07T10:24:15.504 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7293000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f728c0aa810 con 0x7f728c0ac0a0 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7291000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f728c0ac480 0x7f728c156b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43018/0 (socket says 172.21.15.194:43018) 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f7291000640 1 -- 172.21.15.194:0/1206030795 learned_addr learned my addr 172.21.15.194:0/1206030795 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.502+0000 7f728b400640 1 --2- 172.21.15.194:0/1206030795 >> v2:172.21.15.194:3300/0 conn(0x7f728c0c2030 0x7f728c0ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728be00640 1 --2- 172.21.15.194:0/1206030795 >> v2:172.21.15.196:3300/0 conn(0x7f728c0ac0a0 0x7f728c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728aa00640 1 -- 172.21.15.194:0/1206030795 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1033924542 0 0) 0x7f728c14d9b0 con 0x7f728c0ac480 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728aa00640 1 -- 172.21.15.194:0/1206030795 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7270003520 con 0x7f728c0ac480 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728b400640 1 -- 172.21.15.194:0/1206030795 >> v2:172.21.15.196:3300/0 conn(0x7f728c0ac0a0 msgr2=0x7f728c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728b400640 1 --2- 172.21.15.194:0/1206030795 >> v2:172.21.15.196:3300/0 conn(0x7f728c0ac0a0 0x7f728c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728b400640 1 -- 172.21.15.194:0/1206030795 >> v1:172.21.15.194:6789/0 conn(0x7f728c0ac480 legacy=0x7f728c156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.505 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.503+0000 7f728b400640 1 -- 172.21.15.194:0/1206030795 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c0670e0 con 0x7f728c0c2030 2024-03-07T10:24:15.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.504+0000 7f728b400640 1 --2- 172.21.15.194:0/1206030795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0c2030 0x7f728c0ad180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f728c06f4d0 tx=0x7f727802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca6f3f47718d414e server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.504+0000 7f728aa00640 1 -- 172.21.15.194:0/1206030795 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278038070 con 0x7f728c0c2030 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.504+0000 7f728aa00640 1 -- 172.21.15.194:0/1206030795 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278031520 con 0x7f728c0c2030 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.504+0000 7f728aa00640 1 -- 172.21.15.194:0/1206030795 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72780318f0 con 0x7f728c0c2030 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 -- 172.21.15.194:0/1206030795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0c2030 msgr2=0x7f728c0ad180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 --2- 172.21.15.194:0/1206030795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0c2030 0x7f728c0ad180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f728c06f4d0 tx=0x7f727802b7c0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 -- 172.21.15.194:0/1206030795 shutdown_connections 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 --2- 172.21.15.194:0/1206030795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0c2030 0x7f728c0ad180 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 --2- 172.21.15.194:0/1206030795 >> v2:172.21.15.196:3300/0 conn(0x7f728c0ac0a0 0x7f728c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 -- 172.21.15.194:0/1206030795 >> 172.21.15.194:0/1206030795 conn(0x7f728c0c4130 msgr2=0x7f728c0c4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 -- 172.21.15.194:0/1206030795 shutdown_connections 2024-03-07T10:24:15.507 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.505+0000 7f7293000640 1 -- 172.21.15.194:0/1206030795 wait complete. 2024-03-07T10:24:15.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.507+0000 7f7293000640 1 Processor -- start 2024-03-07T10:24:15.508 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.507+0000 7f7293000640 1 -- start start 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f728c0ac0a0 0x7f728c1ee900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 0x7f728c0c5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f728c0c2030 0x7f728c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0ad6c0 con 0x7f728c0ac480 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0aaaf0 con 0x7f728c0ac0a0 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f7293000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f728c0c1c60 con 0x7f728c0c2030 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 0x7f728c0c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 0x7f728c0c5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60892/0 (socket says 172.21.15.194:60892) 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 -- 172.21.15.194:0/1979757500 learned_addr learned my addr 172.21.15.194:0/1979757500 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728be00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f728c0ac0a0 0x7f728c1ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.511 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 -- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f728c0c2030 msgr2=0x7f728c0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f728c0c2030 0x7f728c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 -- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f728c0ac0a0 msgr2=0x7f728c1ee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f728c0ac0a0 0x7f728c1ee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728b400640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c1ef2f0 con 0x7f728c0ac480 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.508+0000 7f728be00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f728c0ac0a0 0x7f728c1ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f728b400640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 0x7f728c0c5220 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7278000c00 tx=0x7f72780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278042070 con 0x7f728c0ac480 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727803d870 con 0x7f728c0ac480 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f728c14c010 con 0x7f728c0ac480 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278038040 con 0x7f728c0ac480 2024-03-07T10:24:15.512 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.509+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728c1eee40 con 0x7f728c0ac480 2024-03-07T10:24:15.513 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.510+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f728c068880 con 0x7f728c0ac480 2024-03-07T10:24:15.514 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.512+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7278045070 con 0x7f728c0ac480 2024-03-07T10:24:15.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.513+0000 7f7283e00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f726c06b4d0 0x7f726c06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.513+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f72780ac210 con 0x7f728c0ac480 2024-03-07T10:24:15.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.513+0000 7f7283e00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f726c0760c0 0x7f726c078540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.514+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7278031520 con 0x7f726c0760c0 2024-03-07T10:24:15.515 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.514+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72780b3050 con 0x7f728c0ac480 2024-03-07T10:24:15.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.514+0000 7f7291000640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f726c0760c0 0x7f726c078540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.514+0000 7f728be00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f726c06b4d0 0x7f726c06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.514+0000 7f7291000640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f726c0760c0 0x7f726c078540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.516 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.515+0000 7f728be00640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f726c06b4d0 0x7f726c06d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f727c006fd0 tx=0x7f727c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.517 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.516+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== osd.3 v2:172.21.15.194:6821/1209571580 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f7278031520 con 0x7f726c0760c0 2024-03-07T10:24:15.531 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.530+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 --> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f728c0c4f60 con 0x7f726c0760c0 2024-03-07T10:24:15.532 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7283e00640 1 -- 172.21.15.194:0/1979757500 <== osd.3 v2:172.21.15.194:6821/1209571580 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f728c0c4f60 con 0x7f726c0760c0 2024-03-07T10:24:15.532 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:15.532 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:15.532 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:15.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f726c0760c0 msgr2=0x7f726c078540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:6821/1209571580,v1:172.21.15.194:6823/1209571580] conn(0x7f726c0760c0 0x7f726c078540 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.533 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f726c06b4d0 msgr2=0x7f726c06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f726c06b4d0 0x7f726c06d990 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f727c006fd0 tx=0x7f727c008040 comp rx=0 tx=0).stop 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 msgr2=0x7f728c0c5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 --2- 172.21.15.194:0/1979757500 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f728c0ac480 0x7f728c0c5220 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7278000c00 tx=0x7f72780046c0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7291000640 1 -- 172.21.15.194:0/1979757500 reap_dead start 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 shutdown_connections 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 >> 172.21.15.194:0/1979757500 conn(0x7f728c0c4130 msgr2=0x7f728c06e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.531+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 shutdown_connections 2024-03-07T10:24:15.534 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.532+0000 7f7293000640 1 -- 172.21.15.194:0/1979757500 wait complete. 2024-03-07T10:24:15.551 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-07T10:24:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.749+0000 7f7b05800640 1 Processor -- start 2024-03-07T10:24:15.751 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.749+0000 7f7b05800640 1 -- start start 2024-03-07T10:24:15.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7b05800640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 0x7f7b0006e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7b05800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7b05800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b0006c870 con 0x7f7b000a8d60 2024-03-07T10:24:15.753 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7b05800640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b000720a0 con 0x7f7b0014f320 2024-03-07T10:24:15.754 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7b05800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00071890 con 0x7f7b00152400 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7afea00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 0x7f7b0006e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7aff400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7aff400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.196:3301/0 says I am v2:172.21.15.194:43930/0 (socket says 172.21.15.194:43930) 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.752+0000 7f7aff400640 1 -- 172.21.15.194:0/2166415768 learned_addr learned my addr 172.21.15.194:0/2166415768 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.753+0000 7f7aff400640 1 -- 172.21.15.194:0/2166415768 >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 msgr2=0x7f7b0006e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.753+0000 7f7aff400640 1 --2- 172.21.15.194:0/2166415768 >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 0x7f7b0006e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.753+0000 7f7aff400640 1 -- 172.21.15.194:0/2166415768 >> v1:172.21.15.196:6789/0 conn(0x7f7b000a8d60 legacy=0x7f7b00151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.753+0000 7f7aff400640 1 -- 172.21.15.194:0/2166415768 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b00071ae0 con 0x7f7b00152400 2024-03-07T10:24:15.755 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.753+0000 7f7afea00640 1 --2- 172.21.15.194:0/2166415768 >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 0x7f7b0006e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:24:15.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.754+0000 7f7aff400640 1 --2- 172.21.15.194:0/2166415768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7af800af60 tx=0x7f7af802e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=926039208d0e8695 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.755+0000 7f7afd600640 1 -- 172.21.15.194:0/2166415768 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af802ea80 con 0x7f7b00152400 2024-03-07T10:24:15.756 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.755+0000 7f7afd600640 1 -- 172.21.15.194:0/2166415768 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af802ec20 con 0x7f7b00152400 2024-03-07T10:24:15.757 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.755+0000 7f7afd600640 1 -- 172.21.15.194:0/2166415768 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8008500 con 0x7f7b00152400 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 -- 172.21.15.194:0/2166415768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 msgr2=0x7f7b0015c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 --2- 172.21.15.194:0/2166415768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7af800af60 tx=0x7f7af802e0e0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 -- 172.21.15.194:0/2166415768 shutdown_connections 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 --2- 172.21.15.194:0/2166415768 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b00152400 0x7f7b0015c5b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 --2- 172.21.15.194:0/2166415768 >> v2:172.21.15.196:3300/0 conn(0x7f7b0014f320 0x7f7b0006e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 -- 172.21.15.194:0/2166415768 >> 172.21.15.194:0/2166415768 conn(0x7f7b000a9450 msgr2=0x7f7b000a9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:15.758 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 -- 172.21.15.194:0/2166415768 shutdown_connections 2024-03-07T10:24:15.759 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.756+0000 7f7b05800640 1 -- 172.21.15.194:0/2166415768 wait complete. 2024-03-07T10:24:15.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.760+0000 7f7b05800640 1 Processor -- start 2024-03-07T10:24:15.761 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.760+0000 7f7b05800640 1 -- start start 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b000a8d60 0x7f7b00146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b0014f320 0x7f7b00144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c2880 con 0x7f7b00152400 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c22c0 con 0x7f7b0014f320 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7b05800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000c2510 con 0x7f7b000a8d60 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7aff400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.764 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7aff400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60900/0 (socket says 172.21.15.194:60900) 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7aff400640 1 -- 172.21.15.194:0/115879352 learned_addr learned my addr 172.21.15.194:0/115879352 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7afea00640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b000a8d60 0x7f7b00146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.762+0000 7f7afe000640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b0014f320 0x7f7b00144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 -- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b000a8d60 msgr2=0x7f7b00146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b000a8d60 0x7f7b00146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 -- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b0014f320 msgr2=0x7f7b00144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b0014f320 0x7f7b00144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:15.765 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 -- 172.21.15.194:0/115879352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b001458c0 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7aff400640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c140 tx=0x7f7af8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8042020 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af803e3f0 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b00151380 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.763+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af803e800 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.764+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b00151940 con 0x7f7b00152400 2024-03-07T10:24:15.766 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.765+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b00068880 con 0x7f7b00152400 2024-03-07T10:24:15.767 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.766+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f7af8005d10 con 0x7f7b00152400 2024-03-07T10:24:15.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.767+0000 7f7af6a00640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 0x7f7ae006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:15.768 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.767+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f7af80acb80 con 0x7f7b00152400 2024-03-07T10:24:15.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.767+0000 7f7afea00640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 0x7f7ae006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:15.770 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.769+0000 7f7afea00640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 0x7f7ae006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009560 tx=0x7f7af0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:15.772 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:15.771+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f7af807b560 con 0x7f7b00152400 2024-03-07T10:24:16.061 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.059+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b00145670 con 0x7f7ae006b4d0 2024-03-07T10:24:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.061+0000 7f7af6a00640 1 -- 172.21.15.194:0/115879352 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b00145670 con 0x7f7ae006b4d0 2024-03-07T10:24:16.062 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 3 to deep-scrub 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 msgr2=0x7f7ae006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 0x7f7ae006d990 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009560 tx=0x7f7af0008040 comp rx=0 tx=0).stop 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 msgr2=0x7f7b00144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7af800c140 tx=0x7f7af8004a40 comp rx=0 tx=0).stop 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 shutdown_connections 2024-03-07T10:24:16.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f7ae006b4d0 0x7f7ae006d990 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b00152400 0x7f7b00144e60 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7b0014f320 0x7f7b00144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 --2- 172.21.15.194:0/115879352 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7b000a8d60 0x7f7b00146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.064+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 >> 172.21.15.194:0/115879352 conn(0x7f7b000a9450 msgr2=0x7f7b00148d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.065+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 shutdown_connections 2024-03-07T10:24:16.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.065+0000 7f7b05800640 1 -- 172.21.15.194:0/115879352 wait complete. 2024-03-07T10:24:16.086 INFO:tasks.ceph:Scrubbing osd.4 2024-03-07T10:24:16.086 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:16.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.338+0000 7f3bcde00640 1 Processor -- start 2024-03-07T10:24:16.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.338+0000 7f3bcde00640 1 -- start start 2024-03-07T10:24:16.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.339+0000 7f3bcde00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bc80a8200 0x7f3bc8070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.339+0000 7f3bcde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc81536e0 0x7f3bc8153b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.339+0000 7f3bcde00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80c8ba0 con 0x7f3bc8150ef0 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bcde00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80c8740 con 0x7f3bc80a8200 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bcde00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8071170 con 0x7f3bc81536e0 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bc80a8200 0x7f3bc8070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bc80a8200 0x7f3bc8070c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60902/0 (socket says 172.21.15.194:60902) 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 -- 172.21.15.194:0/1985547251 learned_addr learned my addr 172.21.15.194:0/1985547251 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bc7400640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc81536e0 0x7f3bc8153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 -- 172.21.15.194:0/1985547251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc81536e0 msgr2=0x7f3bc8153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc81536e0 0x7f3bc8153b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 -- 172.21.15.194:0/1985547251 >> v1:172.21.15.196:6789/0 conn(0x7f3bc8150ef0 legacy=0x7f3bc806ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:16.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.340+0000 7f3bbe000640 1 -- 172.21.15.194:0/1985547251 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80713a0 con 0x7f3bc80a8200 2024-03-07T10:24:16.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.341+0000 7f3bbe000640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc80a8200 0x7f3bc8070c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009870 tx=0x7f3bb002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485da1ecd4eee9b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bc6000640 1 -- 172.21.15.194:0/1985547251 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb00317c0 con 0x7f3bc80a8200 2024-03-07T10:24:16.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bc6000640 1 -- 172.21.15.194:0/1985547251 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0037070 con 0x7f3bc80a8200 2024-03-07T10:24:16.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bc6000640 1 -- 172.21.15.194:0/1985547251 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0031b80 con 0x7f3bc80a8200 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 -- 172.21.15.194:0/1985547251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc80a8200 msgr2=0x7f3bc8070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc80a8200 0x7f3bc8070c30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0009870 tx=0x7f3bb002b860 comp rx=0 tx=0).stop 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 -- 172.21.15.194:0/1985547251 shutdown_connections 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc81536e0 0x7f3bc8153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 --2- 172.21.15.194:0/1985547251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc80a8200 0x7f3bc8070c30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 -- 172.21.15.194:0/1985547251 >> 172.21.15.194:0/1985547251 conn(0x7f3bc80aabb0 msgr2=0x7f3bc80aaf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:16.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 -- 172.21.15.194:0/1985547251 shutdown_connections 2024-03-07T10:24:16.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.342+0000 7f3bcde00640 1 -- 172.21.15.194:0/1985547251 wait complete. 2024-03-07T10:24:16.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.344+0000 7f3bcde00640 1 Processor -- start 2024-03-07T10:24:16.345 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.344+0000 7f3bcde00640 1 -- start start 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80a8200 0x7f3bc814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc8150ef0 0x7f3bc814de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 0x7f3bc80a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8071680 con 0x7f3bc81536e0 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c3f80 con 0x7f3bc8150ef0 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bcde00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c3c10 con 0x7f3bc80a8200 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 0x7f3bc80a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 0x7f3bc80a9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60916/0 (socket says 172.21.15.194:60916) 2024-03-07T10:24:16.347 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.345+0000 7f3bc7400640 1 -- 172.21.15.194:0/2224965418 learned_addr learned my addr 172.21.15.194:0/2224965418 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc6a00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80a8200 0x7f3bc814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bbe000640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc8150ef0 0x7f3bc814de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 -- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80a8200 msgr2=0x7f3bc814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3bc80a8200 0x7f3bc814e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 -- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc8150ef0 msgr2=0x7f3bc814de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc8150ef0 0x7f3bc814de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc81ec570 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bbe000640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f3bc8150ef0 0x7f3bc814de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bc7400640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 0x7f3bc80a9c60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000cc30 tx=0x7f3bc000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.346+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000ce40 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.347+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc0003990 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.347+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0003d40 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.347+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc81575d0 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.347+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc814e3a0 con 0x7f3bc81536e0 2024-03-07T10:24:16.349 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.347+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3bc8068170 con 0x7f3bc81536e0 2024-03-07T10:24:16.351 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.350+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3bc0003ee0 con 0x7f3bc81536e0 2024-03-07T10:24:16.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bbfe00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3ba406b4d0 0x7f3ba406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f3bc008b0e0 con 0x7f3bc81536e0 2024-03-07T10:24:16.352 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bbfe00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f3ba40760b0 0x7f3ba4078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bc000de50 con 0x7f3ba40760b0 2024-03-07T10:24:16.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bc008b490 con 0x7f3bc81536e0 2024-03-07T10:24:16.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.351+0000 7f3bc6a00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3ba406b4d0 0x7f3ba406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.352+0000 7f3bbe000640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f3ba40760b0 0x7f3ba4078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.353 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.352+0000 7f3bc6a00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3ba406b4d0 0x7f3ba406d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80c2ba0 tx=0x7f3bb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.354 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.353+0000 7f3bbe000640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f3ba40760b0 0x7f3ba4078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.356 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.355+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== osd.4 v2:172.21.15.196:6806/2284178707 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3bc000de50 con 0x7f3ba40760b0 2024-03-07T10:24:16.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.369+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 --> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3bc80c88d0 con 0x7f3ba40760b0 2024-03-07T10:24:16.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bbfe00640 1 -- 172.21.15.194:0/2224965418 <== osd.4 v2:172.21.15.196:6806/2284178707 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3bc80c88d0 con 0x7f3ba40760b0 2024-03-07T10:24:16.371 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:16.371 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:16.371 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:16.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f3ba40760b0 msgr2=0x7f3ba4078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6806/2284178707,v1:172.21.15.196:6808/2284178707] conn(0x7f3ba40760b0 0x7f3ba4078530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3ba406b4d0 msgr2=0x7f3ba406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f3ba406b4d0 0x7f3ba406d990 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80c2ba0 tx=0x7f3bb8009040 comp rx=0 tx=0).stop 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 msgr2=0x7f3bc80a9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 --2- 172.21.15.194:0/2224965418 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bc81536e0 0x7f3bc80a9c60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000cc30 tx=0x7f3bc000a5c0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bc7400640 1 -- 172.21.15.194:0/2224965418 reap_dead start 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 shutdown_connections 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.370+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 >> 172.21.15.194:0/2224965418 conn(0x7f3bc80aabb0 msgr2=0x7f3bc80c4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.371+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 shutdown_connections 2024-03-07T10:24:16.373 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.371+0000 7f3bcde00640 1 -- 172.21.15.194:0/2224965418 wait complete. 2024-03-07T10:24:16.389 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-07T10:24:16.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.583+0000 7f1b81600640 1 Processor -- start 2024-03-07T10:24:16.585 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.584+0000 7f1b81600640 1 -- start start 2024-03-07T10:24:16.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.586+0000 7f1b81600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b7c148f40 0x7f1b7c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.586+0000 7f1b81600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1b7c156200 0x7f1b7c153f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.586+0000 7f1b81600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7c156670 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.586+0000 7f1b81600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c073240 con 0x7f1b7c148f40 2024-03-07T10:24:16.588 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.586+0000 7f1b81600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7c06e000 con 0x7f1b7c156200 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b7c148f40 0x7f1b7c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b7c148f40 0x7f1b7c1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60926/0 (socket says 172.21.15.194:60926) 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 -- 172.21.15.194:0/537822282 learned_addr learned my addr 172.21.15.194:0/537822282 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b73e00640 1 --1- 172.21.15.194:0/537822282 >> v1:172.21.15.194:6789/0 conn(0x7f1b7c0c19c0 0x7f1b7c155af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43026/0 (socket says 172.21.15.194:43026) 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7b400640 1 --2- 172.21.15.194:0/537822282 >> v2:172.21.15.196:3300/0 conn(0x7f1b7c156200 0x7f1b7c153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 -- 172.21.15.194:0/537822282 >> v2:172.21.15.196:3300/0 conn(0x7f1b7c156200 msgr2=0x7f1b7c153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 --2- 172.21.15.194:0/537822282 >> v2:172.21.15.196:3300/0 conn(0x7f1b7c156200 0x7f1b7c153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 -- 172.21.15.194:0/537822282 >> v1:172.21.15.194:6789/0 conn(0x7f1b7c0c19c0 legacy=0x7f1b7c155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.589 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.587+0000 7f1b7aa00640 1 -- 172.21.15.194:0/537822282 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c1568e0 con 0x7f1b7c148f40 2024-03-07T10:24:16.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.589+0000 7f1b7aa00640 1 --2- 172.21.15.194:0/537822282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c148f40 0x7f1b7c1539f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aa360 tx=0x7f1b6c02b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb857107fd8050d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.589+0000 7f1b7a000640 1 -- 172.21.15.194:0/537822282 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c034070 con 0x7f1b7c148f40 2024-03-07T10:24:16.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.589+0000 7f1b7a000640 1 -- 172.21.15.194:0/537822282 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c030870 con 0x7f1b7c148f40 2024-03-07T10:24:16.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.589+0000 7f1b7a000640 1 -- 172.21.15.194:0/537822282 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c030c40 con 0x7f1b7c148f40 2024-03-07T10:24:16.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 -- 172.21.15.194:0/537822282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c148f40 msgr2=0x7f1b7c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 --2- 172.21.15.194:0/537822282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c148f40 0x7f1b7c1539f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c0aa360 tx=0x7f1b6c02b9b0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 -- 172.21.15.194:0/537822282 shutdown_connections 2024-03-07T10:24:16.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 --2- 172.21.15.194:0/537822282 >> v2:172.21.15.196:3300/0 conn(0x7f1b7c156200 0x7f1b7c153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 --2- 172.21.15.194:0/537822282 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c148f40 0x7f1b7c1539f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 -- 172.21.15.194:0/537822282 >> 172.21.15.194:0/537822282 conn(0x7f1b7c06b840 msgr2=0x7f1b7c0c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:16.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 -- 172.21.15.194:0/537822282 shutdown_connections 2024-03-07T10:24:16.592 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.590+0000 7f1b81600640 1 -- 172.21.15.194:0/537822282 wait complete. 2024-03-07T10:24:16.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.592+0000 7f1b81600640 1 Processor -- start 2024-03-07T10:24:16.593 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.592+0000 7f1b81600640 1 -- start start 2024-03-07T10:24:16.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.592+0000 7f1b81600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b81600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b7c148f40 0x7f1b7c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b81600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b7c156200 0x7f1b7c149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b81600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c06dc90 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b81600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c06d9b0 con 0x7f1b7c148f40 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b81600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7c149320 con 0x7f1b7c156200 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60934/0 (socket says 172.21.15.194:60934) 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 -- 172.21.15.194:0/302035172 learned_addr learned my addr 172.21.15.194:0/302035172 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 -- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b7c156200 msgr2=0x7f1b7c149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b7c156200 0x7f1b7c149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 -- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b7c148f40 msgr2=0x7f1b7c154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b7c148f40 0x7f1b7c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.593+0000 7f1b7aa00640 1 -- 172.21.15.194:0/302035172 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c152040 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b7aa00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c000c00 tx=0x7f1b6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c048070 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c030670 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c034040 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b7c14ba00 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.596 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.594+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7c1519f0 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.595+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7c068170 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.597 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.596+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1b6c04b070 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.597+0000 7f1b72a00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 0x7f1b5806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:16.598 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.597+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f1b6c0ac710 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.599 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.598+0000 7f1b73e00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 0x7f1b5806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:16.600 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.599+0000 7f1b73e00640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 0x7f1b5806d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000f60 tx=0x7f1b64007a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:16.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.606+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1b6c07b2a0 con 0x7f1b7c0c19c0 2024-03-07T10:24:16.806 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.804+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b7c1421b0 con 0x7f1b5806b500 2024-03-07T10:24:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.805+0000 7f1b72a00640 1 -- 172.21.15.194:0/302035172 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b7c1421b0 con 0x7f1b5806b500 2024-03-07T10:24:16.807 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 4 to deep-scrub 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 msgr2=0x7f1b5806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 0x7f1b5806d9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000f60 tx=0x7f1b64007a00 comp rx=0 tx=0).stop 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 msgr2=0x7f1b7c14b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c000c00 tx=0x7f1b6c004730 comp rx=0 tx=0).stop 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 shutdown_connections 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1b5806b500 0x7f1b5806d9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1b7c156200 0x7f1b7c149870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.810 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1b7c148f40 0x7f1b7c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 --2- 172.21.15.194:0/302035172 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b7c0c19c0 0x7f1b7c14b4c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:16.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.808+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 >> 172.21.15.194:0/302035172 conn(0x7f1b7c06b840 msgr2=0x7f1b7c0c3480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:16.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.809+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 shutdown_connections 2024-03-07T10:24:16.811 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:16.809+0000 7f1b81600640 1 -- 172.21.15.194:0/302035172 wait complete. 2024-03-07T10:24:16.827 INFO:tasks.ceph:Scrubbing osd.5 2024-03-07T10:24:16.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:17.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.032+0000 7ff3e7a00640 1 Processor -- start 2024-03-07T10:24:17.034 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.032+0000 7ff3e7a00640 1 -- start start 2024-03-07T10:24:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.033+0000 7ff3e7a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff3e00c5990 0x7ff3e00c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3e7a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e00cb6e0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.035 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3e7a00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3e00cb9c0 con 0x7ff3e014f890 2024-03-07T10:24:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3e7a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3e014fc70 con 0x7ff3e00c5990 2024-03-07T10:24:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3dfe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff3e00c8f10 0x7ff3e0159670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43042/0 (socket says 172.21.15.194:43042) 2024-03-07T10:24:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3dfe00640 1 -- 172.21.15.194:0/3327058430 learned_addr learned my addr 172.21.15.194:0/3327058430 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3327058430 >> v2:172.21.15.194:3300/0 conn(0x7ff3e00c5990 0x7ff3e00c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3df400640 1 -- 172.21.15.194:0/3327058430 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694141322 0 0) 0x7ff3e00cb6e0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.034+0000 7ff3e5a00640 1 -- 172.21.15.194:0/3327058430 >> v1:172.21.15.196:6789/0 conn(0x7ff3e014f890 legacy=0x7ff3e01561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.035+0000 7ff3e5a00640 1 -- 172.21.15.194:0/3327058430 >> v1:172.21.15.194:6789/0 conn(0x7ff3e00c8f10 legacy=0x7ff3e0159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.035+0000 7ff3e5a00640 1 -- 172.21.15.194:0/3327058430 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e0158e70 con 0x7ff3e00c5990 2024-03-07T10:24:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3327058430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c5990 0x7ff3e00c5e20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae608cbf4ff16dea server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3df400640 1 -- 172.21.15.194:0/3327058430 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8039070 con 0x7ff3e00c5990 2024-03-07T10:24:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3df400640 1 -- 172.21.15.194:0/3327058430 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d802cbd0 con 0x7ff3e00c5990 2024-03-07T10:24:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3df400640 1 -- 172.21.15.194:0/3327058430 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8034440 con 0x7ff3e00c5990 2024-03-07T10:24:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3327058430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c5990 msgr2=0x7ff3e00c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.036+0000 7ff3e7a00640 1 --2- 172.21.15.194:0/3327058430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c5990 0x7ff3e00c5e20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff3d8009d90 tx=0x7ff3d802be20 comp rx=0 tx=0).stop 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.037+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3327058430 shutdown_connections 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.037+0000 7ff3e7a00640 1 --2- 172.21.15.194:0/3327058430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c5990 0x7ff3e00c5e20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.037+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3327058430 >> 172.21.15.194:0/3327058430 conn(0x7ff3e0066f70 msgr2=0x7ff3e0067380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.037+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3327058430 shutdown_connections 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.037+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3327058430 wait complete. 2024-03-07T10:24:17.039 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.038+0000 7ff3e7a00640 1 Processor -- start 2024-03-07T10:24:17.040 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.038+0000 7ff3e7a00640 1 -- start start 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3e00c5990 0x7ff3e00c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 0x7ff3e01e9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3e014f890 0x7ff3e01ee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00cbca0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e01591e0 con 0x7ff3e014f890 2024-03-07T10:24:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3e7a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e00c9390 con 0x7ff3e00c5990 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.039+0000 7ff3dfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 0x7ff3e01e9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 0x7ff3e01e9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60940/0 (socket says 172.21.15.194:60940) 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 -- 172.21.15.194:0/3716431613 learned_addr learned my addr 172.21.15.194:0/3716431613 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3e014f890 0x7ff3e01ee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 -- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3e00c5990 msgr2=0x7ff3e00c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff3e00c5990 0x7ff3e00c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 -- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3e014f890 msgr2=0x7ff3e01ee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3e014f890 0x7ff3e01ee6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e01ef1a0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff3e014f890 0x7ff3e01ee6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dfe00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 0x7ff3e01e9160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3f0 tx=0x7ff3cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.040+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0074e0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.041+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc0047e0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.041+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3e01ef480 con 0x7ff3e00c8f10 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.041+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004c10 con 0x7ff3e00c8f10 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.041+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3e00c2a10 con 0x7ff3e00c8f10 2024-03-07T10:24:17.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.042+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3e0068880 con 0x7ff3e00c8f10 2024-03-07T10:24:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.043+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff3cc011070 con 0x7ff3e00c8f10 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3dcc00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7ff3cc08a2b0 con 0x7ff3e00c8f10 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3dcc00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7ff3c00760b0 0x7ff3c0078530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3c0078c00 con 0x7ff3c00760b0 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3cc091050 con 0x7ff3e00c8f10 2024-03-07T10:24:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.044+0000 7ff3e5000640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff3c006b4d0 0x7ff3c006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.045+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7ff3c00760b0 0x7ff3c0078530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.046+0000 7ff3e5a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7ff3c00760b0 0x7ff3c0078530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.047 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.046+0000 7ff3e5000640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000f60 tx=0x7ff3d40079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.049 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.048+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== osd.5 v2:172.21.15.196:6800/2704867987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff3c0078c00 con 0x7ff3c00760b0 2024-03-07T10:24:17.064 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.063+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 --> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff3e006d570 con 0x7ff3c00760b0 2024-03-07T10:24:17.065 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.064+0000 7ff3dcc00640 1 -- 172.21.15.194:0/3716431613 <== osd.5 v2:172.21.15.196:6800/2704867987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff3e006d570 con 0x7ff3c00760b0 2024-03-07T10:24:17.065 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:17.065 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:17.066 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.064+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7ff3c00760b0 msgr2=0x7ff3c0078530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.064+0000 7ff3e7a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6800/2704867987,v1:172.21.15.196:6801/2704867987] conn(0x7ff3c00760b0 0x7ff3c0078530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff3c006b4d0 msgr2=0x7ff3c006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff3c006b4d0 0x7ff3c006d990 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000f60 tx=0x7ff3d40079b0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 msgr2=0x7ff3e01e9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 --2- 172.21.15.194:0/3716431613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3e00c8f10 0x7ff3e01e9160 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3f0 tx=0x7ff3cc00c8b0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e5a00640 1 -- 172.21.15.194:0/3716431613 reap_dead start 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 shutdown_connections 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 >> 172.21.15.194:0/3716431613 conn(0x7ff3e0066f70 msgr2=0x7ff3e0158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 shutdown_connections 2024-03-07T10:24:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.065+0000 7ff3e7a00640 1 -- 172.21.15.194:0/3716431613 wait complete. 2024-03-07T10:24:17.082 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-07T10:24:17.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.280+0000 7fe392e00640 1 Processor -- start 2024-03-07T10:24:17.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.280+0000 7fe392e00640 1 -- start start 2024-03-07T10:24:17.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe392e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe38c0c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe392e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c072250 con 0x7fe38c072c50 2024-03-07T10:24:17.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe392e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c1530b0 con 0x7fe38c0c7e00 2024-03-07T10:24:17.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe392e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0c58d0 con 0x7fe38c152cd0 2024-03-07T10:24:17.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe391000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe38c072c50 0x7fe38c1558b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43050/0 (socket says 172.21.15.194:43050) 2024-03-07T10:24:17.284 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe391000640 1 -- 172.21.15.194:0/3933896732 learned_addr learned my addr 172.21.15.194:0/3933896732 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.282+0000 7fe391a00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe38c0c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998402650 0 0) 0x7fe38c072250 con 0x7fe38c072c50 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe374003520 con 0x7fe38c072c50 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1617279048 0 0) 0x7fe374003520 con 0x7fe38c072c50 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 msgr2=0x7fe38c0c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe38c0c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 >> v1:172.21.15.196:6789/0 conn(0x7fe38c0c7e00 legacy=0x7fe38c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0c5bb0 con 0x7fe38c072c50 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7fe3780017f0 con 0x7fe38c072c50 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 >> v1:172.21.15.194:6789/0 conn(0x7fe38c072c50 legacy=0x7fe38c1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe3740039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe374004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0c58d0 con 0x7fe374003fb0 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37400bbb0 con 0x7fe374004d40 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37400bdb0 con 0x7fe38c152cd0 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.283+0000 7fe391000640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe374004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391a00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe3740039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe392400640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391000640 1 -- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 msgr2=0x7fe3740039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391000640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c152cd0 0x7fe3740039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391000640 1 -- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe374004d40 msgr2=0x7fe3740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391000640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.284+0000 7fe391000640 1 -- 172.21.15.194:0/3933896732 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe374003520 con 0x7fe374003fb0 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.285+0000 7fe391000640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe374004800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe37800c110 tx=0x7fe374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2ec3f5fdce45f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.285+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378007c40 con 0x7fe374003fb0 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.285+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe378030070 con 0x7fe374003fb0 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.285+0000 7fe38be00640 1 -- 172.21.15.194:0/3933896732 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378007510 con 0x7fe374003fb0 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 -- 172.21.15.194:0/3933896732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 msgr2=0x7fe374004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 --2- 172.21.15.194:0/3933896732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe374004800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe37800c110 tx=0x7fe374005830 comp rx=0 tx=0).stop 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392400640 1 -- 172.21.15.194:0/3933896732 reap_dead start 2024-03-07T10:24:17.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 -- 172.21.15.194:0/3933896732 shutdown_connections 2024-03-07T10:24:17.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 -- 172.21.15.194:0/3933896732 >> 172.21.15.194:0/3933896732 conn(0x7fe38c06b710 msgr2=0x7fe38c0acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 -- 172.21.15.194:0/3933896732 shutdown_connections 2024-03-07T10:24:17.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.286+0000 7fe392e00640 1 -- 172.21.15.194:0/3933896732 wait complete. 2024-03-07T10:24:17.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.288+0000 7fe392e00640 1 Processor -- start 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.288+0000 7fe392e00640 1 -- start start 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c1597b0 0x7fe38c1ee1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 0x7fe38c1ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0c8db0 con 0x7fe374003fb0 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0ad2c0 con 0x7fe38c155110 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe392e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0c8f30 con 0x7fe38c1597b0 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe391a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe391a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60964/0 (socket says 172.21.15.194:60964) 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.289+0000 7fe391a00640 1 -- 172.21.15.194:0/2535946430 learned_addr learned my addr 172.21.15.194:0/2535946430 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:17.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe392400640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 0x7fe38c1ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391000640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c1597b0 0x7fe38c1ee1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 -- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c1597b0 msgr2=0x7fe38c1ee1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c1597b0 0x7fe38c1ee1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 -- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 msgr2=0x7fe38c1ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 0x7fe38c1ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 -- 172.21.15.194:0/2535946430 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c1eee30 con 0x7fe374003fb0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe392400640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 0x7fe38c1ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe391a00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe380011630 tx=0x7fe380011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000f920 con 0x7fe374003fb0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000fac0 con 0x7fe374003fb0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38000fe70 con 0x7fe374003fb0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c1eb630 con 0x7fe374003fb0 2024-03-07T10:24:17.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.290+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c158a50 con 0x7fe374003fb0 2024-03-07T10:24:17.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.292+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c075600 con 0x7fe374003fb0 2024-03-07T10:24:17.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.292+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fe380015460 con 0x7fe374003fb0 2024-03-07T10:24:17.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.293+0000 7fe389600640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 0x7fe36c06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.293+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fe38008afb0 con 0x7fe374003fb0 2024-03-07T10:24:17.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.294+0000 7fe391000640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 0x7fe36c06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.295+0000 7fe391000640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 0x7fe36c06d9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe378034000 tx=0x7fe378009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.298+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fe380019030 con 0x7fe374003fb0 2024-03-07T10:24:17.662 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.661+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe38c072a30 con 0x7fe36c06b500 2024-03-07T10:24:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.662+0000 7fe389600640 1 -- 172.21.15.194:0/2535946430 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe38c072a30 con 0x7fe36c06b500 2024-03-07T10:24:17.664 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 5 to deep-scrub 2024-03-07T10:24:17.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 msgr2=0x7fe36c06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 0x7fe36c06d9c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe378034000 tx=0x7fe378009030 comp rx=0 tx=0).stop 2024-03-07T10:24:17.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 msgr2=0x7fe38c154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.666 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe380011630 tx=0x7fe380011af0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 shutdown_connections 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fe36c06b500 0x7fe36c06d9c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fe38c155110 0x7fe38c1ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fe38c1597b0 0x7fe38c1ee1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 --2- 172.21.15.194:0/2535946430 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe374003fb0 0x7fe38c154bd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 >> 172.21.15.194:0/2535946430 conn(0x7fe38c06b710 msgr2=0x7fe38c151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 shutdown_connections 2024-03-07T10:24:17.667 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.665+0000 7fe392e00640 1 -- 172.21.15.194:0/2535946430 wait complete. 2024-03-07T10:24:17.683 INFO:tasks.ceph:Scrubbing osd.6 2024-03-07T10:24:17.683 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:17.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.882+0000 7f3763000640 1 Processor -- start 2024-03-07T10:24:17.884 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.883+0000 7f3763000640 1 -- start start 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3763000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 0x7f375c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3763000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c0c16e0 con 0x7f375c1540b0 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3763000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c06c9e0 con 0x7f375c14fa60 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3763000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c06d8d0 con 0x7f375c0c1e20 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3753e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f375c1540b0 0x7f375c06dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43062/0 (socket says 172.21.15.194:43062) 2024-03-07T10:24:17.886 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.884+0000 7f3753e00640 1 -- 172.21.15.194:0/2701949478 learned_addr learned my addr 172.21.15.194:0/2701949478 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f3761000640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 0x7f375c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868497632 0 0) 0x7f3744001110 con 0x7f375c1540b0 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3740003520 con 0x7f375c1540b0 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3150092699 0 0) 0x7f3740003520 con 0x7f375c1540b0 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 msgr2=0x7f375c1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 0x7f375c1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 >> v1:172.21.15.196:6789/0 conn(0x7f375c14fa60 legacy=0x7f375c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c06ccc0 con 0x7f375c1540b0 2024-03-07T10:24:17.888 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f3744001840 con 0x7f375c1540b0 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 >> v1:172.21.15.194:6789/0 conn(0x7f375c1540b0 legacy=0x7f375c06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37400039e0 0x7f3740003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.885+0000 7f375b400640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f375b400640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 0x7f3740005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c06d8d0 con 0x7f3740004800 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374000baf0 con 0x7f37400039e0 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374000bcf0 con 0x7f375c0c1e20 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3740004800 0x7f3740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 -- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 msgr2=0x7f3740005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f375c0c1e20 0x7f3740005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 -- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37400039e0 msgr2=0x7f3740003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f37400039e0 0x7f3740003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.889 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.886+0000 7f3753e00640 1 -- 172.21.15.194:0/2701949478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740003520 con 0x7f3740004800 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.887+0000 7f3753e00640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3740004800 0x7f3740004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f374400c4c0 tx=0x7f3740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b84509ea9820f6f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.887+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400c0e0 con 0x7f3740004800 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3744030070 con 0x7f3740004800 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f375b400640 1 -- 172.21.15.194:0/2701949478 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440058d0 con 0x7f3740004800 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 -- 172.21.15.194:0/2701949478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3740004800 msgr2=0x7f3740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 --2- 172.21.15.194:0/2701949478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3740004800 0x7f3740004c80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f374400c4c0 tx=0x7f3740005830 comp rx=0 tx=0).stop 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3761000640 1 -- 172.21.15.194:0/2701949478 reap_dead start 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 -- 172.21.15.194:0/2701949478 shutdown_connections 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 -- 172.21.15.194:0/2701949478 >> 172.21.15.194:0/2701949478 conn(0x7f375c0c6fc0 msgr2=0x7f375c0c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 -- 172.21.15.194:0/2701949478 shutdown_connections 2024-03-07T10:24:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.888+0000 7f3763000640 1 -- 172.21.15.194:0/2701949478 wait complete. 2024-03-07T10:24:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.891+0000 7f3763000640 1 Processor -- start 2024-03-07T10:24:17.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.891+0000 7f3763000640 1 -- start start 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3740004800 0x7f375c0c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f375c14ea20 0x7f375c140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 0x7f375c141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c06d560 con 0x7f375c14eea0 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c06d280 con 0x7f375c14ea20 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.892+0000 7f3763000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c14fe40 con 0x7f3740004800 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 0x7f375c141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 0x7f375c141000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60984/0 (socket says 172.21.15.194:60984) 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 -- 172.21.15.194:0/693290669 learned_addr learned my addr 172.21.15.194:0/693290669 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3753e00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f375c14ea20 0x7f375c140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 -- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3740004800 msgr2=0x7f375c0c24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f3740004800 0x7f375c0c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 -- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f375c14ea20 msgr2=0x7f375c140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f375c14ea20 0x7f375c140ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0ab7a0 con 0x7f375c14eea0 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3761000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 0x7f375c141000 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f375400ede0 tx=0x7f375400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.893+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754018020 con 0x7f375c14eea0 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.894+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400bd10 con 0x7f375c14eea0 2024-03-07T10:24:17.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.894+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754014640 con 0x7f375c14eea0 2024-03-07T10:24:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.894+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c0aba80 con 0x7f375c14eea0 2024-03-07T10:24:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.894+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c0ac040 con 0x7f375c14eea0 2024-03-07T10:24:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.895+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f375c068170 con 0x7f375c14eea0 2024-03-07T10:24:17.897 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.896+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f3754005d10 con 0x7f375c14eea0 2024-03-07T10:24:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.896+0000 7f3758c00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f373806b500 0x7f373806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f375408adc0 con 0x7f375c14eea0 2024-03-07T10:24:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f3758c00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f37380760f0 0x7f3738078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f375400ce90 con 0x7f37380760f0 2024-03-07T10:24:17.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375408d3e0 con 0x7f375c14eea0 2024-03-07T10:24:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f375be00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f373806b500 0x7f373806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.897+0000 7f3753e00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f37380760f0 0x7f3738078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:17.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.898+0000 7f375be00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f373806b500 0x7f373806d9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f374c001590 tx=0x7f374c007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.898+0000 7f3753e00640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f37380760f0 0x7f3738078570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:17.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.900+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== osd.6 v2:172.21.15.196:6816/2495219852 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f375400ce90 con 0x7f37380760f0 2024-03-07T10:24:17.916 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.915+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 --> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f375c06e900 con 0x7f37380760f0 2024-03-07T10:24:17.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3758c00640 1 -- 172.21.15.194:0/693290669 <== osd.6 v2:172.21.15.196:6816/2495219852 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f375c06e900 con 0x7f37380760f0 2024-03-07T10:24:17.917 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:17.917 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:17.917 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f37380760f0 msgr2=0x7f3738078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6816/2495219852,v1:172.21.15.196:6817/2495219852] conn(0x7f37380760f0 0x7f3738078570 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f373806b500 msgr2=0x7f373806d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.918 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f373806b500 0x7f373806d9c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f374c001590 tx=0x7f374c007990 comp rx=0 tx=0).stop 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 msgr2=0x7f375c141000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 --2- 172.21.15.194:0/693290669 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f375c14eea0 0x7f375c141000 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f375400ede0 tx=0x7f375400b480 comp rx=0 tx=0).stop 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3761000640 1 -- 172.21.15.194:0/693290669 reap_dead start 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 shutdown_connections 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.916+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 >> 172.21.15.194:0/693290669 conn(0x7f375c0c6fc0 msgr2=0x7f375c148770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.917+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 shutdown_connections 2024-03-07T10:24:17.919 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:17.917+0000 7f3763000640 1 -- 172.21.15.194:0/693290669 wait complete. 2024-03-07T10:24:17.936 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-07T10:24:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.141+0000 7faad8e00640 1 Processor -- start 2024-03-07T10:24:18.142 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.141+0000 7faad8e00640 1 -- start start 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faad40c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad8e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad4155900 con 0x7faad4152cf0 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad8e00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad4156680 con 0x7faad40c7900 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad8e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40c83c0 con 0x7faad4071db0 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad3400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7faad4152cf0 0x7faad40c9010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:43076/0 (socket says 172.21.15.194:43076) 2024-03-07T10:24:18.144 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.142+0000 7faad3400640 1 -- 172.21.15.194:0/1108391157 learned_addr learned my addr 172.21.15.194:0/1108391157 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad3e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faad40c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616967728 0 0) 0x7faad4155900 con 0x7faad4152cf0 2024-03-07T10:24:18.146 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faab8003520 con 0x7faad4152cf0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356885267 0 0) 0x7faab8003520 con 0x7faad4152cf0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 msgr2=0x7faad40c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faad40c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 >> v1:172.21.15.196:6789/0 conn(0x7faad40c7900 legacy=0x7faad40716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad41530d0 con 0x7faad4152cf0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7faac4001670 con 0x7faad4152cf0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 >> v1:172.21.15.194:6789/0 conn(0x7faad4152cf0 legacy=0x7faad40c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faab80039e0 0x7faab8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faab8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40c83c0 con 0x7faab8004d40 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab800bb50 con 0x7faab80039e0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.143+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab800bd50 con 0x7faad4071db0 2024-03-07T10:24:18.147 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faab8004d40 0x7faab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3400640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faab80039e0 0x7faab8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faacbe00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faab8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 -- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 msgr2=0x7faab8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faad4071db0 0x7faab8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 -- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faab80039e0 msgr2=0x7faab8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faab80039e0 0x7faab8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.148 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.144+0000 7faad3e00640 1 -- 172.21.15.194:0/1108391157 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab8003520 con 0x7faab8004d40 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.145+0000 7faad3e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faab8004d40 0x7faab80051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faacc009f90 tx=0x7faab8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47ad2d68568826a server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc039070 con 0x7faab8004d40 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc02cbd0 con 0x7faab8004d40 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad2a00640 1 -- 172.21.15.194:0/1108391157 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc009c10 con 0x7faab8004d40 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 -- 172.21.15.194:0/1108391157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faab8004d40 msgr2=0x7faab80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.149 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 --2- 172.21.15.194:0/1108391157 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faab8004d40 0x7faab80051c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7faacc009f90 tx=0x7faab8005830 comp rx=0 tx=0).stop 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad3e00640 1 -- 172.21.15.194:0/1108391157 reap_dead start 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 -- 172.21.15.194:0/1108391157 shutdown_connections 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 -- 172.21.15.194:0/1108391157 >> 172.21.15.194:0/1108391157 conn(0x7faad40aca60 msgr2=0x7faad40ace40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 -- 172.21.15.194:0/1108391157 shutdown_connections 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.146+0000 7faad8e00640 1 -- 172.21.15.194:0/1108391157 wait complete. 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.148+0000 7faad8e00640 1 Processor -- start 2024-03-07T10:24:18.150 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.149+0000 7faad8e00640 1 -- start start 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.149+0000 7faad8e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 0x7faad4158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.149+0000 7faad8e00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faad41e81c0 0x7faad41e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4156160 con 0x7faad40abe40 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad8e00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4155e80 con 0x7faad41e81c0 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad8e00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad4072a60 con 0x7faab8004d40 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:60994/0 (socket says 172.21.15.194:60994) 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 -- 172.21.15.194:0/3482001832 learned_addr learned my addr 172.21.15.194:0/3482001832 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faacbe00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faad41e81c0 0x7faad41e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3400640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 0x7faad4158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.153 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 -- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 msgr2=0x7faad4158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 0x7faad4158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 -- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faad41e81c0 msgr2=0x7faad41e8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faad41e81c0 0x7faad41e8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3e00640 1 -- 172.21.15.194:0/3482001832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4155660 con 0x7faad40abe40 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.150+0000 7faad3400640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 0x7faad4158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faad3e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e230 tx=0x7faacc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc039070 con 0x7faad40abe40 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc044070 con 0x7faad40abe40 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc03e830 con 0x7faad40abe40 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40aab20 con 0x7faad40abe40 2024-03-07T10:24:18.154 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.151+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad40ab0e0 con 0x7faad40abe40 2024-03-07T10:24:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.152+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad4075600 con 0x7faad40abe40 2024-03-07T10:24:18.155 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.154+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7faacc005d10 con 0x7faad40abe40 2024-03-07T10:24:18.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.154+0000 7faacb400640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.155+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7faacc0ac920 con 0x7faad40abe40 2024-03-07T10:24:18.156 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.155+0000 7faad3400640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.156+0000 7faad3400640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 0x7faab006d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faac4001c00 tx=0x7faac4000f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.160+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7faacc04d020 con 0x7faad40abe40 2024-03-07T10:24:18.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.374+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faad41490c0 con 0x7faab006b4d0 2024-03-07T10:24:18.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.375+0000 7faacb400640 1 -- 172.21.15.194:0/3482001832 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faad41490c0 con 0x7faab006b4d0 2024-03-07T10:24:18.377 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 6 to deep-scrub 2024-03-07T10:24:18.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 msgr2=0x7faab006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 0x7faab006d990 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faac4001c00 tx=0x7faac4000f90 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 msgr2=0x7faad40ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faacc00e230 tx=0x7faacc009750 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 shutdown_connections 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7faab006b4d0 0x7faab006d990 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faad40abe40 0x7faad40ac2c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7faad41e81c0 0x7faad41e8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 --2- 172.21.15.194:0/3482001832 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7faab8004d40 0x7faad4158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 >> 172.21.15.194:0/3482001832 conn(0x7faad40aca60 msgr2=0x7faad4150710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 shutdown_connections 2024-03-07T10:24:18.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.378+0000 7faad8e00640 1 -- 172.21.15.194:0/3482001832 wait complete. 2024-03-07T10:24:18.397 INFO:tasks.ceph:Scrubbing osd.7 2024-03-07T10:24:18.397 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-07T10:24:18.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.601+0000 7ff616400640 1 Processor -- start 2024-03-07T10:24:18.603 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.601+0000 7ff616400640 1 -- start start 2024-03-07T10:24:18.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.602+0000 7ff616400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff61014bfa0 0x7ff61006b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.602+0000 7ff616400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7ff6100be5f0 0x7ff610158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff616400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6100c5980 con 0x7ff61006b5c0 2024-03-07T10:24:18.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff616400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100726d0 con 0x7ff61014bfa0 2024-03-07T10:24:18.605 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff616400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6100c8e60 con 0x7ff6100be5f0 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff61014bfa0 0x7ff61006b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff61014bfa0 0x7ff61006b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:32770/0 (socket says 172.21.15.194:32770) 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 -- 172.21.15.194:0/497269793 learned_addr learned my addr 172.21.15.194:0/497269793 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff60fe00640 1 --2- 172.21.15.194:0/497269793 >> v2:172.21.15.196:3300/0 conn(0x7ff6100be5f0 0x7ff610158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 -- 172.21.15.194:0/497269793 >> v2:172.21.15.196:3300/0 conn(0x7ff6100be5f0 msgr2=0x7ff610158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 --2- 172.21.15.194:0/497269793 >> v2:172.21.15.196:3300/0 conn(0x7ff6100be5f0 0x7ff610158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 -- 172.21.15.194:0/497269793 >> v1:172.21.15.196:6789/0 conn(0x7ff61006b5c0 legacy=0x7ff6101594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:18.606 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.603+0000 7ff615000640 1 -- 172.21.15.194:0/497269793 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100c5bf0 con 0x7ff61014bfa0 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.604+0000 7ff615000640 1 --2- 172.21.15.194:0/497269793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff61014bfa0 0x7ff61006b080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff6100c6860 tx=0x7ff60402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ed06f50314195b server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff60f400640 1 -- 172.21.15.194:0/497269793 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604035020 con 0x7ff61014bfa0 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff60f400640 1 -- 172.21.15.194:0/497269793 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff604031870 con 0x7ff61014bfa0 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff60f400640 1 -- 172.21.15.194:0/497269793 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604031c40 con 0x7ff61014bfa0 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 -- 172.21.15.194:0/497269793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff61014bfa0 msgr2=0x7ff61006b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 --2- 172.21.15.194:0/497269793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff61014bfa0 0x7ff61006b080 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff6100c6860 tx=0x7ff60402b910 comp rx=0 tx=0).stop 2024-03-07T10:24:18.607 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 -- 172.21.15.194:0/497269793 shutdown_connections 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 --2- 172.21.15.194:0/497269793 >> v2:172.21.15.196:3300/0 conn(0x7ff6100be5f0 0x7ff610158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 --2- 172.21.15.194:0/497269793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff61014bfa0 0x7ff61006b080 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 -- 172.21.15.194:0/497269793 >> 172.21.15.194:0/497269793 conn(0x7ff6100caf60 msgr2=0x7ff6100cb370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.605+0000 7ff616400640 1 -- 172.21.15.194:0/497269793 shutdown_connections 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.606+0000 7ff616400640 1 -- 172.21.15.194:0/497269793 wait complete. 2024-03-07T10:24:18.608 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.607+0000 7ff616400640 1 Processor -- start 2024-03-07T10:24:18.609 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.607+0000 7ff616400640 1 -- start start 2024-03-07T10:24:18.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61006b5c0 0x7ff6101e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.610 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 0x7ff6101544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61014bfa0 0x7ff6101eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff610156440 con 0x7ff6100be5f0 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6100c61b0 con 0x7ff61006b5c0 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff616400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61014c380 con 0x7ff61014bfa0 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 0x7ff6101544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff60fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 0x7ff6101544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:32776/0 (socket says 172.21.15.194:32776) 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.608+0000 7ff60fe00640 1 -- 172.21.15.194:0/2720495717 learned_addr learned my addr 172.21.15.194:0/2720495717 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff615000640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61006b5c0 0x7ff6101e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 -- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61014bfa0 msgr2=0x7ff6101eace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff61014bfa0 0x7ff6101eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 -- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61006b5c0 msgr2=0x7ff6101e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.611 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff61006b5c0 0x7ff6101e8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6100c0bf0 con 0x7ff6100be5f0 2024-03-07T10:24:18.612 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60fe00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 0x7ff6101544a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d7d0 tx=0x7ff5fc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00b6c0 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc019070 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.609+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6100bf810 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.610+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bac0 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.610+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6100c4560 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.611+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6101e8740 con 0x7ff6100be5f0 2024-03-07T10:24:18.613 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.612+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff5fc00bc60 con 0x7ff6100be5f0 2024-03-07T10:24:18.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.612+0000 7ff60cc00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5f006b500 0x7ff5f006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.614 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.613+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7ff5fc08ab10 con 0x7ff6100be5f0 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.613+0000 7ff60cc00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7ff5f00760f0 0x7ff5f0078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.613+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff5fc008e50 con 0x7ff5f00760f0 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.613+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5fc08f2a0 con 0x7ff6100be5f0 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.613+0000 7ff615000640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5f006b500 0x7ff5f006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.614+0000 7ff615a00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7ff5f00760f0 0x7ff5f0078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.615 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.614+0000 7ff615000640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5f006b500 0x7ff5f006d9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff604036000 tx=0x7ff604008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.616 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.615+0000 7ff615a00640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7ff5f00760f0 0x7ff5f0078570 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.618 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.617+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== osd.7 v2:172.21.15.196:6818/311786582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7ff5fc008e50 con 0x7ff5f00760f0 2024-03-07T10:24:18.632 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.631+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 --> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff610075600 con 0x7ff5f00760f0 2024-03-07T10:24:18.633 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff60cc00640 1 -- 172.21.15.194:0/2720495717 <== osd.7 v2:172.21.15.196:6818/311786582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff610075600 con 0x7ff5f00760f0 2024-03-07T10:24:18.633 INFO:teuthology.orchestra.run.smithi194.stdout:{ 2024-03-07T10:24:18.633 INFO:teuthology.orchestra.run.smithi194.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-07T10:24:18.633 INFO:teuthology.orchestra.run.smithi194.stdout:} 2024-03-07T10:24:18.634 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7ff5f00760f0 msgr2=0x7ff5f0078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6818/311786582,v1:172.21.15.196:6820/311786582] conn(0x7ff5f00760f0 0x7ff5f0078570 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5f006b500 msgr2=0x7ff5f006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff5f006b500 0x7ff5f006d9c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff604036000 tx=0x7ff604008030 comp rx=0 tx=0).stop 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 msgr2=0x7ff6101544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 --2- 172.21.15.194:0/2720495717 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6100be5f0 0x7ff6101544a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc00d7d0 tx=0x7ff5fc00dc90 comp rx=0 tx=0).stop 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff615a00640 1 -- 172.21.15.194:0/2720495717 reap_dead start 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 shutdown_connections 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.632+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 >> 172.21.15.194:0/2720495717 conn(0x7ff6100caf60 msgr2=0x7ff610158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.633+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 shutdown_connections 2024-03-07T10:24:18.635 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.633+0000 7ff616400640 1 -- 172.21.15.194:0/2720495717 wait complete. 2024-03-07T10:24:18.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:24:18.639 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:24:18.650 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-07T10:24:18.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.890+0000 7fccbf200640 1 Processor -- start 2024-03-07T10:24:18.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.890+0000 7fccbf200640 1 -- start start 2024-03-07T10:24:18.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.891+0000 7fccbf200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fccc00c3fa0 0x7fccc006e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.891+0000 7fccbf200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc0153000 con 0x7fccc006b080 2024-03-07T10:24:18.894 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.891+0000 7fccbf200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc00c1f30 con 0x7fccc0152c20 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.891+0000 7fccbf200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc00c1bd0 con 0x7fccc00c3fa0 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbe800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fccc006b080 0x7fccc006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:34532/0 (socket says 172.21.15.194:34532) 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbe800640 1 -- 172.21.15.194:0/899225749 learned_addr learned my addr 172.21.15.194:0/899225749 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbd400640 1 --2- 172.21.15.194:0/899225749 >> v2:172.21.15.194:3300/0 conn(0x7fccc00c3fa0 0x7fccc006e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbca00640 1 -- 172.21.15.194:0/899225749 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427810479 0 0) 0x7fccc0153000 con 0x7fccc006b080 2024-03-07T10:24:18.895 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbca00640 1 -- 172.21.15.194:0/899225749 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcca4003520 con 0x7fccc006b080 2024-03-07T10:24:18.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbd400640 1 -- 172.21.15.194:0/899225749 >> v1:172.21.15.196:6789/0 conn(0x7fccc0152c20 legacy=0x7fccc00c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbd400640 1 -- 172.21.15.194:0/899225749 >> v1:172.21.15.194:6789/0 conn(0x7fccc006b080 legacy=0x7fccc006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.896 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.892+0000 7fccbd400640 1 -- 172.21.15.194:0/899225749 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00c21d0 con 0x7fccc00c3fa0 2024-03-07T10:24:18.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.894+0000 7fccbd400640 1 --2- 172.21.15.194:0/899225749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc00c3fa0 0x7fccc006e030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccac0097a0 tx=0x7fccac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4207cf2915e195 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.894+0000 7fccbca00640 1 -- 172.21.15.194:0/899225749 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac034070 con 0x7fccc00c3fa0 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.894+0000 7fccbca00640 1 -- 172.21.15.194:0/899225749 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac030610 con 0x7fccc00c3fa0 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.894+0000 7fccbca00640 1 -- 172.21.15.194:0/899225749 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac0309c0 con 0x7fccc00c3fa0 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 -- 172.21.15.194:0/899225749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc00c3fa0 msgr2=0x7fccc006e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 --2- 172.21.15.194:0/899225749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc00c3fa0 0x7fccc006e030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fccac0097a0 tx=0x7fccac02b960 comp rx=0 tx=0).stop 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 -- 172.21.15.194:0/899225749 shutdown_connections 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 --2- 172.21.15.194:0/899225749 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc00c3fa0 0x7fccc006e030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 -- 172.21.15.194:0/899225749 >> 172.21.15.194:0/899225749 conn(0x7fccc00671e0 msgr2=0x7fccc00c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 -- 172.21.15.194:0/899225749 shutdown_connections 2024-03-07T10:24:18.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.895+0000 7fccbf200640 1 -- 172.21.15.194:0/899225749 wait complete. 2024-03-07T10:24:18.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.898+0000 7fccbf200640 1 Processor -- start 2024-03-07T10:24:18.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.898+0000 7fccbf200640 1 -- start start 2024-03-07T10:24:18.901 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccc00c3fa0 0x7fccc01ee260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccc0152c20 0x7fccc014b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc006f180 con 0x7fccc006b080 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc01562f0 con 0x7fccc00c3fa0 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.899+0000 7fccbf200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc006bba0 con 0x7fccc0152c20 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57492/0 (socket says 172.21.15.194:57492) 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 -- 172.21.15.194:0/2192985540 learned_addr learned my addr 172.21.15.194:0/2192985540 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbd400640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccc00c3fa0 0x7fccc01ee260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 -- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccc0152c20 msgr2=0x7fccc014b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccc0152c20 0x7fccc014b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 -- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccc00c3fa0 msgr2=0x7fccc01ee260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:18.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccc00c3fa0 0x7fccc01ee260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:18.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 -- 172.21.15.194:0/2192985540 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc00abac0 con 0x7fccc006b080 2024-03-07T10:24:18.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.900+0000 7fccbde00640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c400 tx=0x7fccb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.901+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0017070 con 0x7fccc006b080 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.901+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb00052d0 con 0x7fccc006b080 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.901+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0003830 con 0x7fccc006b080 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.901+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc00ab7e0 con 0x7fccc006b080 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.901+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc01eb0f0 con 0x7fccc006b080 2024-03-07T10:24:18.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.902+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc0068a60 con 0x7fccc006b080 2024-03-07T10:24:18.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.904+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fccb001a070 con 0x7fccc006b080 2024-03-07T10:24:18.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.904+0000 7fccb6000640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 0x7fcca006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:18.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.905+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fccb0089970 con 0x7fccc006b080 2024-03-07T10:24:18.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.905+0000 7fccbd400640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 0x7fcca006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:18.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.906+0000 7fccbd400640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 0x7fcca006d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fccac036000 tx=0x7fccac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:18.911 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:18.910+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fccc0068a60 con 0x7fccc006b080 2024-03-07T10:24:19.108 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.106+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fccc0075600 con 0x7fcca006b4d0 2024-03-07T10:24:19.110 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.107+0000 7fccb6000640 1 -- 172.21.15.194:0/2192985540 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fccc0075600 con 0x7fcca006b4d0 2024-03-07T10:24:19.110 INFO:teuthology.orchestra.run.smithi194.stderr:instructed osd(s) 7 to deep-scrub 2024-03-07T10:24:19.112 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 msgr2=0x7fcca006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 0x7fcca006d990 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fccac036000 tx=0x7fccac008030 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 msgr2=0x7fccc0072700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fccb000c400 tx=0x7fccb000c8c0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 shutdown_connections 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fcca006b4d0 0x7fcca006d990 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fccc0152c20 0x7fccc014b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fccc00c3fa0 0x7fccc01ee260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 --2- 172.21.15.194:0/2192985540 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fccc006b080 0x7fccc0072700 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 >> 172.21.15.194:0/2192985540 conn(0x7fccc00671e0 msgr2=0x7fccc01519b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 shutdown_connections 2024-03-07T10:24:19.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.110+0000 7fccbf200640 1 -- 172.21.15.194:0/2192985540 wait complete. 2024-03-07T10:24:19.130 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:24:19.330 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.328+0000 7fcedc000640 1 Processor -- start 2024-03-07T10:24:19.331 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.328+0000 7fcedc000640 1 -- start start 2024-03-07T10:24:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.329+0000 7fcedc000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.329+0000 7fcedc000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fced406de40 0x7fced415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.329+0000 7fcedc000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fced4153980 con 0x7fced4150b70 2024-03-07T10:24:19.332 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.329+0000 7fcedc000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fced4153c60 con 0x7fced406de40 2024-03-07T10:24:19.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.329+0000 7fcedc000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced4153f40 con 0x7fced4156c20 2024-03-07T10:24:19.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fced9600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fced4150b70 0x7fced40a94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:34538/0 (socket says 172.21.15.194:34538) 2024-03-07T10:24:19.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fced9600640 1 -- 172.21.15.194:0/4061835915 learned_addr learned my addr 172.21.15.194:0/4061835915 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:19.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fceda000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fced406de40 0x7fced415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.333 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fced8c00640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fceda000640 1 -- 172.21.15.194:0/4061835915 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 msgr2=0x7fced406d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fceda000640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced406d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fceda000640 1 -- 172.21.15.194:0/4061835915 >> v1:172.21.15.194:6789/0 conn(0x7fced4150b70 legacy=0x7fced40a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fced3e00640 1 -- 172.21.15.194:0/4061835915 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205315969 0 0) 0x7fced4153980 con 0x7fced4150b70 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.330+0000 7fceda000640 1 -- 172.21.15.194:0/4061835915 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4154220 con 0x7fced406de40 2024-03-07T10:24:19.334 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.332+0000 7fceda000640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced415dfb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009d90 tx=0x7fcecc02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20bcf06825df5cb server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.332+0000 7fced3e00640 1 -- 172.21.15.194:0/4061835915 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc039070 con 0x7fced406de40 2024-03-07T10:24:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.332+0000 7fced3e00640 1 -- 172.21.15.194:0/4061835915 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc02cbc0 con 0x7fced406de40 2024-03-07T10:24:19.335 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.332+0000 7fced3e00640 1 -- 172.21.15.194:0/4061835915 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc034440 con 0x7fced406de40 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 -- 172.21.15.194:0/4061835915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 msgr2=0x7fced415dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced415dfb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009d90 tx=0x7fcecc02be10 comp rx=0 tx=0).stop 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 -- 172.21.15.194:0/4061835915 shutdown_connections 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced415dfb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 --2- 172.21.15.194:0/4061835915 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced406d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 -- 172.21.15.194:0/4061835915 >> 172.21.15.194:0/4061835915 conn(0x7fced406b840 msgr2=0x7fced40c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 -- 172.21.15.194:0/4061835915 shutdown_connections 2024-03-07T10:24:19.336 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.333+0000 7fcedc000640 1 -- 172.21.15.194:0/4061835915 wait complete. 2024-03-07T10:24:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.335+0000 7fcedc000640 1 Processor -- start 2024-03-07T10:24:19.337 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.335+0000 7fcedc000640 1 -- start start 2024-03-07T10:24:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced4150b70 0x7fced4148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced4149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced40a9be0 con 0x7fced406de40 2024-03-07T10:24:19.339 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced4153630 con 0x7fced4150b70 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fcedc000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced40a9d60 con 0x7fced4156c20 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:57498/0 (socket says 172.21.15.194:57498) 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 -- 172.21.15.194:0/4225593571 learned_addr learned my addr 172.21.15.194:0/4225593571 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced8c00640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced4150b70 0x7fced4148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 -- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 msgr2=0x7fced4149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fceda000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced4149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced4149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 -- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced4150b70 msgr2=0x7fced4148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.336+0000 7fced9600640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced4150b70 0x7fced4148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fced9600640 1 -- 172.21.15.194:0/4225593571 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced4071280 con 0x7fced406de40 2024-03-07T10:24:19.340 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fced9600640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c430 tx=0x7fcec800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:19.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec80074e0 con 0x7fced406de40 2024-03-07T10:24:19.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec80047e0 con 0x7fced406de40 2024-03-07T10:24:19.341 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004bd0 con 0x7fced406de40 2024-03-07T10:24:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced4071560 con 0x7fced406de40 2024-03-07T10:24:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.337+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fced4071c20 con 0x7fced406de40 2024-03-07T10:24:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.338+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fced41ef3d0 con 0x7fced406de40 2024-03-07T10:24:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.339+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcec8011070 con 0x7fced406de40 2024-03-07T10:24:19.342 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.340+0000 7fced1600640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 0x7fceb406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:19.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.340+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fcec808a280 con 0x7fced406de40 2024-03-07T10:24:19.343 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.341+0000 7fced8c00640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 0x7fceb406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:19.344 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.342+0000 7fced8c00640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 0x7fceb406d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fced4071170 tx=0x7fcec0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:19.348 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.346+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcec800e280 con 0x7fced406de40 2024-03-07T10:24:19.541 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.538+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fced4068170 con 0x7fceb406b4d0 2024-03-07T10:24:19.577 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.575+0000 7fced1600640 1 -- 172.21.15.194:0/4225593571 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+487259 (secure 0 0 0) 0x7fced4068170 con 0x7fceb406b4d0 2024-03-07T10:24:19.584 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:19.587 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 msgr2=0x7fceb406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 0x7fceb406d990 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fced4071170 tx=0x7fcec0008040 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 msgr2=0x7fced40c0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcec800c430 tx=0x7fcec800c8f0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 shutdown_connections 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceb406b4d0 0x7fceb406d990 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fced4156c20 0x7fced4149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fced4150b70 0x7fced4148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 --2- 172.21.15.194:0/4225593571 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fced406de40 0x7fced40c0660 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 >> 172.21.15.194:0/4225593571 conn(0x7fced406b840 msgr2=0x7fced40a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 shutdown_connections 2024-03-07T10:24:19.590 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:19.581+0000 7fcedc000640 1 -- 172.21.15.194:0/4225593571 wait complete. 2024-03-07T10:24:19.605 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-03-07T10:24:18.492434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":674491,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":354,"num_read_kb":388,"num_write":353,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":820,"ondisk_log_size":820,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":4014080,"data_stored":2423862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9671,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005700"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024280+0000","last_change":"2024-03-07T10:21:09.303131+0000","last_active":"2024-03-07T10:23:58.024280+0000","last_peered":"2024-03-07T10:23:58.024280+0000","last_clean":"2024-03-07T10:23:58.024280+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:23:58.024280+0000","last_undegraded":"2024-03-07T10:23:58.024280+0000","last_fullsized":"2024-03-07T10:23:58.024280+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:40:13.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"28'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030809+0000","last_change":"2024-03-07T10:20:57.161619+0000","last_active":"2024-03-07T10:23:58.030809+0000","last_peered":"2024-03-07T10:23:58.030809+0000","last_clean":"2024-03-07T10:23:58.030809+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:23:58.030809+0000","last_undegraded":"2024-03-07T10:23:58.030809+0000","last_fullsized":"2024-03-07T10:23:58.030809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905262+0000","last_change":"2024-03-07T10:20:58.166356+0000","last_active":"2024-03-07T10:24:05.905262+0000","last_peered":"2024-03-07T10:24:05.905262+0000","last_clean":"2024-03-07T10:24:05.905262+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:05.905262+0000","last_undegraded":"2024-03-07T10:24:05.905262+0000","last_fullsized":"2024-03-07T10:24:05.905262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015913+0000","last_change":"2024-03-07T10:21:08.267517+0000","last_active":"2024-03-07T10:23:58.015913+0000","last_peered":"2024-03-07T10:23:58.015913+0000","last_clean":"2024-03-07T10:23:58.015913+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:23:58.015913+0000","last_undegraded":"2024-03-07T10:23:58.015913+0000","last_fullsized":"2024-03-07T10:23:58.015913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019635+0000","last_change":"2024-03-07T10:21:09.307096+0000","last_active":"2024-03-07T10:23:58.019635+0000","last_peered":"2024-03-07T10:23:58.019635+0000","last_clean":"2024-03-07T10:23:58.019635+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:23:58.019635+0000","last_undegraded":"2024-03-07T10:23:58.019635+0000","last_fullsized":"2024-03-07T10:23:58.019635+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021206+0000","last_change":"2024-03-07T10:20:57.152159+0000","last_active":"2024-03-07T10:23:58.021206+0000","last_peered":"2024-03-07T10:23:58.021206+0000","last_clean":"2024-03-07T10:23:58.021206+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:23:58.021206+0000","last_undegraded":"2024-03-07T10:23:58.021206+0000","last_fullsized":"2024-03-07T10:23:58.021206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908643+0000","last_change":"2024-03-07T10:20:58.164067+0000","last_active":"2024-03-07T10:24:05.908643+0000","last_peered":"2024-03-07T10:24:05.908643+0000","last_clean":"2024-03-07T10:24:05.908643+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:05.908643+0000","last_undegraded":"2024-03-07T10:24:05.908643+0000","last_fullsized":"2024-03-07T10:24:05.908643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024431+0000","last_change":"2024-03-07T10:21:08.275889+0000","last_active":"2024-03-07T10:23:58.024431+0000","last_peered":"2024-03-07T10:23:58.024431+0000","last_clean":"2024-03-07T10:23:58.024431+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:23:58.024431+0000","last_undegraded":"2024-03-07T10:23:58.024431+0000","last_fullsized":"2024-03-07T10:23:58.024431+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:50.105646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047467+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:23:58.047467+0000","last_peered":"2024-03-07T10:23:58.047467+0000","last_clean":"2024-03-07T10:23:58.047467+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:23:58.047467+0000","last_undegraded":"2024-03-07T10:23:58.047467+0000","last_fullsized":"2024-03-07T10:23:58.047467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048385+0000","last_change":"2024-03-07T10:20:57.166695+0000","last_active":"2024-03-07T10:23:58.048385+0000","last_peered":"2024-03-07T10:23:58.048385+0000","last_clean":"2024-03-07T10:23:58.048385+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:23:58.048385+0000","last_undegraded":"2024-03-07T10:23:58.048385+0000","last_fullsized":"2024-03-07T10:23:58.048385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:02.640788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907846+0000","last_change":"2024-03-07T10:20:58.163274+0000","last_active":"2024-03-07T10:24:05.907846+0000","last_peered":"2024-03-07T10:24:05.907846+0000","last_clean":"2024-03-07T10:24:05.907846+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:05.907846+0000","last_undegraded":"2024-03-07T10:24:05.907846+0000","last_fullsized":"2024-03-07T10:24:05.907846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025165+0000","last_change":"2024-03-07T10:21:08.268564+0000","last_active":"2024-03-07T10:23:58.025165+0000","last_peered":"2024-03-07T10:23:58.025165+0000","last_clean":"2024-03-07T10:23:58.025165+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:23:58.025165+0000","last_undegraded":"2024-03-07T10:23:58.025165+0000","last_fullsized":"2024-03-07T10:23:58.025165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048028+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:23:58.048028+0000","last_peered":"2024-03-07T10:23:58.048028+0000","last_clean":"2024-03-07T10:23:58.048028+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:23:58.048028+0000","last_undegraded":"2024-03-07T10:23:58.048028+0000","last_fullsized":"2024-03-07T10:23:58.048028+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:32.441961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902537+0000","last_change":"2024-03-07T10:20:58.153867+0000","last_active":"2024-03-07T10:24:05.902537+0000","last_peered":"2024-03-07T10:24:05.902537+0000","last_clean":"2024-03-07T10:24:05.902537+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:05.902537+0000","last_undegraded":"2024-03-07T10:24:05.902537+0000","last_fullsized":"2024-03-07T10:24:05.902537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024932+0000","last_change":"2024-03-07T10:21:08.264983+0000","last_active":"2024-03-07T10:23:58.024932+0000","last_peered":"2024-03-07T10:23:58.024932+0000","last_clean":"2024-03-07T10:23:58.024932+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:23:58.024932+0000","last_undegraded":"2024-03-07T10:23:58.024932+0000","last_fullsized":"2024-03-07T10:23:58.024932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:40.799539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018881+0000","last_change":"2024-03-07T10:21:09.316227+0000","last_active":"2024-03-07T10:23:58.018881+0000","last_peered":"2024-03-07T10:23:58.018881+0000","last_clean":"2024-03-07T10:23:58.018881+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:23:58.018881+0000","last_undegraded":"2024-03-07T10:23:58.018881+0000","last_fullsized":"2024-03-07T10:23:58.018881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912919+0000","last_change":"2024-03-07T10:20:58.162112+0000","last_active":"2024-03-07T10:24:05.912919+0000","last_peered":"2024-03-07T10:24:05.912919+0000","last_clean":"2024-03-07T10:24:05.912919+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:05.912919+0000","last_undegraded":"2024-03-07T10:24:05.912919+0000","last_fullsized":"2024-03-07T10:24:05.912919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:17.533234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"28'4","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047794+0000","last_change":"2024-03-07T10:20:57.165765+0000","last_active":"2024-03-07T10:23:58.047794+0000","last_peered":"2024-03-07T10:23:58.047794+0000","last_clean":"2024-03-07T10:23:58.047794+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:23:58.047794+0000","last_undegraded":"2024-03-07T10:23:58.047794+0000","last_fullsized":"2024-03-07T10:23:58.047794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:45:29.450376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"23'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026019+0000","last_change":"2024-03-07T10:21:08.279883+0000","last_active":"2024-03-07T10:23:58.026019+0000","last_peered":"2024-03-07T10:23:58.026019+0000","last_clean":"2024-03-07T10:23:58.026019+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:23:58.026019+0000","last_undegraded":"2024-03-07T10:23:58.026019+0000","last_fullsized":"2024-03-07T10:23:58.026019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:17.786981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021578+0000","last_change":"2024-03-07T10:21:09.312329+0000","last_active":"2024-03-07T10:23:58.021578+0000","last_peered":"2024-03-07T10:23:58.021578+0000","last_clean":"2024-03-07T10:23:58.021578+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:23:58.021578+0000","last_undegraded":"2024-03-07T10:23:58.021578+0000","last_fullsized":"2024-03-07T10:23:58.021578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910918+0000","last_change":"2024-03-07T10:20:58.152697+0000","last_active":"2024-03-07T10:24:05.910918+0000","last_peered":"2024-03-07T10:24:05.910918+0000","last_clean":"2024-03-07T10:24:05.910918+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:05.910918+0000","last_undegraded":"2024-03-07T10:24:05.910918+0000","last_fullsized":"2024-03-07T10:24:05.910918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022012+0000","last_change":"2024-03-07T10:20:57.152872+0000","last_active":"2024-03-07T10:23:58.022012+0000","last_peered":"2024-03-07T10:23:58.022012+0000","last_clean":"2024-03-07T10:23:58.022012+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:23:58.022012+0000","last_undegraded":"2024-03-07T10:23:58.022012+0000","last_fullsized":"2024-03-07T10:23:58.022012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025697+0000","last_change":"2024-03-07T10:21:08.282598+0000","last_active":"2024-03-07T10:23:58.025697+0000","last_peered":"2024-03-07T10:23:58.025697+0000","last_clean":"2024-03-07T10:23:58.025697+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:23:58.025697+0000","last_undegraded":"2024-03-07T10:23:58.025697+0000","last_fullsized":"2024-03-07T10:23:58.025697+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:47.267353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025370+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:23:58.025370+0000","last_peered":"2024-03-07T10:23:58.025370+0000","last_clean":"2024-03-07T10:23:58.025370+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:23:58.025370+0000","last_undegraded":"2024-03-07T10:23:58.025370+0000","last_fullsized":"2024-03-07T10:23:58.025370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:47:18.181260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905247+0000","last_change":"2024-03-07T10:20:58.161804+0000","last_active":"2024-03-07T10:24:05.905247+0000","last_peered":"2024-03-07T10:24:05.905247+0000","last_clean":"2024-03-07T10:24:05.905247+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:05.905247+0000","last_undegraded":"2024-03-07T10:24:05.905247+0000","last_fullsized":"2024-03-07T10:24:05.905247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020662+0000","last_change":"2024-03-07T10:20:57.153522+0000","last_active":"2024-03-07T10:23:58.020662+0000","last_peered":"2024-03-07T10:23:58.020662+0000","last_clean":"2024-03-07T10:23:58.020662+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:23:58.020662+0000","last_undegraded":"2024-03-07T10:23:58.020662+0000","last_fullsized":"2024-03-07T10:23:58.020662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"23'1","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024785+0000","last_change":"2024-03-07T10:21:08.285703+0000","last_active":"2024-03-07T10:23:58.024785+0000","last_peered":"2024-03-07T10:23:58.024785+0000","last_clean":"2024-03-07T10:23:58.024785+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:23:58.024785+0000","last_undegraded":"2024-03-07T10:23:58.024785+0000","last_fullsized":"2024-03-07T10:23:58.024785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027741+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:23:58.027741+0000","last_peered":"2024-03-07T10:23:58.027741+0000","last_clean":"2024-03-07T10:23:58.027741+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:23:58.027741+0000","last_undegraded":"2024-03-07T10:23:58.027741+0000","last_fullsized":"2024-03-07T10:23:58.027741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.851798+0000","last_change":"2024-03-07T10:20:58.155850+0000","last_active":"2024-03-07T10:24:05.851798+0000","last_peered":"2024-03-07T10:24:05.851798+0000","last_clean":"2024-03-07T10:24:05.851798+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:05.851798+0000","last_undegraded":"2024-03-07T10:24:05.851798+0000","last_fullsized":"2024-03-07T10:24:05.851798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:16.672128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047943+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:23:58.047943+0000","last_peered":"2024-03-07T10:23:58.047943+0000","last_clean":"2024-03-07T10:23:58.047943+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:23:58.047943+0000","last_undegraded":"2024-03-07T10:23:58.047943+0000","last_fullsized":"2024-03-07T10:23:58.047943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.036887+0000","last_change":"2024-03-07T10:21:08.277452+0000","last_active":"2024-03-07T10:24:01.036887+0000","last_peered":"2024-03-07T10:24:01.036887+0000","last_clean":"2024-03-07T10:24:01.036887+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:01.036887+0000","last_undegraded":"2024-03-07T10:24:01.036887+0000","last_fullsized":"2024-03-07T10:24:01.036887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016449+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:23:58.016449+0000","last_peered":"2024-03-07T10:23:58.016449+0000","last_clean":"2024-03-07T10:23:58.016449+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:23:58.016449+0000","last_undegraded":"2024-03-07T10:23:58.016449+0000","last_fullsized":"2024-03-07T10:23:58.016449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906895+0000","last_change":"2024-03-07T10:20:58.161874+0000","last_active":"2024-03-07T10:24:05.906895+0000","last_peered":"2024-03-07T10:24:05.906895+0000","last_clean":"2024-03-07T10:24:05.906895+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:05.906895+0000","last_undegraded":"2024-03-07T10:24:05.906895+0000","last_fullsized":"2024-03-07T10:24:05.906895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"28'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037774+0000","last_change":"2024-03-07T10:20:57.161097+0000","last_active":"2024-03-07T10:23:58.037774+0000","last_peered":"2024-03-07T10:23:58.037774+0000","last_clean":"2024-03-07T10:23:58.037774+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:23:58.037774+0000","last_undegraded":"2024-03-07T10:23:58.037774+0000","last_fullsized":"2024-03-07T10:23:58.037774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.037586+0000","last_change":"2024-03-07T10:21:08.280598+0000","last_active":"2024-03-07T10:24:07.037586+0000","last_peered":"2024-03-07T10:24:07.037586+0000","last_clean":"2024-03-07T10:24:07.037586+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:24:07.037586+0000","last_undegraded":"2024-03-07T10:24:07.037586+0000","last_fullsized":"2024-03-07T10:24:07.037586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:38.302296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024293+0000","last_change":"2024-03-07T10:21:09.298373+0000","last_active":"2024-03-07T10:23:58.024293+0000","last_peered":"2024-03-07T10:23:58.024293+0000","last_clean":"2024-03-07T10:23:58.024293+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:23:58.024293+0000","last_undegraded":"2024-03-07T10:23:58.024293+0000","last_fullsized":"2024-03-07T10:23:58.024293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:20.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906259+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:24:05.906259+0000","last_peered":"2024-03-07T10:24:05.906259+0000","last_clean":"2024-03-07T10:24:05.906259+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:05.906259+0000","last_undegraded":"2024-03-07T10:24:05.906259+0000","last_fullsized":"2024-03-07T10:24:05.906259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:06.016499+0000","last_change":"2024-03-07T10:20:57.162337+0000","last_active":"2024-03-07T10:24:06.016499+0000","last_peered":"2024-03-07T10:24:06.016499+0000","last_clean":"2024-03-07T10:24:06.016499+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:24:06.016499+0000","last_undegraded":"2024-03-07T10:24:06.016499+0000","last_fullsized":"2024-03-07T10:24:06.016499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015421+0000","last_change":"2024-03-07T10:21:08.283066+0000","last_active":"2024-03-07T10:23:58.015421+0000","last_peered":"2024-03-07T10:23:58.015421+0000","last_clean":"2024-03-07T10:23:58.015421+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:23:58.015421+0000","last_undegraded":"2024-03-07T10:23:58.015421+0000","last_fullsized":"2024-03-07T10:23:58.015421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036766+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:23:58.036766+0000","last_peered":"2024-03-07T10:23:58.036766+0000","last_clean":"2024-03-07T10:23:58.036766+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:23:58.036766+0000","last_undegraded":"2024-03-07T10:23:58.036766+0000","last_fullsized":"2024-03-07T10:23:58.036766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:06.966055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.900869+0000","last_change":"2024-03-07T10:20:58.160549+0000","last_active":"2024-03-07T10:24:05.900869+0000","last_peered":"2024-03-07T10:24:05.900869+0000","last_clean":"2024-03-07T10:24:05.900869+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:05.900869+0000","last_undegraded":"2024-03-07T10:24:05.900869+0000","last_fullsized":"2024-03-07T10:24:05.900869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048513+0000","last_change":"2024-03-07T10:20:57.165827+0000","last_active":"2024-03-07T10:23:58.048513+0000","last_peered":"2024-03-07T10:23:58.048513+0000","last_clean":"2024-03-07T10:23:58.048513+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:23:58.048513+0000","last_undegraded":"2024-03-07T10:23:58.048513+0000","last_fullsized":"2024-03-07T10:23:58.048513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:07:28.200219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030182+0000","last_change":"2024-03-07T10:21:08.285588+0000","last_active":"2024-03-07T10:23:58.030182+0000","last_peered":"2024-03-07T10:23:58.030182+0000","last_clean":"2024-03-07T10:23:58.030182+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:23:58.030182+0000","last_undegraded":"2024-03-07T10:23:58.030182+0000","last_fullsized":"2024-03-07T10:23:58.030182+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030747+0000","last_change":"2024-03-07T10:21:09.308530+0000","last_active":"2024-03-07T10:23:58.030747+0000","last_peered":"2024-03-07T10:23:58.030747+0000","last_clean":"2024-03-07T10:23:58.030747+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:23:58.030747+0000","last_undegraded":"2024-03-07T10:23:58.030747+0000","last_fullsized":"2024-03-07T10:23:58.030747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912092+0000","last_change":"2024-03-07T10:20:58.165146+0000","last_active":"2024-03-07T10:24:05.912092+0000","last_peered":"2024-03-07T10:24:05.912092+0000","last_clean":"2024-03-07T10:24:05.912092+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:05.912092+0000","last_undegraded":"2024-03-07T10:24:05.912092+0000","last_fullsized":"2024-03-07T10:24:05.912092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022876+0000","last_change":"2024-03-07T10:20:57.159063+0000","last_active":"2024-03-07T10:23:58.022876+0000","last_peered":"2024-03-07T10:23:58.022876+0000","last_clean":"2024-03-07T10:23:58.022876+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:23:58.022876+0000","last_undegraded":"2024-03-07T10:23:58.022876+0000","last_fullsized":"2024-03-07T10:23:58.022876+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021334+0000","last_change":"2024-03-07T10:21:08.289003+0000","last_active":"2024-03-07T10:23:58.021334+0000","last_peered":"2024-03-07T10:23:58.021334+0000","last_clean":"2024-03-07T10:23:58.021334+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:23:58.021334+0000","last_undegraded":"2024-03-07T10:23:58.021334+0000","last_fullsized":"2024-03-07T10:23:58.021334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029876+0000","last_change":"2024-03-07T10:21:09.323258+0000","last_active":"2024-03-07T10:23:58.029876+0000","last_peered":"2024-03-07T10:23:58.029876+0000","last_clean":"2024-03-07T10:23:58.029876+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:23:58.029876+0000","last_undegraded":"2024-03-07T10:23:58.029876+0000","last_fullsized":"2024-03-07T10:23:58.029876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906576+0000","last_change":"2024-03-07T10:20:58.149323+0000","last_active":"2024-03-07T10:24:05.906576+0000","last_peered":"2024-03-07T10:24:05.906576+0000","last_clean":"2024-03-07T10:24:05.906576+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:05.906576+0000","last_undegraded":"2024-03-07T10:24:05.906576+0000","last_fullsized":"2024-03-07T10:24:05.906576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:03.654825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026748+0000","last_change":"2024-03-07T10:20:57.161917+0000","last_active":"2024-03-07T10:23:58.026748+0000","last_peered":"2024-03-07T10:23:58.026748+0000","last_clean":"2024-03-07T10:23:58.026748+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:23:58.026748+0000","last_undegraded":"2024-03-07T10:23:58.026748+0000","last_fullsized":"2024-03-07T10:23:58.026748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.191210+0000","last_change":"2024-03-07T10:24:16.191234+0000","last_active":"2024-03-07T10:24:16.191210+0000","last_peered":"2024-03-07T10:24:16.191210+0000","last_clean":"2024-03-07T10:24:16.191210+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:24:16.191210+0000","last_undegraded":"2024-03-07T10:24:16.191210+0000","last_fullsized":"2024-03-07T10:24:16.191210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.191110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:24.909595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021660+0000","last_change":"2024-03-07T10:21:09.313046+0000","last_active":"2024-03-07T10:23:58.021660+0000","last_peered":"2024-03-07T10:23:58.021660+0000","last_clean":"2024-03-07T10:23:58.021660+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:23:58.021660+0000","last_undegraded":"2024-03-07T10:23:58.021660+0000","last_fullsized":"2024-03-07T10:23:58.021660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.898405+0000","last_change":"2024-03-07T10:20:58.168715+0000","last_active":"2024-03-07T10:24:05.898405+0000","last_peered":"2024-03-07T10:24:05.898405+0000","last_clean":"2024-03-07T10:24:05.898405+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:05.898405+0000","last_undegraded":"2024-03-07T10:24:05.898405+0000","last_fullsized":"2024-03-07T10:24:05.898405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020707+0000","last_change":"2024-03-07T10:20:57.154285+0000","last_active":"2024-03-07T10:23:58.020707+0000","last_peered":"2024-03-07T10:23:58.020707+0000","last_clean":"2024-03-07T10:23:58.020707+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:23:58.020707+0000","last_undegraded":"2024-03-07T10:23:58.020707+0000","last_fullsized":"2024-03-07T10:23:58.020707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"27'3","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.053084+0000","last_change":"2024-03-07T10:21:08.289749+0000","last_active":"2024-03-07T10:24:01.053084+0000","last_peered":"2024-03-07T10:24:01.053084+0000","last_clean":"2024-03-07T10:24:01.053084+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:01.053084+0000","last_undegraded":"2024-03-07T10:24:01.053084+0000","last_fullsized":"2024-03-07T10:24:01.053084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027870+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:23:58.027870+0000","last_peered":"2024-03-07T10:23:58.027870+0000","last_clean":"2024-03-07T10:23:58.027870+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:23:58.027870+0000","last_undegraded":"2024-03-07T10:23:58.027870+0000","last_fullsized":"2024-03-07T10:23:58.027870+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908010+0000","last_change":"2024-03-07T10:20:58.156377+0000","last_active":"2024-03-07T10:24:05.908010+0000","last_peered":"2024-03-07T10:24:05.908010+0000","last_clean":"2024-03-07T10:24:05.908010+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:05.908010+0000","last_undegraded":"2024-03-07T10:24:05.908010+0000","last_fullsized":"2024-03-07T10:24:05.908010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047603+0000","last_change":"2024-03-07T10:20:57.162063+0000","last_active":"2024-03-07T10:23:58.047603+0000","last_peered":"2024-03-07T10:23:58.047603+0000","last_clean":"2024-03-07T10:23:58.047603+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:23:58.047603+0000","last_undegraded":"2024-03-07T10:23:58.047603+0000","last_fullsized":"2024-03-07T10:23:58.047603+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'15","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:10.024691+0000","last_change":"2024-03-07T10:21:08.286429+0000","last_active":"2024-03-07T10:24:10.024691+0000","last_peered":"2024-03-07T10:24:10.024691+0000","last_clean":"2024-03-07T10:24:10.024691+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:10.024691+0000","last_undegraded":"2024-03-07T10:24:10.024691+0000","last_fullsized":"2024-03-07T10:24:10.024691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047787+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:23:58.047787+0000","last_peered":"2024-03-07T10:23:58.047787+0000","last_clean":"2024-03-07T10:23:58.047787+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:23:58.047787+0000","last_undegraded":"2024-03-07T10:23:58.047787+0000","last_fullsized":"2024-03-07T10:23:58.047787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:24:40.262645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907464+0000","last_change":"2024-03-07T10:20:58.163606+0000","last_active":"2024-03-07T10:24:05.907464+0000","last_peered":"2024-03-07T10:24:05.907464+0000","last_clean":"2024-03-07T10:24:05.907464+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:05.907464+0000","last_undegraded":"2024-03-07T10:24:05.907464+0000","last_fullsized":"2024-03-07T10:24:05.907464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026879+0000","last_change":"2024-03-07T10:20:57.157375+0000","last_active":"2024-03-07T10:23:58.026879+0000","last_peered":"2024-03-07T10:23:58.026879+0000","last_clean":"2024-03-07T10:23:58.026879+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:23:58.026879+0000","last_undegraded":"2024-03-07T10:23:58.026879+0000","last_fullsized":"2024-03-07T10:23:58.026879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047898+0000","last_change":"2024-03-07T10:20:48.056690+0000","last_active":"2024-03-07T10:23:58.047898+0000","last_peered":"2024-03-07T10:23:58.047898+0000","last_clean":"2024-03-07T10:23:58.047898+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:23:58.047898+0000","last_undegraded":"2024-03-07T10:23:58.047898+0000","last_fullsized":"2024-03-07T10:23:58.047898+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:46.734762+0000","last_clean_scrub_stamp":"2024-03-07T10:20:46.734762+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:28:38.377297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037197+0000","last_change":"2024-03-07T10:21:08.289722+0000","last_active":"2024-03-07T10:23:58.037197+0000","last_peered":"2024-03-07T10:23:58.037197+0000","last_clean":"2024-03-07T10:23:58.037197+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:23:58.037197+0000","last_undegraded":"2024-03-07T10:23:58.037197+0000","last_fullsized":"2024-03-07T10:23:58.037197+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:42.580874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.115052+0000","last_change":"2024-03-07T10:24:16.115076+0000","last_active":"2024-03-07T10:24:16.115052+0000","last_peered":"2024-03-07T10:24:16.115052+0000","last_clean":"2024-03-07T10:24:16.115052+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:24:16.115052+0000","last_undegraded":"2024-03-07T10:24:16.115052+0000","last_fullsized":"2024-03-07T10:24:16.115052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.114954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:44:18.227347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911873+0000","last_change":"2024-03-07T10:20:58.171418+0000","last_active":"2024-03-07T10:24:05.911873+0000","last_peered":"2024-03-07T10:24:05.911873+0000","last_clean":"2024-03-07T10:24:05.911873+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:05.911873+0000","last_undegraded":"2024-03-07T10:24:05.911873+0000","last_fullsized":"2024-03-07T10:24:05.911873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021831+0000","last_change":"2024-03-07T10:20:57.158939+0000","last_active":"2024-03-07T10:23:58.021831+0000","last_peered":"2024-03-07T10:23:58.021831+0000","last_clean":"2024-03-07T10:23:58.021831+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:23:58.021831+0000","last_undegraded":"2024-03-07T10:23:58.021831+0000","last_fullsized":"2024-03-07T10:23:58.021831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036726+0000","last_change":"2024-03-07T10:21:08.288461+0000","last_active":"2024-03-07T10:23:58.036726+0000","last_peered":"2024-03-07T10:23:58.036726+0000","last_clean":"2024-03-07T10:23:58.036726+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:23:58.036726+0000","last_undegraded":"2024-03-07T10:23:58.036726+0000","last_fullsized":"2024-03-07T10:23:58.036726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019814+0000","last_change":"2024-03-07T10:21:09.308761+0000","last_active":"2024-03-07T10:23:58.019814+0000","last_peered":"2024-03-07T10:23:58.019814+0000","last_clean":"2024-03-07T10:23:58.019814+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:23:58.019814+0000","last_undegraded":"2024-03-07T10:23:58.019814+0000","last_fullsized":"2024-03-07T10:23:58.019814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913110+0000","last_change":"2024-03-07T10:20:58.152612+0000","last_active":"2024-03-07T10:24:05.913110+0000","last_peered":"2024-03-07T10:24:05.913110+0000","last_clean":"2024-03-07T10:24:05.913110+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:05.913110+0000","last_undegraded":"2024-03-07T10:24:05.913110+0000","last_fullsized":"2024-03-07T10:24:05.913110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024310+0000","last_change":"2024-03-07T10:20:57.159258+0000","last_active":"2024-03-07T10:23:58.024310+0000","last_peered":"2024-03-07T10:23:58.024310+0000","last_clean":"2024-03-07T10:23:58.024310+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:23:58.024310+0000","last_undegraded":"2024-03-07T10:23:58.024310+0000","last_fullsized":"2024-03-07T10:23:58.024310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.033892+0000","last_change":"2024-03-07T10:21:08.284627+0000","last_active":"2024-03-07T10:24:07.033892+0000","last_peered":"2024-03-07T10:24:07.033892+0000","last_clean":"2024-03-07T10:24:07.033892+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:24:07.033892+0000","last_undegraded":"2024-03-07T10:24:07.033892+0000","last_fullsized":"2024-03-07T10:24:07.033892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047240+0000","last_change":"2024-03-07T10:21:09.300122+0000","last_active":"2024-03-07T10:23:58.047240+0000","last_peered":"2024-03-07T10:23:58.047240+0000","last_clean":"2024-03-07T10:23:58.047240+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:23:58.047240+0000","last_undegraded":"2024-03-07T10:23:58.047240+0000","last_fullsized":"2024-03-07T10:23:58.047240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905249+0000","last_change":"2024-03-07T10:20:58.161976+0000","last_active":"2024-03-07T10:24:05.905249+0000","last_peered":"2024-03-07T10:24:05.905249+0000","last_clean":"2024-03-07T10:24:05.905249+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:05.905249+0000","last_undegraded":"2024-03-07T10:24:05.905249+0000","last_fullsized":"2024-03-07T10:24:05.905249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:37:07.123539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.022064+0000","last_change":"2024-03-07T10:20:57.158349+0000","last_active":"2024-03-07T10:23:58.022064+0000","last_peered":"2024-03-07T10:23:58.022064+0000","last_clean":"2024-03-07T10:23:58.022064+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:23:58.022064+0000","last_undegraded":"2024-03-07T10:23:58.022064+0000","last_fullsized":"2024-03-07T10:23:58.022064+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024972+0000","last_change":"2024-03-07T10:21:08.278275+0000","last_active":"2024-03-07T10:23:58.024972+0000","last_peered":"2024-03-07T10:23:58.024972+0000","last_clean":"2024-03-07T10:23:58.024972+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:23:58.024972+0000","last_undegraded":"2024-03-07T10:23:58.024972+0000","last_fullsized":"2024-03-07T10:23:58.024972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:06:05.952252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020955+0000","last_change":"2024-03-07T10:21:09.310444+0000","last_active":"2024-03-07T10:23:58.020955+0000","last_peered":"2024-03-07T10:23:58.020955+0000","last_clean":"2024-03-07T10:23:58.020955+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:23:58.020955+0000","last_undegraded":"2024-03-07T10:23:58.020955+0000","last_fullsized":"2024-03-07T10:23:58.020955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904960+0000","last_change":"2024-03-07T10:20:58.158392+0000","last_active":"2024-03-07T10:24:05.904960+0000","last_peered":"2024-03-07T10:24:05.904960+0000","last_clean":"2024-03-07T10:24:05.904960+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:05.904960+0000","last_undegraded":"2024-03-07T10:24:05.904960+0000","last_fullsized":"2024-03-07T10:24:05.904960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:42:32.464691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025874+0000","last_change":"2024-03-07T10:20:57.163371+0000","last_active":"2024-03-07T10:23:58.025874+0000","last_peered":"2024-03-07T10:23:58.025874+0000","last_clean":"2024-03-07T10:23:58.025874+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:23:58.025874+0000","last_undegraded":"2024-03-07T10:23:58.025874+0000","last_fullsized":"2024-03-07T10:23:58.025874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:00:00.783068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024476+0000","last_change":"2024-03-07T10:21:08.287676+0000","last_active":"2024-03-07T10:23:58.024476+0000","last_peered":"2024-03-07T10:23:58.024476+0000","last_clean":"2024-03-07T10:23:58.024476+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:23:58.024476+0000","last_undegraded":"2024-03-07T10:23:58.024476+0000","last_fullsized":"2024-03-07T10:23:58.024476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:37.367109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019374+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:23:58.019374+0000","last_peered":"2024-03-07T10:23:58.019374+0000","last_clean":"2024-03-07T10:23:58.019374+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:23:58.019374+0000","last_undegraded":"2024-03-07T10:23:58.019374+0000","last_fullsized":"2024-03-07T10:23:58.019374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905323+0000","last_change":"2024-03-07T10:20:58.152006+0000","last_active":"2024-03-07T10:24:05.905323+0000","last_peered":"2024-03-07T10:24:05.905323+0000","last_clean":"2024-03-07T10:24:05.905323+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:05.905323+0000","last_undegraded":"2024-03-07T10:24:05.905323+0000","last_fullsized":"2024-03-07T10:24:05.905323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:19.828629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"28'9","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020909+0000","last_change":"2024-03-07T10:20:57.156195+0000","last_active":"2024-03-07T10:23:58.020909+0000","last_peered":"2024-03-07T10:23:58.020909+0000","last_clean":"2024-03-07T10:23:58.020909+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:23:58.020909+0000","last_undegraded":"2024-03-07T10:23:58.020909+0000","last_fullsized":"2024-03-07T10:23:58.020909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030593+0000","last_change":"2024-03-07T10:21:08.281592+0000","last_active":"2024-03-07T10:23:58.030593+0000","last_peered":"2024-03-07T10:23:58.030593+0000","last_clean":"2024-03-07T10:23:58.030593+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:23:58.030593+0000","last_undegraded":"2024-03-07T10:23:58.030593+0000","last_fullsized":"2024-03-07T10:23:58.030593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026481+0000","last_change":"2024-03-07T10:21:09.297305+0000","last_active":"2024-03-07T10:23:58.026481+0000","last_peered":"2024-03-07T10:23:58.026481+0000","last_clean":"2024-03-07T10:23:58.026481+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:23:58.026481+0000","last_undegraded":"2024-03-07T10:23:58.026481+0000","last_fullsized":"2024-03-07T10:23:58.026481+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:17.544665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908498+0000","last_change":"2024-03-07T10:20:58.157961+0000","last_active":"2024-03-07T10:24:05.908498+0000","last_peered":"2024-03-07T10:24:05.908498+0000","last_clean":"2024-03-07T10:24:05.908498+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:05.908498+0000","last_undegraded":"2024-03-07T10:24:05.908498+0000","last_fullsized":"2024-03-07T10:24:05.908498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:03:45.668329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036847+0000","last_change":"2024-03-07T10:20:57.161782+0000","last_active":"2024-03-07T10:23:58.036847+0000","last_peered":"2024-03-07T10:23:58.036847+0000","last_clean":"2024-03-07T10:23:58.036847+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:23:58.036847+0000","last_undegraded":"2024-03-07T10:23:58.036847+0000","last_fullsized":"2024-03-07T10:23:58.036847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:07.063271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.033217+0000","last_change":"2024-03-07T10:21:08.286043+0000","last_active":"2024-03-07T10:24:07.033217+0000","last_peered":"2024-03-07T10:24:07.033217+0000","last_clean":"2024-03-07T10:24:07.033217+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:24:07.033217+0000","last_undegraded":"2024-03-07T10:24:07.033217+0000","last_fullsized":"2024-03-07T10:24:07.033217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026935+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:23:58.026935+0000","last_peered":"2024-03-07T10:23:58.026935+0000","last_clean":"2024-03-07T10:23:58.026935+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:23:58.026935+0000","last_undegraded":"2024-03-07T10:23:58.026935+0000","last_fullsized":"2024-03-07T10:23:58.026935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:13:03.478617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906429+0000","last_change":"2024-03-07T10:20:58.155023+0000","last_active":"2024-03-07T10:24:05.906429+0000","last_peered":"2024-03-07T10:24:05.906429+0000","last_clean":"2024-03-07T10:24:05.906429+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:05.906429+0000","last_undegraded":"2024-03-07T10:24:05.906429+0000","last_fullsized":"2024-03-07T10:24:05.906429+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:34:07.670799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026621+0000","last_change":"2024-03-07T10:20:57.158778+0000","last_active":"2024-03-07T10:23:58.026621+0000","last_peered":"2024-03-07T10:23:58.026621+0000","last_clean":"2024-03-07T10:23:58.026621+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:23:58.026621+0000","last_undegraded":"2024-03-07T10:23:58.026621+0000","last_fullsized":"2024-03-07T10:23:58.026621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'36","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:09.308589+0000","last_change":"2024-03-07T10:21:08.286577+0000","last_active":"2024-03-07T10:24:09.308589+0000","last_peered":"2024-03-07T10:24:09.308589+0000","last_clean":"2024-03-07T10:24:09.308589+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:09.308589+0000","last_undegraded":"2024-03-07T10:24:09.308589+0000","last_fullsized":"2024-03-07T10:24:09.308589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":32,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016831+0000","last_change":"2024-03-07T10:21:09.289817+0000","last_active":"2024-03-07T10:23:58.016831+0000","last_peered":"2024-03-07T10:23:58.016831+0000","last_clean":"2024-03-07T10:23:58.016831+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:23:58.016831+0000","last_undegraded":"2024-03-07T10:23:58.016831+0000","last_fullsized":"2024-03-07T10:23:58.016831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.903654+0000","last_change":"2024-03-07T10:20:58.148581+0000","last_active":"2024-03-07T10:24:05.903654+0000","last_peered":"2024-03-07T10:24:05.903654+0000","last_clean":"2024-03-07T10:24:05.903654+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:05.903654+0000","last_undegraded":"2024-03-07T10:24:05.903654+0000","last_fullsized":"2024-03-07T10:24:05.903654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.031202+0000","last_change":"2024-03-07T10:20:57.159889+0000","last_active":"2024-03-07T10:23:58.031202+0000","last_peered":"2024-03-07T10:23:58.031202+0000","last_clean":"2024-03-07T10:23:58.031202+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:23:58.031202+0000","last_undegraded":"2024-03-07T10:23:58.031202+0000","last_fullsized":"2024-03-07T10:23:58.031202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.035163+0000","last_change":"2024-03-07T10:21:08.288696+0000","last_active":"2024-03-07T10:24:07.035163+0000","last_peered":"2024-03-07T10:24:07.035163+0000","last_clean":"2024-03-07T10:24:07.035163+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:07.035163+0000","last_undegraded":"2024-03-07T10:24:07.035163+0000","last_fullsized":"2024-03-07T10:24:07.035163+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:08:19.847999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017103+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:23:58.017103+0000","last_peered":"2024-03-07T10:23:58.017103+0000","last_clean":"2024-03-07T10:23:58.017103+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:23:58.017103+0000","last_undegraded":"2024-03-07T10:23:58.017103+0000","last_fullsized":"2024-03-07T10:23:58.017103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.901641+0000","last_change":"2024-03-07T10:20:58.156228+0000","last_active":"2024-03-07T10:24:05.901641+0000","last_peered":"2024-03-07T10:24:05.901641+0000","last_clean":"2024-03-07T10:24:05.901641+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:05.901641+0000","last_undegraded":"2024-03-07T10:24:05.901641+0000","last_fullsized":"2024-03-07T10:24:05.901641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'29","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.845529+0000","last_change":"2024-03-07T10:20:57.156307+0000","last_active":"2024-03-07T10:24:05.845529+0000","last_peered":"2024-03-07T10:24:05.845529+0000","last_clean":"2024-03-07T10:24:05.845529+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:05.845529+0000","last_undegraded":"2024-03-07T10:24:05.845529+0000","last_fullsized":"2024-03-07T10:24:05.845529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:14:57.058081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.180090+0000","last_change":"2024-03-07T10:24:15.180114+0000","last_active":"2024-03-07T10:24:15.180090+0000","last_peered":"2024-03-07T10:24:15.180090+0000","last_clean":"2024-03-07T10:24:15.180090+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:24:15.180090+0000","last_undegraded":"2024-03-07T10:24:15.180090+0000","last_fullsized":"2024-03-07T10:24:15.180090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.180026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:10:58.716023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021679+0000","last_change":"2024-03-07T10:21:09.306934+0000","last_active":"2024-03-07T10:23:58.021679+0000","last_peered":"2024-03-07T10:23:58.021679+0000","last_clean":"2024-03-07T10:23:58.021679+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:23:58.021679+0000","last_undegraded":"2024-03-07T10:23:58.021679+0000","last_fullsized":"2024-03-07T10:23:58.021679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.902224+0000","last_change":"2024-03-07T10:20:58.146149+0000","last_active":"2024-03-07T10:24:05.902224+0000","last_peered":"2024-03-07T10:24:05.902224+0000","last_clean":"2024-03-07T10:24:05.902224+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:05.902224+0000","last_undegraded":"2024-03-07T10:24:05.902224+0000","last_fullsized":"2024-03-07T10:24:05.902224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:51:33.455999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024174+0000","last_change":"2024-03-07T10:20:57.164658+0000","last_active":"2024-03-07T10:23:58.024174+0000","last_peered":"2024-03-07T10:23:58.024174+0000","last_clean":"2024-03-07T10:23:58.024174+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:23:58.024174+0000","last_undegraded":"2024-03-07T10:23:58.024174+0000","last_fullsized":"2024-03-07T10:23:58.024174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"23'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026448+0000","last_change":"2024-03-07T10:21:08.276124+0000","last_active":"2024-03-07T10:23:58.026448+0000","last_peered":"2024-03-07T10:23:58.026448+0000","last_clean":"2024-03-07T10:23:58.026448+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:23:58.026448+0000","last_undegraded":"2024-03-07T10:23:58.026448+0000","last_fullsized":"2024-03-07T10:23:58.026448+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:43:29.944811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036723+0000","last_change":"2024-03-07T10:21:09.286783+0000","last_active":"2024-03-07T10:23:58.036723+0000","last_peered":"2024-03-07T10:23:58.036723+0000","last_clean":"2024-03-07T10:23:58.036723+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:23:58.036723+0000","last_undegraded":"2024-03-07T10:23:58.036723+0000","last_fullsized":"2024-03-07T10:23:58.036723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:18:44.629196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.761771+0000","last_change":"2024-03-07T10:24:15.761796+0000","last_active":"2024-03-07T10:24:15.761771+0000","last_peered":"2024-03-07T10:24:15.761771+0000","last_clean":"2024-03-07T10:24:15.761771+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:15.761771+0000","last_undegraded":"2024-03-07T10:24:15.761771+0000","last_fullsized":"2024-03-07T10:24:15.761771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.761687+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:12:30.714756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027480+0000","last_change":"2024-03-07T10:20:57.164015+0000","last_active":"2024-03-07T10:23:58.027480+0000","last_peered":"2024-03-07T10:23:58.027480+0000","last_clean":"2024-03-07T10:23:58.027480+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:23:58.027480+0000","last_undegraded":"2024-03-07T10:23:58.027480+0000","last_fullsized":"2024-03-07T10:23:58.027480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:15:15.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'9","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.041085+0000","last_change":"2024-03-07T10:21:08.279548+0000","last_active":"2024-03-07T10:24:07.041085+0000","last_peered":"2024-03-07T10:24:07.041085+0000","last_clean":"2024-03-07T10:24:07.041085+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:07.041085+0000","last_undegraded":"2024-03-07T10:24:07.041085+0000","last_fullsized":"2024-03-07T10:24:07.041085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047262+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:23:58.047262+0000","last_peered":"2024-03-07T10:23:58.047262+0000","last_clean":"2024-03-07T10:23:58.047262+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:23:58.047262+0000","last_undegraded":"2024-03-07T10:23:58.047262+0000","last_fullsized":"2024-03-07T10:23:58.047262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:06.497359+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:24:06.497359+0000","last_peered":"2024-03-07T10:24:06.497359+0000","last_clean":"2024-03-07T10:24:06.497359+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:06.497359+0000","last_undegraded":"2024-03-07T10:24:06.497359+0000","last_fullsized":"2024-03-07T10:24:06.497359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037698+0000","last_change":"2024-03-07T10:20:57.166646+0000","last_active":"2024-03-07T10:23:58.037698+0000","last_peered":"2024-03-07T10:23:58.037698+0000","last_clean":"2024-03-07T10:23:58.037698+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:23:58.037698+0000","last_undegraded":"2024-03-07T10:23:58.037698+0000","last_fullsized":"2024-03-07T10:23:58.037698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:22.472262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015481+0000","last_change":"2024-03-07T10:21:08.277920+0000","last_active":"2024-03-07T10:23:58.015481+0000","last_peered":"2024-03-07T10:23:58.015481+0000","last_clean":"2024-03-07T10:23:58.015481+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:23:58.015481+0000","last_undegraded":"2024-03-07T10:23:58.015481+0000","last_fullsized":"2024-03-07T10:23:58.015481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037601+0000","last_change":"2024-03-07T10:21:09.292162+0000","last_active":"2024-03-07T10:23:58.037601+0000","last_peered":"2024-03-07T10:23:58.037601+0000","last_clean":"2024-03-07T10:23:58.037601+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:23:58.037601+0000","last_undegraded":"2024-03-07T10:23:58.037601+0000","last_fullsized":"2024-03-07T10:23:58.037601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:49:20.974547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.046083+0000","last_change":"2024-03-07T10:21:08.278403+0000","last_active":"2024-03-07T10:23:58.046083+0000","last_peered":"2024-03-07T10:23:58.046083+0000","last_clean":"2024-03-07T10:23:58.046083+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:23:58.046083+0000","last_undegraded":"2024-03-07T10:23:58.046083+0000","last_fullsized":"2024-03-07T10:23:58.046083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910831+0000","last_change":"2024-03-07T10:20:58.169801+0000","last_active":"2024-03-07T10:24:05.910831+0000","last_peered":"2024-03-07T10:24:05.910831+0000","last_clean":"2024-03-07T10:24:05.910831+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:05.910831+0000","last_undegraded":"2024-03-07T10:24:05.910831+0000","last_fullsized":"2024-03-07T10:24:05.910831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025312+0000","last_change":"2024-03-07T10:20:57.168370+0000","last_active":"2024-03-07T10:23:58.025312+0000","last_peered":"2024-03-07T10:23:58.025312+0000","last_clean":"2024-03-07T10:23:58.025312+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:23:58.025312+0000","last_undegraded":"2024-03-07T10:23:58.025312+0000","last_fullsized":"2024-03-07T10:23:58.025312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:36:26.068978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.030144+0000","last_change":"2024-03-07T10:21:09.308492+0000","last_active":"2024-03-07T10:23:58.030144+0000","last_peered":"2024-03-07T10:23:58.030144+0000","last_clean":"2024-03-07T10:23:58.030144+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:23:58.030144+0000","last_undegraded":"2024-03-07T10:23:58.030144+0000","last_fullsized":"2024-03-07T10:23:58.030144+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'6","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.044936+0000","last_change":"2024-03-07T10:21:08.291922+0000","last_active":"2024-03-07T10:23:58.044936+0000","last_peered":"2024-03-07T10:23:58.044936+0000","last_clean":"2024-03-07T10:23:58.044936+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:23:58.044936+0000","last_undegraded":"2024-03-07T10:23:58.044936+0000","last_fullsized":"2024-03-07T10:23:58.044936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:36.727220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911301+0000","last_change":"2024-03-07T10:20:58.148074+0000","last_active":"2024-03-07T10:24:05.911301+0000","last_peered":"2024-03-07T10:24:05.911301+0000","last_clean":"2024-03-07T10:24:05.911301+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:05.911301+0000","last_undegraded":"2024-03-07T10:24:05.911301+0000","last_fullsized":"2024-03-07T10:24:05.911301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016499+0000","last_change":"2024-03-07T10:20:57.149673+0000","last_active":"2024-03-07T10:23:58.016499+0000","last_peered":"2024-03-07T10:23:58.016499+0000","last_clean":"2024-03-07T10:23:58.016499+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:23:58.016499+0000","last_undegraded":"2024-03-07T10:23:58.016499+0000","last_fullsized":"2024-03-07T10:23:58.016499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023823+0000","last_change":"2024-03-07T10:21:09.316902+0000","last_active":"2024-03-07T10:23:58.023823+0000","last_peered":"2024-03-07T10:23:58.023823+0000","last_clean":"2024-03-07T10:23:58.023823+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:23:58.023823+0000","last_undegraded":"2024-03-07T10:23:58.023823+0000","last_fullsized":"2024-03-07T10:23:58.023823+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037173+0000","last_change":"2024-03-07T10:20:57.162482+0000","last_active":"2024-03-07T10:23:58.037173+0000","last_peered":"2024-03-07T10:23:58.037173+0000","last_clean":"2024-03-07T10:23:58.037173+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:23:58.037173+0000","last_undegraded":"2024-03-07T10:23:58.037173+0000","last_fullsized":"2024-03-07T10:23:58.037173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:58:24.700360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911381+0000","last_change":"2024-03-07T10:20:58.156909+0000","last_active":"2024-03-07T10:24:05.911381+0000","last_peered":"2024-03-07T10:24:05.911381+0000","last_clean":"2024-03-07T10:24:05.911381+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:05.911381+0000","last_undegraded":"2024-03-07T10:24:05.911381+0000","last_fullsized":"2024-03-07T10:24:05.911381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"23'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:01.051036+0000","last_change":"2024-03-07T10:21:08.283736+0000","last_active":"2024-03-07T10:24:01.051036+0000","last_peered":"2024-03-07T10:24:01.051036+0000","last_clean":"2024-03-07T10:24:01.051036+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:01.051036+0000","last_undegraded":"2024-03-07T10:24:01.051036+0000","last_fullsized":"2024-03-07T10:24:01.051036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025302+0000","last_change":"2024-03-07T10:21:09.300419+0000","last_active":"2024-03-07T10:23:58.025302+0000","last_peered":"2024-03-07T10:23:58.025302+0000","last_clean":"2024-03-07T10:23:58.025302+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:23:58.025302+0000","last_undegraded":"2024-03-07T10:23:58.025302+0000","last_fullsized":"2024-03-07T10:23:58.025302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:13:54.328353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017593+0000","last_change":"2024-03-07T10:20:57.152224+0000","last_active":"2024-03-07T10:23:58.017593+0000","last_peered":"2024-03-07T10:23:58.017593+0000","last_clean":"2024-03-07T10:23:58.017593+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:23:58.017593+0000","last_undegraded":"2024-03-07T10:23:58.017593+0000","last_fullsized":"2024-03-07T10:23:58.017593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.890051+0000","last_change":"2024-03-07T10:20:58.163290+0000","last_active":"2024-03-07T10:24:05.890051+0000","last_peered":"2024-03-07T10:24:05.890051+0000","last_clean":"2024-03-07T10:24:05.890051+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:05.890051+0000","last_undegraded":"2024-03-07T10:24:05.890051+0000","last_fullsized":"2024-03-07T10:24:05.890051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:02:23.486300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'4","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:07.033943+0000","last_change":"2024-03-07T10:21:08.279292+0000","last_active":"2024-03-07T10:24:07.033943+0000","last_peered":"2024-03-07T10:24:07.033943+0000","last_clean":"2024-03-07T10:24:07.033943+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:07.033943+0000","last_undegraded":"2024-03-07T10:24:07.033943+0000","last_fullsized":"2024-03-07T10:24:07.033943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:07.226810+0000","last_clean_scrub_stamp":"2024-03-07T10:21:07.226810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020541+0000","last_change":"2024-03-07T10:21:09.298817+0000","last_active":"2024-03-07T10:23:58.020541+0000","last_peered":"2024-03-07T10:23:58.020541+0000","last_clean":"2024-03-07T10:23:58.020541+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:23:58.020541+0000","last_undegraded":"2024-03-07T10:23:58.020541+0000","last_fullsized":"2024-03-07T10:23:58.020541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912772+0000","last_change":"2024-03-07T10:20:58.159968+0000","last_active":"2024-03-07T10:24:05.912772+0000","last_peered":"2024-03-07T10:24:05.912772+0000","last_clean":"2024-03-07T10:24:05.912772+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:05.912772+0000","last_undegraded":"2024-03-07T10:24:05.912772+0000","last_fullsized":"2024-03-07T10:24:05.912772+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:41:07.504076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023058+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:23:58.023058+0000","last_peered":"2024-03-07T10:23:58.023058+0000","last_clean":"2024-03-07T10:23:58.023058+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:23:58.023058+0000","last_undegraded":"2024-03-07T10:23:58.023058+0000","last_fullsized":"2024-03-07T10:23:58.023058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.889751+0000","last_change":"2024-03-07T10:20:58.144678+0000","last_active":"2024-03-07T10:24:05.889751+0000","last_peered":"2024-03-07T10:24:05.889751+0000","last_clean":"2024-03-07T10:24:05.889751+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:05.889751+0000","last_undegraded":"2024-03-07T10:24:05.889751+0000","last_fullsized":"2024-03-07T10:24:05.889751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027030+0000","last_change":"2024-03-07T10:21:09.301716+0000","last_active":"2024-03-07T10:23:58.027030+0000","last_peered":"2024-03-07T10:23:58.027030+0000","last_clean":"2024-03-07T10:23:58.027030+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:23:58.027030+0000","last_undegraded":"2024-03-07T10:23:58.027030+0000","last_fullsized":"2024-03-07T10:23:58.027030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912442+0000","last_change":"2024-03-07T10:20:58.153489+0000","last_active":"2024-03-07T10:24:05.912442+0000","last_peered":"2024-03-07T10:24:05.912442+0000","last_clean":"2024-03-07T10:24:05.912442+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:05.912442+0000","last_undegraded":"2024-03-07T10:24:05.912442+0000","last_fullsized":"2024-03-07T10:24:05.912442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:39:27.250927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023778+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:23:58.023778+0000","last_peered":"2024-03-07T10:23:58.023778+0000","last_clean":"2024-03-07T10:23:58.023778+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:23:58.023778+0000","last_undegraded":"2024-03-07T10:23:58.023778+0000","last_fullsized":"2024-03-07T10:23:58.023778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908332+0000","last_change":"2024-03-07T10:20:58.154673+0000","last_active":"2024-03-07T10:24:05.908332+0000","last_peered":"2024-03-07T10:24:05.908332+0000","last_clean":"2024-03-07T10:24:05.908332+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:05.908332+0000","last_undegraded":"2024-03-07T10:24:05.908332+0000","last_fullsized":"2024-03-07T10:24:05.908332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047336+0000","last_change":"2024-03-07T10:21:09.300980+0000","last_active":"2024-03-07T10:23:58.047336+0000","last_peered":"2024-03-07T10:23:58.047336+0000","last_clean":"2024-03-07T10:23:58.047336+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:23:58.047336+0000","last_undegraded":"2024-03-07T10:23:58.047336+0000","last_fullsized":"2024-03-07T10:23:58.047336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:01:56.579625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910470+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:24:05.910470+0000","last_peered":"2024-03-07T10:24:05.910470+0000","last_clean":"2024-03-07T10:24:05.910470+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:05.910470+0000","last_undegraded":"2024-03-07T10:24:05.910470+0000","last_fullsized":"2024-03-07T10:24:05.910470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024979+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:23:58.024979+0000","last_peered":"2024-03-07T10:23:58.024979+0000","last_clean":"2024-03-07T10:23:58.024979+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:23:58.024979+0000","last_undegraded":"2024-03-07T10:23:58.024979+0000","last_fullsized":"2024-03-07T10:23:58.024979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:27:07.787831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.908845+0000","last_change":"2024-03-07T10:20:58.164211+0000","last_active":"2024-03-07T10:24:05.908845+0000","last_peered":"2024-03-07T10:24:05.908845+0000","last_clean":"2024-03-07T10:24:05.908845+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:05.908845+0000","last_undegraded":"2024-03-07T10:24:05.908845+0000","last_fullsized":"2024-03-07T10:24:05.908845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047223+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:23:58.047223+0000","last_peered":"2024-03-07T10:23:58.047223+0000","last_clean":"2024-03-07T10:23:58.047223+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:23:58.047223+0000","last_undegraded":"2024-03-07T10:23:58.047223+0000","last_fullsized":"2024-03-07T10:23:58.047223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:21:11.044760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907491+0000","last_change":"2024-03-07T10:20:58.161056+0000","last_active":"2024-03-07T10:24:05.907491+0000","last_peered":"2024-03-07T10:24:05.907491+0000","last_clean":"2024-03-07T10:24:05.907491+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:05.907491+0000","last_undegraded":"2024-03-07T10:24:05.907491+0000","last_fullsized":"2024-03-07T10:24:05.907491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036645+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:23:58.036645+0000","last_peered":"2024-03-07T10:23:58.036645+0000","last_clean":"2024-03-07T10:23:58.036645+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:23:58.036645+0000","last_undegraded":"2024-03-07T10:23:58.036645+0000","last_fullsized":"2024-03-07T10:23:58.036645+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:48:37.791511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904355+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:24:05.904355+0000","last_peered":"2024-03-07T10:24:05.904355+0000","last_clean":"2024-03-07T10:24:05.904355+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:05.904355+0000","last_undegraded":"2024-03-07T10:24:05.904355+0000","last_fullsized":"2024-03-07T10:24:05.904355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020384+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:23:58.020384+0000","last_peered":"2024-03-07T10:23:58.020384+0000","last_clean":"2024-03-07T10:23:58.020384+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:23:58.020384+0000","last_undegraded":"2024-03-07T10:23:58.020384+0000","last_fullsized":"2024-03-07T10:23:58.020384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.889451+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:24:05.889451+0000","last_peered":"2024-03-07T10:24:05.889451+0000","last_clean":"2024-03-07T10:24:05.889451+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:05.889451+0000","last_undegraded":"2024-03-07T10:24:05.889451+0000","last_fullsized":"2024-03-07T10:24:05.889451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:13:17.582216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048487+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:23:58.048487+0000","last_peered":"2024-03-07T10:23:58.048487+0000","last_clean":"2024-03-07T10:23:58.048487+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:23:58.048487+0000","last_undegraded":"2024-03-07T10:23:58.048487+0000","last_fullsized":"2024-03-07T10:23:58.048487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:01:16.539103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910589+0000","last_change":"2024-03-07T10:20:58.158556+0000","last_active":"2024-03-07T10:24:05.910589+0000","last_peered":"2024-03-07T10:24:05.910589+0000","last_clean":"2024-03-07T10:24:05.910589+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:05.910589+0000","last_undegraded":"2024-03-07T10:24:05.910589+0000","last_fullsized":"2024-03-07T10:24:05.910589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.021192+0000","last_change":"2024-03-07T10:21:09.303802+0000","last_active":"2024-03-07T10:23:58.021192+0000","last_peered":"2024-03-07T10:23:58.021192+0000","last_clean":"2024-03-07T10:23:58.021192+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:23:58.021192+0000","last_undegraded":"2024-03-07T10:23:58.021192+0000","last_fullsized":"2024-03-07T10:23:58.021192+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.900868+0000","last_change":"2024-03-07T10:21:39.613361+0000","last_active":"2024-03-07T10:24:05.900868+0000","last_peered":"2024-03-07T10:24:05.900868+0000","last_clean":"2024-03-07T10:24:05.900868+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:05.900868+0000","last_undegraded":"2024-03-07T10:24:05.900868+0000","last_fullsized":"2024-03-07T10:24:05.900868+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018200+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:23:58.018200+0000","last_peered":"2024-03-07T10:23:58.018200+0000","last_clean":"2024-03-07T10:23:58.018200+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:23:58.018200+0000","last_undegraded":"2024-03-07T10:23:58.018200+0000","last_fullsized":"2024-03-07T10:23:58.018200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:14.713565+0000","last_change":"2024-03-07T10:24:14.713624+0000","last_active":"2024-03-07T10:24:14.713565+0000","last_peered":"2024-03-07T10:24:14.713565+0000","last_clean":"2024-03-07T10:24:14.713565+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:14.713565+0000","last_undegraded":"2024-03-07T10:24:14.713565+0000","last_fullsized":"2024-03-07T10:24:14.713565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_clean_scrub_stamp":"2024-03-07T10:24:14.713377+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:59:06.356523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024597+0000","last_change":"2024-03-07T10:21:09.300292+0000","last_active":"2024-03-07T10:23:58.024597+0000","last_peered":"2024-03-07T10:23:58.024597+0000","last_clean":"2024-03-07T10:23:58.024597+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:23:58.024597+0000","last_undegraded":"2024-03-07T10:23:58.024597+0000","last_fullsized":"2024-03-07T10:23:58.024597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:11.841025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907976+0000","last_change":"2024-03-07T10:20:58.158686+0000","last_active":"2024-03-07T10:24:05.907976+0000","last_peered":"2024-03-07T10:24:05.907976+0000","last_clean":"2024-03-07T10:24:05.907976+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:05.907976+0000","last_undegraded":"2024-03-07T10:24:05.907976+0000","last_fullsized":"2024-03-07T10:24:05.907976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024868+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:23:58.024868+0000","last_peered":"2024-03-07T10:23:58.024868+0000","last_clean":"2024-03-07T10:23:58.024868+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:23:58.024868+0000","last_undegraded":"2024-03-07T10:23:58.024868+0000","last_fullsized":"2024-03-07T10:23:58.024868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:42:40.347405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.893801+0000","last_change":"2024-03-07T10:20:58.155553+0000","last_active":"2024-03-07T10:24:05.893801+0000","last_peered":"2024-03-07T10:24:05.893801+0000","last_clean":"2024-03-07T10:24:05.893801+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:05.893801+0000","last_undegraded":"2024-03-07T10:24:05.893801+0000","last_fullsized":"2024-03-07T10:24:05.893801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:35:28.186113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025108+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:23:58.025108+0000","last_peered":"2024-03-07T10:23:58.025108+0000","last_clean":"2024-03-07T10:23:58.025108+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:23:58.025108+0000","last_undegraded":"2024-03-07T10:23:58.025108+0000","last_fullsized":"2024-03-07T10:23:58.025108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:15:47.392001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.897005+0000","last_change":"2024-03-07T10:20:58.162065+0000","last_active":"2024-03-07T10:24:05.897005+0000","last_peered":"2024-03-07T10:24:05.897005+0000","last_clean":"2024-03-07T10:24:05.897005+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:05.897005+0000","last_undegraded":"2024-03-07T10:24:05.897005+0000","last_fullsized":"2024-03-07T10:24:05.897005+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.029271+0000","last_change":"2024-03-07T10:21:09.303142+0000","last_active":"2024-03-07T10:23:58.029271+0000","last_peered":"2024-03-07T10:23:58.029271+0000","last_clean":"2024-03-07T10:23:58.029271+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:23:58.029271+0000","last_undegraded":"2024-03-07T10:23:58.029271+0000","last_fullsized":"2024-03-07T10:23:58.029271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.899102+0000","last_change":"2024-03-07T10:21:39.614215+0000","last_active":"2024-03-07T10:24:05.899102+0000","last_peered":"2024-03-07T10:24:05.899102+0000","last_clean":"2024-03-07T10:24:05.899102+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:05.899102+0000","last_undegraded":"2024-03-07T10:24:05.899102+0000","last_fullsized":"2024-03-07T10:24:05.899102+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023053+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:23:58.023053+0000","last_peered":"2024-03-07T10:23:58.023053+0000","last_clean":"2024-03-07T10:23:58.023053+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:23:58.023053+0000","last_undegraded":"2024-03-07T10:23:58.023053+0000","last_fullsized":"2024-03-07T10:23:58.023053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911103+0000","last_change":"2024-03-07T10:20:58.147197+0000","last_active":"2024-03-07T10:24:05.911103+0000","last_peered":"2024-03-07T10:24:05.911103+0000","last_clean":"2024-03-07T10:24:05.911103+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:05.911103+0000","last_undegraded":"2024-03-07T10:24:05.911103+0000","last_fullsized":"2024-03-07T10:24:05.911103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:49:26.321369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025459+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:23:58.025459+0000","last_peered":"2024-03-07T10:23:58.025459+0000","last_clean":"2024-03-07T10:23:58.025459+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:23:58.025459+0000","last_undegraded":"2024-03-07T10:23:58.025459+0000","last_fullsized":"2024-03-07T10:23:58.025459+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:25:28.905106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.888085+0000","last_change":"2024-03-07T10:20:58.161305+0000","last_active":"2024-03-07T10:24:05.888085+0000","last_peered":"2024-03-07T10:24:05.888085+0000","last_clean":"2024-03-07T10:24:05.888085+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:05.888085+0000","last_undegraded":"2024-03-07T10:24:05.888085+0000","last_fullsized":"2024-03-07T10:24:05.888085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026942+0000","last_change":"2024-03-07T10:21:09.298043+0000","last_active":"2024-03-07T10:23:58.026942+0000","last_peered":"2024-03-07T10:23:58.026942+0000","last_clean":"2024-03-07T10:23:58.026942+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:23:58.026942+0000","last_undegraded":"2024-03-07T10:23:58.026942+0000","last_fullsized":"2024-03-07T10:23:58.026942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:13.761596+0000","last_change":"2024-03-07T10:24:13.761626+0000","last_active":"2024-03-07T10:24:13.761596+0000","last_peered":"2024-03-07T10:24:13.761596+0000","last_clean":"2024-03-07T10:24:13.761596+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:13.761596+0000","last_undegraded":"2024-03-07T10:24:13.761596+0000","last_fullsized":"2024-03-07T10:24:13.761596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_clean_scrub_stamp":"2024-03-07T10:24:13.761490+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:02.086659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048174+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:23:58.048174+0000","last_peered":"2024-03-07T10:23:58.048174+0000","last_clean":"2024-03-07T10:23:58.048174+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:23:58.048174+0000","last_undegraded":"2024-03-07T10:23:58.048174+0000","last_fullsized":"2024-03-07T10:23:58.048174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:50:06.551735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.905741+0000","last_change":"2024-03-07T10:20:58.157408+0000","last_active":"2024-03-07T10:24:05.905741+0000","last_peered":"2024-03-07T10:24:05.905741+0000","last_clean":"2024-03-07T10:24:05.905741+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:05.905741+0000","last_undegraded":"2024-03-07T10:24:05.905741+0000","last_fullsized":"2024-03-07T10:24:05.905741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016669+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:23:58.016669+0000","last_peered":"2024-03-07T10:23:58.016669+0000","last_clean":"2024-03-07T10:23:58.016669+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:23:58.016669+0000","last_undegraded":"2024-03-07T10:23:58.016669+0000","last_fullsized":"2024-03-07T10:23:58.016669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906195+0000","last_change":"2024-03-07T10:20:58.163744+0000","last_active":"2024-03-07T10:24:05.906195+0000","last_peered":"2024-03-07T10:24:05.906195+0000","last_clean":"2024-03-07T10:24:05.906195+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:05.906195+0000","last_undegraded":"2024-03-07T10:24:05.906195+0000","last_fullsized":"2024-03-07T10:24:05.906195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:54:08.077309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020264+0000","last_change":"2024-03-07T10:21:09.317824+0000","last_active":"2024-03-07T10:23:58.020264+0000","last_peered":"2024-03-07T10:23:58.020264+0000","last_clean":"2024-03-07T10:23:58.020264+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:23:58.020264+0000","last_undegraded":"2024-03-07T10:23:58.020264+0000","last_fullsized":"2024-03-07T10:23:58.020264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.914163+0000","last_change":"2024-03-07T10:20:58.169939+0000","last_active":"2024-03-07T10:24:05.914163+0000","last_peered":"2024-03-07T10:24:05.914163+0000","last_clean":"2024-03-07T10:24:05.914163+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:05.914163+0000","last_undegraded":"2024-03-07T10:24:05.914163+0000","last_fullsized":"2024-03-07T10:24:05.914163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:04:43.061736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047776+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:23:58.047776+0000","last_peered":"2024-03-07T10:23:58.047776+0000","last_clean":"2024-03-07T10:23:58.047776+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:23:58.047776+0000","last_undegraded":"2024-03-07T10:23:58.047776+0000","last_fullsized":"2024-03-07T10:23:58.047776+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:50:37.051325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.915299+0000","last_change":"2024-03-07T10:20:58.159278+0000","last_active":"2024-03-07T10:24:05.915299+0000","last_peered":"2024-03-07T10:24:05.915299+0000","last_clean":"2024-03-07T10:24:05.915299+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:05.915299+0000","last_undegraded":"2024-03-07T10:24:05.915299+0000","last_fullsized":"2024-03-07T10:24:05.915299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T11:29:45.446777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025799+0000","last_change":"2024-03-07T10:21:09.298748+0000","last_active":"2024-03-07T10:23:58.025799+0000","last_peered":"2024-03-07T10:23:58.025799+0000","last_clean":"2024-03-07T10:23:58.025799+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:23:58.025799+0000","last_undegraded":"2024-03-07T10:23:58.025799+0000","last_fullsized":"2024-03-07T10:23:58.025799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:09:14.856195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910637+0000","last_change":"2024-03-07T10:20:58.174081+0000","last_active":"2024-03-07T10:24:05.910637+0000","last_peered":"2024-03-07T10:24:05.910637+0000","last_clean":"2024-03-07T10:24:05.910637+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:05.910637+0000","last_undegraded":"2024-03-07T10:24:05.910637+0000","last_fullsized":"2024-03-07T10:24:05.910637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:54:25.700036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020221+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:23:58.020221+0000","last_peered":"2024-03-07T10:23:58.020221+0000","last_clean":"2024-03-07T10:23:58.020221+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:23:58.020221+0000","last_undegraded":"2024-03-07T10:23:58.020221+0000","last_fullsized":"2024-03-07T10:23:58.020221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911787+0000","last_change":"2024-03-07T10:20:58.165151+0000","last_active":"2024-03-07T10:24:05.911787+0000","last_peered":"2024-03-07T10:24:05.911787+0000","last_clean":"2024-03-07T10:24:05.911787+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:05.911787+0000","last_undegraded":"2024-03-07T10:24:05.911787+0000","last_fullsized":"2024-03-07T10:24:05.911787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.037509+0000","last_change":"2024-03-07T10:21:09.297213+0000","last_active":"2024-03-07T10:23:58.037509+0000","last_peered":"2024-03-07T10:23:58.037509+0000","last_clean":"2024-03-07T10:23:58.037509+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:23:58.037509+0000","last_undegraded":"2024-03-07T10:23:58.037509+0000","last_fullsized":"2024-03-07T10:23:58.037509+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:21:48.758193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912205+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:24:05.912205+0000","last_peered":"2024-03-07T10:24:05.912205+0000","last_clean":"2024-03-07T10:24:05.912205+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:05.912205+0000","last_undegraded":"2024-03-07T10:24:05.912205+0000","last_fullsized":"2024-03-07T10:24:05.912205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:58:30.683356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018502+0000","last_change":"2024-03-07T10:21:09.314438+0000","last_active":"2024-03-07T10:23:58.018502+0000","last_peered":"2024-03-07T10:23:58.018502+0000","last_clean":"2024-03-07T10:23:58.018502+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:23:58.018502+0000","last_undegraded":"2024-03-07T10:23:58.018502+0000","last_fullsized":"2024-03-07T10:23:58.018502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.911281+0000","last_change":"2024-03-07T10:20:58.146726+0000","last_active":"2024-03-07T10:24:05.911281+0000","last_peered":"2024-03-07T10:24:05.911281+0000","last_clean":"2024-03-07T10:24:05.911281+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:05.911281+0000","last_undegraded":"2024-03-07T10:24:05.911281+0000","last_fullsized":"2024-03-07T10:24:05.911281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:32:53.299193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027137+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:23:58.027137+0000","last_peered":"2024-03-07T10:23:58.027137+0000","last_clean":"2024-03-07T10:23:58.027137+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:23:58.027137+0000","last_undegraded":"2024-03-07T10:23:58.027137+0000","last_fullsized":"2024-03-07T10:23:58.027137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:39:41.185059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.887465+0000","last_change":"2024-03-07T10:20:58.158138+0000","last_active":"2024-03-07T10:24:05.887465+0000","last_peered":"2024-03-07T10:24:05.887465+0000","last_clean":"2024-03-07T10:24:05.887465+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:05.887465+0000","last_undegraded":"2024-03-07T10:24:05.887465+0000","last_fullsized":"2024-03-07T10:24:05.887465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:20:26.611038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015302+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:23:58.015302+0000","last_peered":"2024-03-07T10:23:58.015302+0000","last_clean":"2024-03-07T10:23:58.015302+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:23:58.015302+0000","last_undegraded":"2024-03-07T10:23:58.015302+0000","last_fullsized":"2024-03-07T10:23:58.015302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.913448+0000","last_change":"2024-03-07T10:20:58.152468+0000","last_active":"2024-03-07T10:24:05.913448+0000","last_peered":"2024-03-07T10:24:05.913448+0000","last_clean":"2024-03-07T10:24:05.913448+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:05.913448+0000","last_undegraded":"2024-03-07T10:24:05.913448+0000","last_fullsized":"2024-03-07T10:24:05.913448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:40:39.989463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020075+0000","last_change":"2024-03-07T10:21:09.309287+0000","last_active":"2024-03-07T10:23:58.020075+0000","last_peered":"2024-03-07T10:23:58.020075+0000","last_clean":"2024-03-07T10:23:58.020075+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:23:58.020075+0000","last_undegraded":"2024-03-07T10:23:58.020075+0000","last_fullsized":"2024-03-07T10:23:58.020075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.909544+0000","last_change":"2024-03-07T10:20:58.152546+0000","last_active":"2024-03-07T10:24:05.909544+0000","last_peered":"2024-03-07T10:24:05.909544+0000","last_clean":"2024-03-07T10:24:05.909544+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:05.909544+0000","last_undegraded":"2024-03-07T10:24:05.909544+0000","last_fullsized":"2024-03-07T10:24:05.909544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047140+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:23:58.047140+0000","last_peered":"2024-03-07T10:23:58.047140+0000","last_clean":"2024-03-07T10:23:58.047140+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:23:58.047140+0000","last_undegraded":"2024-03-07T10:23:58.047140+0000","last_fullsized":"2024-03-07T10:23:58.047140+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:53:20.599781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907914+0000","last_change":"2024-03-07T10:20:58.160168+0000","last_active":"2024-03-07T10:24:05.907914+0000","last_peered":"2024-03-07T10:24:05.907914+0000","last_clean":"2024-03-07T10:24:05.907914+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:05.907914+0000","last_undegraded":"2024-03-07T10:24:05.907914+0000","last_fullsized":"2024-03-07T10:24:05.907914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047261+0000","last_change":"2024-03-07T10:21:09.300879+0000","last_active":"2024-03-07T10:23:58.047261+0000","last_peered":"2024-03-07T10:23:58.047261+0000","last_clean":"2024-03-07T10:23:58.047261+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:23:58.047261+0000","last_undegraded":"2024-03-07T10:23:58.047261+0000","last_fullsized":"2024-03-07T10:23:58.047261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:47:46.469179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.907990+0000","last_change":"2024-03-07T10:20:58.159071+0000","last_active":"2024-03-07T10:24:05.907990+0000","last_peered":"2024-03-07T10:24:05.907990+0000","last_clean":"2024-03-07T10:24:05.907990+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:05.907990+0000","last_undegraded":"2024-03-07T10:24:05.907990+0000","last_fullsized":"2024-03-07T10:24:05.907990+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:37.151170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":44910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":158,"num_read_kb":200,"num_write":101,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":89820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":87,"ondisk_log_size":87,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":134994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":216505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.615 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.616 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.617 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.618 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.619 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.620 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.621 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-07T10:20:46.734762+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=46, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.622 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.623 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.624 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.625 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.626 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.627 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.628 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-07T10:21:07.226810+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=7, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.629 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.630 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.631 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.632 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.633 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.634 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 5.3b last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:19.635 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-07T10:24:39.636 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:24:39.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.848+0000 7f36aac00640 1 Processor -- start 2024-03-07T10:24:39.850 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.848+0000 7f36aac00640 1 -- start start 2024-03-07T10:24:39.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36aac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a4150a90 0x7f36a40c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36aac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f36a40c2690 0x7f36a40c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.852 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36aac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a40c33b0 con 0x7f36a40c4130 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36aac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a4072b50 con 0x7f36a40c2690 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36aac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4150e70 con 0x7f36a4150a90 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36a8e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f36a40c4130 0x7f36a40c16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:41586/0 (socket says 172.21.15.194:41586) 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.850+0000 7f36a8e00640 1 -- 172.21.15.194:0/2918643558 learned_addr learned my addr 172.21.15.194:0/2918643558 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36aa200640 1 --2- 172.21.15.194:0/2918643558 >> v2:172.21.15.194:3300/0 conn(0x7f36a40c2690 0x7f36a40c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36a9800640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a4150a90 0x7f36a40c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36aa200640 1 -- 172.21.15.194:0/2918643558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a4150a90 msgr2=0x7f36a40c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36aa200640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a4150a90 0x7f36a40c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36a3e00640 1 -- 172.21.15.194:0/2918643558 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475614589 0 0) 0x7f36a40c33b0 con 0x7f36a40c4130 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36aa200640 1 -- 172.21.15.194:0/2918643558 >> v1:172.21.15.194:6789/0 conn(0x7f36a40c4130 legacy=0x7f36a40c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:39.853 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.851+0000 7f36aa200640 1 -- 172.21.15.194:0/2918643558 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4072d80 con 0x7f36a40c2690 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.852+0000 7f36aa200640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a40c2690 0x7f36a40c1de0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f369c009d90 tx=0x7f369c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69878d175e6383c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.852+0000 7f36a3e00640 1 -- 172.21.15.194:0/2918643558 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c039070 con 0x7f36a40c2690 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.852+0000 7f36a3e00640 1 -- 172.21.15.194:0/2918643558 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c02cc50 con 0x7f36a40c2690 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.852+0000 7f36a3e00640 1 -- 172.21.15.194:0/2918643558 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c034440 con 0x7f36a40c2690 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 -- 172.21.15.194:0/2918643558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a40c2690 msgr2=0x7f36a40c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a40c2690 0x7f36a40c1de0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f369c009d90 tx=0x7f369c02bea0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 -- 172.21.15.194:0/2918643558 shutdown_connections 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a40c2690 0x7f36a40c1de0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.855 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 --2- 172.21.15.194:0/2918643558 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a4150a90 0x7f36a40c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 -- 172.21.15.194:0/2918643558 >> 172.21.15.194:0/2918643558 conn(0x7f36a40c70f0 msgr2=0x7f36a40c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:39.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 -- 172.21.15.194:0/2918643558 shutdown_connections 2024-03-07T10:24:39.856 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.853+0000 7f36aac00640 1 -- 172.21.15.194:0/2918643558 wait complete. 2024-03-07T10:24:39.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.855+0000 7f36aac00640 1 Processor -- start 2024-03-07T10:24:39.857 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.855+0000 7f36aac00640 1 -- start start 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a40c2690 0x7f36a41eadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36a40c4130 0x7f36a414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4073340 con 0x7f36a4150a90 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4071cf0 con 0x7f36a40c4130 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aac00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40c2320 con 0x7f36a40c2690 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aa200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aa200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:35822/0 (socket says 172.21.15.194:35822) 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.856+0000 7f36aa200640 1 -- 172.21.15.194:0/3558624425 learned_addr learned my addr 172.21.15.194:0/3558624425 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36a9800640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a40c2690 0x7f36a41eadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.859 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 -- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a40c2690 msgr2=0x7f36a41eadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36a8e00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36a40c4130 0x7f36a414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a40c2690 0x7f36a41eadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 -- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36a40c4130 msgr2=0x7f36a414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36a40c4130 0x7f36a414ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 -- 172.21.15.194:0/3558624425 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a414e0f0 con 0x7f36a4150a90 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aa200640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f369c009d90 tx=0x7f369c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c039050 con 0x7f36a4150a90 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c045070 con 0x7f36a4150a90 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c03e610 con 0x7f36a4150a90 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a414e3b0 con 0x7f36a4150a90 2024-03-07T10:24:39.860 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.857+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a414e970 con 0x7f36a4150a90 2024-03-07T10:24:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.859+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a40a98f0 con 0x7f36a4150a90 2024-03-07T10:24:39.861 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.860+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f369c03e7b0 con 0x7f36a4150a90 2024-03-07T10:24:39.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.861+0000 7f36a1600640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 0x7f368406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:24:39.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.861+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f369c0ad200 con 0x7f36a4150a90 2024-03-07T10:24:39.862 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.861+0000 7f36a9800640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 0x7f368406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:24:39.863 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.862+0000 7f36a9800640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 0x7f368406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698006fd0 tx=0x7f3698008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:24:39.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:39.865+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f36a40a98f0 con 0x7f36a4150a90 2024-03-07T10:24:40.113 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.111+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f36a4068170 con 0x7f368406b4d0 2024-03-07T10:24:40.174 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.172+0000 7f36a1600640 1 -- 172.21.15.194:0/3558624425 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+489422 (secure 0 0 0) 0x7f36a4068170 con 0x7f368406b4d0 2024-03-07T10:24:40.181 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:24:40.184 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.180+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 msgr2=0x7f368406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.180+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 0x7f368406d990 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3698006fd0 tx=0x7f3698008040 comp rx=0 tx=0).stop 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.180+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 msgr2=0x7f36a40c06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.180+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f369c009d90 tx=0x7f369c004a40 comp rx=0 tx=0).stop 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 shutdown_connections 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f368406b4d0 0x7f368406d990 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36a4150a90 0x7f36a40c06c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:40.186 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f36a40c4130 0x7f36a414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:40.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 --2- 172.21.15.194:0/3558624425 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f36a40c2690 0x7f36a41eadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:24:40.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 >> 172.21.15.194:0/3558624425 conn(0x7f36a40c70f0 msgr2=0x7f36a414a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:24:40.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 shutdown_connections 2024-03-07T10:24:40.187 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:24:40.181+0000 7f36aac00640 1 -- 172.21.15.194:0/3558624425 wait complete. 2024-03-07T10:24:40.201 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-03-07T10:24:38.502561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":674491,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":354,"num_read_kb":388,"num_write":353,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220048,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754672,"statfs":{"total":773094113280,"available":772868784128,"internally_reserved":0,"allocated":4014080,"data_stored":2423862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006000"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.613797+0000","last_change":"2024-03-07T10:24:35.613855+0000","last_active":"2024-03-07T10:24:35.613797+0000","last_peered":"2024-03-07T10:24:35.613797+0000","last_clean":"2024-03-07T10:24:35.613797+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:24:35.613797+0000","last_undegraded":"2024-03-07T10:24:35.613797+0000","last_fullsized":"2024-03-07T10:24:35.613797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.613547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.613547+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.613547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:22.241083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.903340+0000","last_change":"2024-03-07T10:24:19.903430+0000","last_active":"2024-03-07T10:24:19.903340+0000","last_peered":"2024-03-07T10:24:19.903340+0000","last_clean":"2024-03-07T10:24:19.903340+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:24:19.903340+0000","last_undegraded":"2024-03-07T10:24:19.903340+0000","last_fullsized":"2024-03-07T10:24:19.903340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:19.903087+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:19.903087+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.903087+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:12.221811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.617279+0000","last_change":"2024-03-07T10:24:20.617342+0000","last_active":"2024-03-07T10:24:20.617279+0000","last_peered":"2024-03-07T10:24:20.617279+0000","last_clean":"2024-03-07T10:24:20.617279+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:20.617279+0000","last_undegraded":"2024-03-07T10:24:20.617279+0000","last_fullsized":"2024-03-07T10:24:20.617279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:20.617095+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:20.617095+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.617095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:30.931553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.635573+0000","last_change":"2024-03-07T10:24:18.635607+0000","last_active":"2024-03-07T10:24:18.635573+0000","last_peered":"2024-03-07T10:24:18.635573+0000","last_clean":"2024-03-07T10:24:18.635573+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:24:18.635573+0000","last_undegraded":"2024-03-07T10:24:18.635573+0000","last_fullsized":"2024-03-07T10:24:18.635573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:18.635440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:18.635440+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.635440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:07:28.554825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.312005+0000","last_change":"2024-03-07T10:24:33.312062+0000","last_active":"2024-03-07T10:24:33.312005+0000","last_peered":"2024-03-07T10:24:33.312005+0000","last_clean":"2024-03-07T10:24:33.312005+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:24:33.312005+0000","last_undegraded":"2024-03-07T10:24:33.312005+0000","last_fullsized":"2024-03-07T10:24:33.312005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.311760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.311760+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.311760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:55:32.570083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.605383+0000","last_change":"2024-03-07T10:24:32.605444+0000","last_active":"2024-03-07T10:24:32.605383+0000","last_peered":"2024-03-07T10:24:32.605383+0000","last_clean":"2024-03-07T10:24:32.605383+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:24:32.605383+0000","last_undegraded":"2024-03-07T10:24:32.605383+0000","last_fullsized":"2024-03-07T10:24:32.605383+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:32.605182+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:32.605182+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.605182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:32.745693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.836967+0000","last_change":"2024-03-07T10:24:17.837129+0000","last_active":"2024-03-07T10:24:17.836967+0000","last_peered":"2024-03-07T10:24:17.836967+0000","last_clean":"2024-03-07T10:24:17.836967+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:17.836967+0000","last_undegraded":"2024-03-07T10:24:17.836967+0000","last_fullsized":"2024-03-07T10:24:17.836967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:17.836720+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:17.836720+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.836720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:47.650479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.649199+0000","last_change":"2024-03-07T10:24:23.649251+0000","last_active":"2024-03-07T10:24:23.649199+0000","last_peered":"2024-03-07T10:24:23.649199+0000","last_clean":"2024-03-07T10:24:23.649199+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:24:23.649199+0000","last_undegraded":"2024-03-07T10:24:23.649199+0000","last_fullsized":"2024-03-07T10:24:23.649199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:23.648976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:23.648976+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.648976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:28.960981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047609+0000","last_change":"2024-03-07T10:21:09.311958+0000","last_active":"2024-03-07T10:23:58.047609+0000","last_peered":"2024-03-07T10:23:58.047609+0000","last_clean":"2024-03-07T10:23:58.047609+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:23:58.047609+0000","last_undegraded":"2024-03-07T10:23:58.047609+0000","last_fullsized":"2024-03-07T10:23:58.047609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.435021+0000","last_change":"2024-03-07T10:24:36.435181+0000","last_active":"2024-03-07T10:24:36.435021+0000","last_peered":"2024-03-07T10:24:36.435021+0000","last_clean":"2024-03-07T10:24:36.435021+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:24:36.435021+0000","last_undegraded":"2024-03-07T10:24:36.435021+0000","last_fullsized":"2024-03-07T10:24:36.435021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:36.434787+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:36.434787+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.434787+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:03.719600+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.055344+0000","last_change":"2024-03-07T10:24:21.055409+0000","last_active":"2024-03-07T10:24:21.055344+0000","last_peered":"2024-03-07T10:24:21.055344+0000","last_clean":"2024-03-07T10:24:21.055344+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:21.055344+0000","last_undegraded":"2024-03-07T10:24:21.055344+0000","last_fullsized":"2024-03-07T10:24:21.055344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:21.055203+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:21.055203+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.055203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:07:30.974589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.649014+0000","last_change":"2024-03-07T10:24:31.649103+0000","last_active":"2024-03-07T10:24:31.649014+0000","last_peered":"2024-03-07T10:24:31.649014+0000","last_clean":"2024-03-07T10:24:31.649014+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:24:31.649014+0000","last_undegraded":"2024-03-07T10:24:31.649014+0000","last_fullsized":"2024-03-07T10:24:31.649014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:31.648840+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:31.648840+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.648840+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:17.973743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.026947+0000","last_change":"2024-03-07T10:21:09.306112+0000","last_active":"2024-03-07T10:23:58.026947+0000","last_peered":"2024-03-07T10:23:58.026947+0000","last_clean":"2024-03-07T10:23:58.026947+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:23:58.026947+0000","last_undegraded":"2024-03-07T10:23:58.026947+0000","last_fullsized":"2024-03-07T10:23:58.026947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048097+0000","last_change":"2024-03-07T10:20:57.173024+0000","last_active":"2024-03-07T10:23:58.048097+0000","last_peered":"2024-03-07T10:23:58.048097+0000","last_clean":"2024-03-07T10:23:58.048097+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:23:58.048097+0000","last_undegraded":"2024-03-07T10:23:58.048097+0000","last_fullsized":"2024-03-07T10:23:58.048097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.072790+0000","last_change":"2024-03-07T10:24:23.072868+0000","last_active":"2024-03-07T10:24:23.072790+0000","last_peered":"2024-03-07T10:24:23.072790+0000","last_clean":"2024-03-07T10:24:23.072790+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:23.072790+0000","last_undegraded":"2024-03-07T10:24:23.072790+0000","last_fullsized":"2024-03-07T10:24:23.072790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:23.072576+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:23.072576+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.072576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:33.387035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.682618+0000","last_change":"2024-03-07T10:24:30.682680+0000","last_active":"2024-03-07T10:24:30.682618+0000","last_peered":"2024-03-07T10:24:30.682618+0000","last_clean":"2024-03-07T10:24:30.682618+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:24:30.682618+0000","last_undegraded":"2024-03-07T10:24:30.682618+0000","last_fullsized":"2024-03-07T10:24:30.682618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:30.682446+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:30.682446+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.682446+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:09.585995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.307081+0000","last_change":"2024-03-07T10:24:35.307154+0000","last_active":"2024-03-07T10:24:35.307081+0000","last_peered":"2024-03-07T10:24:35.307081+0000","last_clean":"2024-03-07T10:24:35.307081+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:24:35.307081+0000","last_undegraded":"2024-03-07T10:24:35.307081+0000","last_fullsized":"2024-03-07T10:24:35.307081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.306891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.306891+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.306891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:28:04.073013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.100760+0000","last_change":"2024-03-07T10:24:19.100859+0000","last_active":"2024-03-07T10:24:19.100760+0000","last_peered":"2024-03-07T10:24:19.100760+0000","last_clean":"2024-03-07T10:24:19.100760+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:19.100760+0000","last_undegraded":"2024-03-07T10:24:19.100760+0000","last_fullsized":"2024-03-07T10:24:19.100760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.100537+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.100537+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.100537+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:43:37.181522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.444615+0000","last_change":"2024-03-07T10:24:34.444684+0000","last_active":"2024-03-07T10:24:34.444615+0000","last_peered":"2024-03-07T10:24:34.444615+0000","last_clean":"2024-03-07T10:24:34.444615+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:24:34.444615+0000","last_undegraded":"2024-03-07T10:24:34.444615+0000","last_fullsized":"2024-03-07T10:24:34.444615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:34.444435+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:34.444435+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.444435+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:51.425330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.572921+0000","last_change":"2024-03-07T10:24:17.572985+0000","last_active":"2024-03-07T10:24:17.572921+0000","last_peered":"2024-03-07T10:24:17.572921+0000","last_clean":"2024-03-07T10:24:17.572921+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:24:17.572921+0000","last_undegraded":"2024-03-07T10:24:17.572921+0000","last_fullsized":"2024-03-07T10:24:17.572921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:17.572756+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:17.572756+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.572756+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:16:46.378457+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.176195+0000","last_change":"2024-03-07T10:24:28.176249+0000","last_active":"2024-03-07T10:24:28.176195+0000","last_peered":"2024-03-07T10:24:28.176195+0000","last_clean":"2024-03-07T10:24:28.176195+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:24:28.176195+0000","last_undegraded":"2024-03-07T10:24:28.176195+0000","last_fullsized":"2024-03-07T10:24:28.176195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.176001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.176001+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.176001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:36.797759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.598807+0000","last_change":"2024-03-07T10:24:35.598889+0000","last_active":"2024-03-07T10:24:35.598807+0000","last_peered":"2024-03-07T10:24:35.598807+0000","last_clean":"2024-03-07T10:24:35.598807+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:35.598807+0000","last_undegraded":"2024-03-07T10:24:35.598807+0000","last_fullsized":"2024-03-07T10:24:35.598807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:35.598609+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:35.598609+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.598609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:14:26.359253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.243943+0000","last_change":"2024-03-07T10:24:25.243995+0000","last_active":"2024-03-07T10:24:25.243943+0000","last_peered":"2024-03-07T10:24:25.243943+0000","last_clean":"2024-03-07T10:24:25.243943+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:24:25.243943+0000","last_undegraded":"2024-03-07T10:24:25.243943+0000","last_fullsized":"2024-03-07T10:24:25.243943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.243691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.243691+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.243691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:50.116146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.577457+0000","last_change":"2024-03-07T10:24:20.577513+0000","last_active":"2024-03-07T10:24:20.577457+0000","last_peered":"2024-03-07T10:24:20.577457+0000","last_clean":"2024-03-07T10:24:20.577457+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:24:20.577457+0000","last_undegraded":"2024-03-07T10:24:20.577457+0000","last_fullsized":"2024-03-07T10:24:20.577457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:20.577284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:20.577284+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.577284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:29.295770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025414+0000","last_change":"2024-03-07T10:21:09.306688+0000","last_active":"2024-03-07T10:23:58.025414+0000","last_peered":"2024-03-07T10:23:58.025414+0000","last_clean":"2024-03-07T10:23:58.025414+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:23:58.025414+0000","last_undegraded":"2024-03-07T10:23:58.025414+0000","last_fullsized":"2024-03-07T10:23:58.025414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.650702+0000","last_change":"2024-03-07T10:24:26.650768+0000","last_active":"2024-03-07T10:24:26.650702+0000","last_peered":"2024-03-07T10:24:26.650702+0000","last_clean":"2024-03-07T10:24:26.650702+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:26.650702+0000","last_undegraded":"2024-03-07T10:24:26.650702+0000","last_fullsized":"2024-03-07T10:24:26.650702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:26.650539+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:26.650539+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.650539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:17.141949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.264506+0000","last_change":"2024-03-07T10:24:26.264635+0000","last_active":"2024-03-07T10:24:26.264506+0000","last_peered":"2024-03-07T10:24:26.264506+0000","last_clean":"2024-03-07T10:24:26.264506+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:24:26.264506+0000","last_undegraded":"2024-03-07T10:24:26.264506+0000","last_fullsized":"2024-03-07T10:24:26.264506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.264284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.264284+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.264284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:26:42.775427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.144215+0000","last_change":"2024-03-07T10:24:17.144266+0000","last_active":"2024-03-07T10:24:17.144215+0000","last_peered":"2024-03-07T10:24:17.144215+0000","last_clean":"2024-03-07T10:24:17.144215+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:24:17.144215+0000","last_undegraded":"2024-03-07T10:24:17.144215+0000","last_fullsized":"2024-03-07T10:24:17.144215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:17.144061+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:17.144061+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.144061+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:15.766733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027788+0000","last_change":"2024-03-07T10:21:09.307968+0000","last_active":"2024-03-07T10:23:58.027788+0000","last_peered":"2024-03-07T10:23:58.027788+0000","last_clean":"2024-03-07T10:23:58.027788+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:23:58.027788+0000","last_undegraded":"2024-03-07T10:23:58.027788+0000","last_fullsized":"2024-03-07T10:23:58.027788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.726377+0000","last_change":"2024-03-07T10:24:27.726437+0000","last_active":"2024-03-07T10:24:27.726377+0000","last_peered":"2024-03-07T10:24:27.726377+0000","last_clean":"2024-03-07T10:24:27.726377+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:27.726377+0000","last_undegraded":"2024-03-07T10:24:27.726377+0000","last_fullsized":"2024-03-07T10:24:27.726377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:27.726183+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:27.726183+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.726183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:53.378474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048150+0000","last_change":"2024-03-07T10:20:57.168964+0000","last_active":"2024-03-07T10:23:58.048150+0000","last_peered":"2024-03-07T10:23:58.048150+0000","last_clean":"2024-03-07T10:23:58.048150+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:23:58.048150+0000","last_undegraded":"2024-03-07T10:23:58.048150+0000","last_fullsized":"2024-03-07T10:23:58.048150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:56.096590+0000","last_clean_scrub_stamp":"2024-03-07T10:20:56.096590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.582797+0000","last_change":"2024-03-07T10:24:19.582862+0000","last_active":"2024-03-07T10:24:19.582797+0000","last_peered":"2024-03-07T10:24:19.582797+0000","last_clean":"2024-03-07T10:24:19.582797+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:19.582797+0000","last_undegraded":"2024-03-07T10:24:19.582797+0000","last_fullsized":"2024-03-07T10:24:19.582797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:19.582625+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:19.582625+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.582625+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:11.843151+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016449+0000","last_change":"2024-03-07T10:21:09.316791+0000","last_active":"2024-03-07T10:23:58.016449+0000","last_peered":"2024-03-07T10:23:58.016449+0000","last_clean":"2024-03-07T10:23:58.016449+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:23:58.016449+0000","last_undegraded":"2024-03-07T10:23:58.016449+0000","last_fullsized":"2024-03-07T10:23:58.016449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.840749+0000","last_change":"2024-03-07T10:24:25.840813+0000","last_active":"2024-03-07T10:24:25.840749+0000","last_peered":"2024-03-07T10:24:25.840749+0000","last_clean":"2024-03-07T10:24:25.840749+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:25.840749+0000","last_undegraded":"2024-03-07T10:24:25.840749+0000","last_fullsized":"2024-03-07T10:24:25.840749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:25.840555+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:25.840555+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.840555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:03.167676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.097855+0000","last_change":"2024-03-07T10:24:24.098025+0000","last_active":"2024-03-07T10:24:24.097855+0000","last_peered":"2024-03-07T10:24:24.097855+0000","last_clean":"2024-03-07T10:24:24.097855+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:24:24.097855+0000","last_undegraded":"2024-03-07T10:24:24.097855+0000","last_fullsized":"2024-03-07T10:24:24.097855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:24.097624+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:24.097624+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.097624+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:16.358151+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.551955+0000","last_change":"2024-03-07T10:24:18.552001+0000","last_active":"2024-03-07T10:24:18.551955+0000","last_peered":"2024-03-07T10:24:18.551955+0000","last_clean":"2024-03-07T10:24:18.551955+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:24:18.551955+0000","last_undegraded":"2024-03-07T10:24:18.551955+0000","last_fullsized":"2024-03-07T10:24:18.551955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:18.551803+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:18.551803+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.551803+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:48.543077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.610903+0000","last_change":"2024-03-07T10:24:32.610959+0000","last_active":"2024-03-07T10:24:32.610903+0000","last_peered":"2024-03-07T10:24:32.610903+0000","last_clean":"2024-03-07T10:24:32.610903+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:24:32.610903+0000","last_undegraded":"2024-03-07T10:24:32.610903+0000","last_fullsized":"2024-03-07T10:24:32.610903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.610660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.610660+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.610660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:16.681565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.906259+0000","last_change":"2024-03-07T10:20:58.153750+0000","last_active":"2024-03-07T10:24:05.906259+0000","last_peered":"2024-03-07T10:24:05.906259+0000","last_clean":"2024-03-07T10:24:05.906259+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:05.906259+0000","last_undegraded":"2024-03-07T10:24:05.906259+0000","last_fullsized":"2024-03-07T10:24:05.906259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.240552+0000","last_change":"2024-03-07T10:24:29.240668+0000","last_active":"2024-03-07T10:24:29.240552+0000","last_peered":"2024-03-07T10:24:29.240552+0000","last_clean":"2024-03-07T10:24:29.240552+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:24:29.240552+0000","last_undegraded":"2024-03-07T10:24:29.240552+0000","last_fullsized":"2024-03-07T10:24:29.240552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:29.240301+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:29.240301+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.240301+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:31:09.122841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.667615+0000","last_change":"2024-03-07T10:24:21.667675+0000","last_active":"2024-03-07T10:24:21.667615+0000","last_peered":"2024-03-07T10:24:21.667615+0000","last_clean":"2024-03-07T10:24:21.667615+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:24:21.667615+0000","last_undegraded":"2024-03-07T10:24:21.667615+0000","last_fullsized":"2024-03-07T10:24:21.667615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:21.667415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:21.667415+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.667415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:00.570964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036912+0000","last_change":"2024-03-07T10:21:09.302516+0000","last_active":"2024-03-07T10:23:58.036912+0000","last_peered":"2024-03-07T10:23:58.036912+0000","last_clean":"2024-03-07T10:23:58.036912+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:23:58.036912+0000","last_undegraded":"2024-03-07T10:23:58.036912+0000","last_fullsized":"2024-03-07T10:23:58.036912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.273242+0000","last_change":"2024-03-07T10:24:32.273352+0000","last_active":"2024-03-07T10:24:32.273242+0000","last_peered":"2024-03-07T10:24:32.273242+0000","last_clean":"2024-03-07T10:24:32.273242+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:32.273242+0000","last_undegraded":"2024-03-07T10:24:32.273242+0000","last_fullsized":"2024-03-07T10:24:32.273242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:32.273035+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:32.273035+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.273035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:24.162315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.447414+0000","last_change":"2024-03-07T10:24:35.447486+0000","last_active":"2024-03-07T10:24:35.447414+0000","last_peered":"2024-03-07T10:24:35.447414+0000","last_clean":"2024-03-07T10:24:35.447414+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:24:35.447414+0000","last_undegraded":"2024-03-07T10:24:35.447414+0000","last_fullsized":"2024-03-07T10:24:35.447414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.447182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.447182+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.447182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:35.587694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.808069+0000","last_change":"2024-03-07T10:24:28.808182+0000","last_active":"2024-03-07T10:24:28.808069+0000","last_peered":"2024-03-07T10:24:28.808069+0000","last_clean":"2024-03-07T10:24:28.808069+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:24:28.808069+0000","last_undegraded":"2024-03-07T10:24:28.808069+0000","last_fullsized":"2024-03-07T10:24:28.808069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.807820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.807820+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.807820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:39.122278+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.780440+0000","last_change":"2024-03-07T10:24:32.780490+0000","last_active":"2024-03-07T10:24:32.780440+0000","last_peered":"2024-03-07T10:24:32.780440+0000","last_clean":"2024-03-07T10:24:32.780440+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:24:32.780440+0000","last_undegraded":"2024-03-07T10:24:32.780440+0000","last_fullsized":"2024-03-07T10:24:32.780440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.780264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.780264+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.780264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:48.940677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.075546+0000","last_change":"2024-03-07T10:24:19.075706+0000","last_active":"2024-03-07T10:24:19.075546+0000","last_peered":"2024-03-07T10:24:19.075546+0000","last_clean":"2024-03-07T10:24:19.075546+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:19.075546+0000","last_undegraded":"2024-03-07T10:24:19.075546+0000","last_fullsized":"2024-03-07T10:24:19.075546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.075279+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.075279+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.075279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:00:50.859925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.263979+0000","last_change":"2024-03-07T10:24:27.264030+0000","last_active":"2024-03-07T10:24:27.263979+0000","last_peered":"2024-03-07T10:24:27.263979+0000","last_clean":"2024-03-07T10:24:27.263979+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:24:27.263979+0000","last_undegraded":"2024-03-07T10:24:27.263979+0000","last_fullsized":"2024-03-07T10:24:27.263979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.263771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.263771+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.263771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:13.588674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.195810+0000","last_change":"2024-03-07T10:24:19.195865+0000","last_active":"2024-03-07T10:24:19.195810+0000","last_peered":"2024-03-07T10:24:19.195810+0000","last_clean":"2024-03-07T10:24:19.195810+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:24:19.195810+0000","last_undegraded":"2024-03-07T10:24:19.195810+0000","last_fullsized":"2024-03-07T10:24:19.195810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:19.195716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:19.195716+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.195716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:24.507722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.792631+0000","last_change":"2024-03-07T10:24:33.792689+0000","last_active":"2024-03-07T10:24:33.792631+0000","last_peered":"2024-03-07T10:24:33.792631+0000","last_clean":"2024-03-07T10:24:33.792631+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:24:33.792631+0000","last_undegraded":"2024-03-07T10:24:33.792631+0000","last_fullsized":"2024-03-07T10:24:33.792631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.792444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.792444+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.792444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:19.865019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.702860+0000","last_change":"2024-03-07T10:24:26.702953+0000","last_active":"2024-03-07T10:24:26.702860+0000","last_peered":"2024-03-07T10:24:26.702860+0000","last_clean":"2024-03-07T10:24:26.702860+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:26.702860+0000","last_undegraded":"2024-03-07T10:24:26.702860+0000","last_fullsized":"2024-03-07T10:24:26.702860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:26.702650+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:26.702650+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.702650+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:04.029771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.204243+0000","last_change":"2024-03-07T10:24:30.204294+0000","last_active":"2024-03-07T10:24:30.204243+0000","last_peered":"2024-03-07T10:24:30.204243+0000","last_clean":"2024-03-07T10:24:30.204243+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:24:30.204243+0000","last_undegraded":"2024-03-07T10:24:30.204243+0000","last_fullsized":"2024-03-07T10:24:30.204243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.204010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.204010+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.204010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:22.093290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.191210+0000","last_change":"2024-03-07T10:24:16.191234+0000","last_active":"2024-03-07T10:24:16.191210+0000","last_peered":"2024-03-07T10:24:16.191210+0000","last_clean":"2024-03-07T10:24:16.191210+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:24:16.191210+0000","last_undegraded":"2024-03-07T10:24:16.191210+0000","last_fullsized":"2024-03-07T10:24:16.191210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.191110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:24.909595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.216539+0000","last_change":"2024-03-07T10:24:29.216643+0000","last_active":"2024-03-07T10:24:29.216539+0000","last_peered":"2024-03-07T10:24:29.216539+0000","last_clean":"2024-03-07T10:24:29.216539+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:24:29.216539+0000","last_undegraded":"2024-03-07T10:24:29.216539+0000","last_fullsized":"2024-03-07T10:24:29.216539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:29.216303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:29.216303+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.216303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:43.959483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.182725+0000","last_change":"2024-03-07T10:24:20.182822+0000","last_active":"2024-03-07T10:24:20.182725+0000","last_peered":"2024-03-07T10:24:20.182725+0000","last_clean":"2024-03-07T10:24:20.182725+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:20.182725+0000","last_undegraded":"2024-03-07T10:24:20.182725+0000","last_fullsized":"2024-03-07T10:24:20.182725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:20.182491+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:20.182491+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.182491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:28.804248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.082890+0000","last_change":"2024-03-07T10:24:17.082914+0000","last_active":"2024-03-07T10:24:17.082890+0000","last_peered":"2024-03-07T10:24:17.082890+0000","last_clean":"2024-03-07T10:24:17.082890+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:24:17.082890+0000","last_undegraded":"2024-03-07T10:24:17.082890+0000","last_fullsized":"2024-03-07T10:24:17.082890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:17.082817+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:17.082817+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.082817+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:20:47.689380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.169223+0000","last_change":"2024-03-07T10:24:21.169289+0000","last_active":"2024-03-07T10:24:21.169223+0000","last_peered":"2024-03-07T10:24:21.169223+0000","last_clean":"2024-03-07T10:24:21.169223+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:21.169223+0000","last_undegraded":"2024-03-07T10:24:21.169223+0000","last_fullsized":"2024-03-07T10:24:21.169223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:21.169045+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:21.169045+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.169045+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:36:29.047306+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027899+0000","last_change":"2024-03-07T10:21:09.315673+0000","last_active":"2024-03-07T10:23:58.027899+0000","last_peered":"2024-03-07T10:23:58.027899+0000","last_clean":"2024-03-07T10:23:58.027899+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:23:58.027899+0000","last_undegraded":"2024-03-07T10:23:58.027899+0000","last_fullsized":"2024-03-07T10:23:58.027899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.842611+0000","last_change":"2024-03-07T10:24:23.842669+0000","last_active":"2024-03-07T10:24:23.842611+0000","last_peered":"2024-03-07T10:24:23.842611+0000","last_clean":"2024-03-07T10:24:23.842611+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:23.842611+0000","last_undegraded":"2024-03-07T10:24:23.842611+0000","last_fullsized":"2024-03-07T10:24:23.842611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:23.842435+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:23.842435+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.842435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:32.464193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.450082+0000","last_change":"2024-03-07T10:24:33.450137+0000","last_active":"2024-03-07T10:24:33.450082+0000","last_peered":"2024-03-07T10:24:33.450082+0000","last_clean":"2024-03-07T10:24:33.450082+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:24:33.450082+0000","last_undegraded":"2024-03-07T10:24:33.450082+0000","last_fullsized":"2024-03-07T10:24:33.450082+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.449842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.449842+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.449842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:24.778447+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'15","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.808708+0000","last_change":"2024-03-07T10:24:29.808830+0000","last_active":"2024-03-07T10:24:29.808708+0000","last_peered":"2024-03-07T10:24:29.808708+0000","last_clean":"2024-03-07T10:24:29.808708+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:29.808708+0000","last_undegraded":"2024-03-07T10:24:29.808708+0000","last_fullsized":"2024-03-07T10:24:29.808708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:29.808493+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:29.808493+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.808493+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:08.712042+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047860+0000","last_change":"2024-03-07T10:21:09.316693+0000","last_active":"2024-03-07T10:23:58.047860+0000","last_peered":"2024-03-07T10:23:58.047860+0000","last_clean":"2024-03-07T10:23:58.047860+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:23:58.047860+0000","last_undegraded":"2024-03-07T10:23:58.047860+0000","last_fullsized":"2024-03-07T10:23:58.047860+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.645250+0000","last_change":"2024-03-07T10:24:24.645318+0000","last_active":"2024-03-07T10:24:24.645250+0000","last_peered":"2024-03-07T10:24:24.645250+0000","last_clean":"2024-03-07T10:24:24.645250+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:24.645250+0000","last_undegraded":"2024-03-07T10:24:24.645250+0000","last_fullsized":"2024-03-07T10:24:24.645250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:24.645054+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:24.645054+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.645054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:40.805467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.184248+0000","last_change":"2024-03-07T10:24:28.184332+0000","last_active":"2024-03-07T10:24:28.184248+0000","last_peered":"2024-03-07T10:24:28.184248+0000","last_clean":"2024-03-07T10:24:28.184248+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:24:28.184248+0000","last_undegraded":"2024-03-07T10:24:28.184248+0000","last_fullsized":"2024-03-07T10:24:28.184248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.183979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.183979+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.183979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:57:42.546996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":200,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.425529+0000","last_change":"2024-03-07T10:24:32.425692+0000","last_active":"2024-03-07T10:24:32.425529+0000","last_peered":"2024-03-07T10:24:32.425529+0000","last_clean":"2024-03-07T10:24:32.425529+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:24:32.425529+0000","last_undegraded":"2024-03-07T10:24:32.425529+0000","last_fullsized":"2024-03-07T10:24:32.425529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-03-07T10:24:32.425278+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-03-07T10:24:32.425278+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.425278+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:40.814537+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.215225+0000","last_change":"2024-03-07T10:24:32.215324+0000","last_active":"2024-03-07T10:24:32.215225+0000","last_peered":"2024-03-07T10:24:32.215225+0000","last_clean":"2024-03-07T10:24:32.215225+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:24:32.215225+0000","last_undegraded":"2024-03-07T10:24:32.215225+0000","last_fullsized":"2024-03-07T10:24:32.215225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.214879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.214879+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.214879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:22.080510+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.115052+0000","last_change":"2024-03-07T10:24:16.115076+0000","last_active":"2024-03-07T10:24:16.115052+0000","last_peered":"2024-03-07T10:24:16.115052+0000","last_clean":"2024-03-07T10:24:16.115052+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:24:16.115052+0000","last_undegraded":"2024-03-07T10:24:16.115052+0000","last_fullsized":"2024-03-07T10:24:16.115052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.114954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:44:18.227347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.407455+0000","last_change":"2024-03-07T10:24:22.407499+0000","last_active":"2024-03-07T10:24:22.407455+0000","last_peered":"2024-03-07T10:24:22.407455+0000","last_clean":"2024-03-07T10:24:22.407455+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:22.407455+0000","last_undegraded":"2024-03-07T10:24:22.407455+0000","last_fullsized":"2024-03-07T10:24:22.407455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:22.407299+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:22.407299+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.407299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:34.232759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.100469+0000","last_change":"2024-03-07T10:24:20.100525+0000","last_active":"2024-03-07T10:24:20.100469+0000","last_peered":"2024-03-07T10:24:20.100469+0000","last_clean":"2024-03-07T10:24:20.100469+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:24:20.100469+0000","last_undegraded":"2024-03-07T10:24:20.100469+0000","last_fullsized":"2024-03-07T10:24:20.100469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:20.100288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:20.100288+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.100288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:21:06.273478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.233859+0000","last_change":"2024-03-07T10:24:31.233916+0000","last_active":"2024-03-07T10:24:31.233859+0000","last_peered":"2024-03-07T10:24:31.233859+0000","last_clean":"2024-03-07T10:24:31.233859+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:24:31.233859+0000","last_undegraded":"2024-03-07T10:24:31.233859+0000","last_fullsized":"2024-03-07T10:24:31.233859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.233657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.233657+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.233657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:08.560778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.228538+0000","last_change":"2024-03-07T10:24:25.228592+0000","last_active":"2024-03-07T10:24:25.228538+0000","last_peered":"2024-03-07T10:24:25.228538+0000","last_clean":"2024-03-07T10:24:25.228538+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:24:25.228538+0000","last_undegraded":"2024-03-07T10:24:25.228538+0000","last_fullsized":"2024-03-07T10:24:25.228538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.228340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.228340+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.228340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:17.547064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.163645+0000","last_change":"2024-03-07T10:24:35.163702+0000","last_active":"2024-03-07T10:24:35.163645+0000","last_peered":"2024-03-07T10:24:35.163645+0000","last_clean":"2024-03-07T10:24:35.163645+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:35.163645+0000","last_undegraded":"2024-03-07T10:24:35.163645+0000","last_fullsized":"2024-03-07T10:24:35.163645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:35.163468+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:35.163468+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.163468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:35.303980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.247736+0000","last_change":"2024-03-07T10:24:28.247804+0000","last_active":"2024-03-07T10:24:28.247736+0000","last_peered":"2024-03-07T10:24:28.247736+0000","last_clean":"2024-03-07T10:24:28.247736+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:24:28.247736+0000","last_undegraded":"2024-03-07T10:24:28.247736+0000","last_fullsized":"2024-03-07T10:24:28.247736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:28.247546+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:28.247546+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.247546+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:07:52.089236+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.832792+0000","last_change":"2024-03-07T10:24:27.832886+0000","last_active":"2024-03-07T10:24:27.832792+0000","last_peered":"2024-03-07T10:24:27.832792+0000","last_clean":"2024-03-07T10:24:27.832792+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:24:27.832792+0000","last_undegraded":"2024-03-07T10:24:27.832792+0000","last_fullsized":"2024-03-07T10:24:27.832792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:27.832585+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:27.832585+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.832585+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:09.341343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.433229+0000","last_change":"2024-03-07T10:24:26.433273+0000","last_active":"2024-03-07T10:24:26.433229+0000","last_peered":"2024-03-07T10:24:26.433229+0000","last_clean":"2024-03-07T10:24:26.433229+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:24:26.433229+0000","last_undegraded":"2024-03-07T10:24:26.433229+0000","last_fullsized":"2024-03-07T10:24:26.433229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.433065+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:10.503970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.407165+0000","last_change":"2024-03-07T10:24:20.407222+0000","last_active":"2024-03-07T10:24:20.407165+0000","last_peered":"2024-03-07T10:24:20.407165+0000","last_clean":"2024-03-07T10:24:20.407165+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:20.407165+0000","last_undegraded":"2024-03-07T10:24:20.407165+0000","last_fullsized":"2024-03-07T10:24:20.407165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:20.406917+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:20.406917+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.406917+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:31:57.734038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.074194+0000","last_change":"2024-03-07T10:24:19.074238+0000","last_active":"2024-03-07T10:24:19.074194+0000","last_peered":"2024-03-07T10:24:19.074194+0000","last_clean":"2024-03-07T10:24:19.074194+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:24:19.074194+0000","last_undegraded":"2024-03-07T10:24:19.074194+0000","last_fullsized":"2024-03-07T10:24:19.074194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:19.074073+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:19.074073+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.074073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:07.399242+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.092473+0000","last_change":"2024-03-07T10:24:18.092622+0000","last_active":"2024-03-07T10:24:18.092473+0000","last_peered":"2024-03-07T10:24:18.092473+0000","last_clean":"2024-03-07T10:24:18.092473+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:24:18.092473+0000","last_undegraded":"2024-03-07T10:24:18.092473+0000","last_fullsized":"2024-03-07T10:24:18.092473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:18.092241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:18.092241+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.092241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:32.835421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.204182+0000","last_change":"2024-03-07T10:24:27.204278+0000","last_active":"2024-03-07T10:24:27.204182+0000","last_peered":"2024-03-07T10:24:27.204182+0000","last_clean":"2024-03-07T10:24:27.204182+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:24:27.204182+0000","last_undegraded":"2024-03-07T10:24:27.204182+0000","last_fullsized":"2024-03-07T10:24:27.204182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.203910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.203910+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.203910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:32.515915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.399406+0000","last_change":"2024-03-07T10:24:21.399449+0000","last_active":"2024-03-07T10:24:21.399406+0000","last_peered":"2024-03-07T10:24:21.399406+0000","last_clean":"2024-03-07T10:24:21.399406+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:21.399406+0000","last_undegraded":"2024-03-07T10:24:21.399406+0000","last_fullsized":"2024-03-07T10:24:21.399406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:21.399257+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:21.399257+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.399257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:47.051547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.677238+0000","last_change":"2024-03-07T10:24:24.677301+0000","last_active":"2024-03-07T10:24:24.677238+0000","last_peered":"2024-03-07T10:24:24.677238+0000","last_clean":"2024-03-07T10:24:24.677238+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:24:24.677238+0000","last_undegraded":"2024-03-07T10:24:24.677238+0000","last_fullsized":"2024-03-07T10:24:24.677238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:24.677024+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:24.677024+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.677024+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:33.298781+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.645267+0000","last_change":"2024-03-07T10:24:22.645327+0000","last_active":"2024-03-07T10:24:22.645267+0000","last_peered":"2024-03-07T10:24:22.645267+0000","last_clean":"2024-03-07T10:24:22.645267+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:24:22.645267+0000","last_undegraded":"2024-03-07T10:24:22.645267+0000","last_fullsized":"2024-03-07T10:24:22.645267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:22.645025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:22.645025+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.645025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:30.442878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.019374+0000","last_change":"2024-03-07T10:21:09.321717+0000","last_active":"2024-03-07T10:23:58.019374+0000","last_peered":"2024-03-07T10:23:58.019374+0000","last_clean":"2024-03-07T10:23:58.019374+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:23:58.019374+0000","last_undegraded":"2024-03-07T10:23:58.019374+0000","last_fullsized":"2024-03-07T10:23:58.019374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.431714+0000","last_change":"2024-03-07T10:24:31.431869+0000","last_active":"2024-03-07T10:24:31.431714+0000","last_peered":"2024-03-07T10:24:31.431714+0000","last_clean":"2024-03-07T10:24:31.431714+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:31.431714+0000","last_undegraded":"2024-03-07T10:24:31.431714+0000","last_fullsized":"2024-03-07T10:24:31.431714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:31.431452+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:31.431452+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.431452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:31.942470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'13","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.101397+0000","last_change":"2024-03-07T10:24:18.101460+0000","last_active":"2024-03-07T10:24:18.101397+0000","last_peered":"2024-03-07T10:24:18.101397+0000","last_clean":"2024-03-07T10:24:18.101397+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:24:18.101397+0000","last_undegraded":"2024-03-07T10:24:18.101397+0000","last_fullsized":"2024-03-07T10:24:18.101397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-03-07T10:24:18.101276+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-03-07T10:24:18.101276+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.101276+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:30:54.326749+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.834340+0000","last_change":"2024-03-07T10:24:26.834394+0000","last_active":"2024-03-07T10:24:26.834340+0000","last_peered":"2024-03-07T10:24:26.834340+0000","last_clean":"2024-03-07T10:24:26.834340+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:24:26.834340+0000","last_undegraded":"2024-03-07T10:24:26.834340+0000","last_fullsized":"2024-03-07T10:24:26.834340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.834157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.834157+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.834157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:52.486448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.073391+0000","last_change":"2024-03-07T10:24:22.073445+0000","last_active":"2024-03-07T10:24:22.073391+0000","last_peered":"2024-03-07T10:24:22.073391+0000","last_clean":"2024-03-07T10:24:22.073391+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:24:22.073391+0000","last_undegraded":"2024-03-07T10:24:22.073391+0000","last_fullsized":"2024-03-07T10:24:22.073391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:22.073194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:22.073194+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.073194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:33.898654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.198983+0000","last_change":"2024-03-07T10:24:28.199067+0000","last_active":"2024-03-07T10:24:28.198983+0000","last_peered":"2024-03-07T10:24:28.198983+0000","last_clean":"2024-03-07T10:24:28.198983+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:28.198983+0000","last_undegraded":"2024-03-07T10:24:28.198983+0000","last_fullsized":"2024-03-07T10:24:28.198983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:28.198777+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:28.198777+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.198777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:34.015482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.117686+0000","last_change":"2024-03-07T10:24:25.117796+0000","last_active":"2024-03-07T10:24:25.117686+0000","last_peered":"2024-03-07T10:24:25.117686+0000","last_clean":"2024-03-07T10:24:25.117686+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:24:25.117686+0000","last_undegraded":"2024-03-07T10:24:25.117686+0000","last_fullsized":"2024-03-07T10:24:25.117686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.117418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.117418+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.117418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:33.835903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.679550+0000","last_change":"2024-03-07T10:24:23.679713+0000","last_active":"2024-03-07T10:24:23.679550+0000","last_peered":"2024-03-07T10:24:23.679550+0000","last_clean":"2024-03-07T10:24:23.679550+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:24:23.679550+0000","last_undegraded":"2024-03-07T10:24:23.679550+0000","last_fullsized":"2024-03-07T10:24:23.679550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:23.679343+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:23.679343+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.679343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:07.750248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027020+0000","last_change":"2024-03-07T10:21:09.321287+0000","last_active":"2024-03-07T10:23:58.027020+0000","last_peered":"2024-03-07T10:23:58.027020+0000","last_clean":"2024-03-07T10:23:58.027020+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:23:58.027020+0000","last_undegraded":"2024-03-07T10:23:58.027020+0000","last_fullsized":"2024-03-07T10:23:58.027020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.422711+0000","last_change":"2024-03-07T10:24:29.422774+0000","last_active":"2024-03-07T10:24:29.422711+0000","last_peered":"2024-03-07T10:24:29.422711+0000","last_clean":"2024-03-07T10:24:29.422711+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:29.422711+0000","last_undegraded":"2024-03-07T10:24:29.422711+0000","last_fullsized":"2024-03-07T10:24:29.422711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:29.422505+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:29.422505+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.422505+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:16.050041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.213423+0000","last_change":"2024-03-07T10:24:29.213512+0000","last_active":"2024-03-07T10:24:29.213423+0000","last_peered":"2024-03-07T10:24:29.213423+0000","last_clean":"2024-03-07T10:24:29.213423+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:24:29.213423+0000","last_undegraded":"2024-03-07T10:24:29.213423+0000","last_fullsized":"2024-03-07T10:24:29.213423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-03-07T10:24:29.213167+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-03-07T10:24:29.213167+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.213167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:19.704576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.680128+0000","last_change":"2024-03-07T10:24:25.680211+0000","last_active":"2024-03-07T10:24:25.680128+0000","last_peered":"2024-03-07T10:24:25.680128+0000","last_clean":"2024-03-07T10:24:25.680128+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:25.680128+0000","last_undegraded":"2024-03-07T10:24:25.680128+0000","last_fullsized":"2024-03-07T10:24:25.680128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-03-07T10:24:25.679908+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-03-07T10:24:25.679908+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.679908+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:57:40.042925+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":32,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.648323+0000","last_change":"2024-03-07T10:24:27.648358+0000","last_active":"2024-03-07T10:24:27.648323+0000","last_peered":"2024-03-07T10:24:27.648323+0000","last_clean":"2024-03-07T10:24:27.648323+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:24:27.648323+0000","last_undegraded":"2024-03-07T10:24:27.648323+0000","last_fullsized":"2024-03-07T10:24:27.648323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.648219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.648219+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.648219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:19.537499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.861100+0000","last_change":"2024-03-07T10:24:20.861238+0000","last_active":"2024-03-07T10:24:20.861100+0000","last_peered":"2024-03-07T10:24:20.861100+0000","last_clean":"2024-03-07T10:24:20.861100+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:20.861100+0000","last_undegraded":"2024-03-07T10:24:20.861100+0000","last_fullsized":"2024-03-07T10:24:20.861100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:20.860875+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:20.860875+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.860875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:50:55.341370+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.884385+0000","last_change":"2024-03-07T10:24:18.884410+0000","last_active":"2024-03-07T10:24:18.884385+0000","last_peered":"2024-03-07T10:24:18.884385+0000","last_clean":"2024-03-07T10:24:18.884385+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:24:18.884385+0000","last_undegraded":"2024-03-07T10:24:18.884385+0000","last_fullsized":"2024-03-07T10:24:18.884385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:18.884322+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:18.884322+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.884322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:49:16.630344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.084060+0000","last_change":"2024-03-07T10:24:20.084135+0000","last_active":"2024-03-07T10:24:20.084060+0000","last_peered":"2024-03-07T10:24:20.084060+0000","last_clean":"2024-03-07T10:24:20.084060+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:20.084060+0000","last_undegraded":"2024-03-07T10:24:20.084060+0000","last_fullsized":"2024-03-07T10:24:20.084060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:20.083833+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:20.083833+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.083833+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:09.949465+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.017103+0000","last_change":"2024-03-07T10:21:09.312617+0000","last_active":"2024-03-07T10:23:58.017103+0000","last_peered":"2024-03-07T10:23:58.017103+0000","last_clean":"2024-03-07T10:23:58.017103+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:23:58.017103+0000","last_undegraded":"2024-03-07T10:23:58.017103+0000","last_fullsized":"2024-03-07T10:23:58.017103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.439169+0000","last_change":"2024-03-07T10:24:25.439299+0000","last_active":"2024-03-07T10:24:25.439169+0000","last_peered":"2024-03-07T10:24:25.439169+0000","last_clean":"2024-03-07T10:24:25.439169+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:25.439169+0000","last_undegraded":"2024-03-07T10:24:25.439169+0000","last_fullsized":"2024-03-07T10:24:25.439169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:25.438885+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:25.438885+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.438885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:11.763788+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'31","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.081326+0000","last_change":"2024-03-07T10:24:23.081397+0000","last_active":"2024-03-07T10:24:23.081326+0000","last_peered":"2024-03-07T10:24:23.081326+0000","last_clean":"2024-03-07T10:24:23.081326+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:23.081326+0000","last_undegraded":"2024-03-07T10:24:23.081326+0000","last_fullsized":"2024-03-07T10:24:23.081326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-03-07T10:24:23.081141+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-03-07T10:24:23.081141+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.081141+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:53.072415+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.180090+0000","last_change":"2024-03-07T10:24:15.180114+0000","last_active":"2024-03-07T10:24:15.180090+0000","last_peered":"2024-03-07T10:24:15.180090+0000","last_clean":"2024-03-07T10:24:15.180090+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:24:15.180090+0000","last_undegraded":"2024-03-07T10:24:15.180090+0000","last_fullsized":"2024-03-07T10:24:15.180090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.180026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:10:58.716023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.218516+0000","last_change":"2024-03-07T10:24:23.218565+0000","last_active":"2024-03-07T10:24:23.218516+0000","last_peered":"2024-03-07T10:24:23.218516+0000","last_clean":"2024-03-07T10:24:23.218516+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:24:23.218516+0000","last_undegraded":"2024-03-07T10:24:23.218516+0000","last_fullsized":"2024-03-07T10:24:23.218516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:23.218343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:23.218343+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.218343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:48.870634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.669916+0000","last_change":"2024-03-07T10:24:25.669979+0000","last_active":"2024-03-07T10:24:25.669916+0000","last_peered":"2024-03-07T10:24:25.669916+0000","last_clean":"2024-03-07T10:24:25.669916+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:25.669916+0000","last_undegraded":"2024-03-07T10:24:25.669916+0000","last_fullsized":"2024-03-07T10:24:25.669916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:25.669717+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:25.669717+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.669717+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:40.412897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'7","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.209961+0000","last_change":"2024-03-07T10:24:30.210091+0000","last_active":"2024-03-07T10:24:30.209961+0000","last_peered":"2024-03-07T10:24:30.209961+0000","last_clean":"2024-03-07T10:24:30.209961+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:24:30.209961+0000","last_undegraded":"2024-03-07T10:24:30.209961+0000","last_fullsized":"2024-03-07T10:24:30.209961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:30.209704+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:30.209704+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.209704+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:00:12.903281+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.620842+0000","last_change":"2024-03-07T10:24:21.620978+0000","last_active":"2024-03-07T10:24:21.620842+0000","last_peered":"2024-03-07T10:24:21.620842+0000","last_clean":"2024-03-07T10:24:21.620842+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:24:21.620842+0000","last_undegraded":"2024-03-07T10:24:21.620842+0000","last_fullsized":"2024-03-07T10:24:21.620842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:21.620661+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:21.620661+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.620661+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:20.243333+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.223958+0000","last_change":"2024-03-07T10:24:34.224001+0000","last_active":"2024-03-07T10:24:34.223958+0000","last_peered":"2024-03-07T10:24:34.223958+0000","last_clean":"2024-03-07T10:24:34.223958+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:24:34.223958+0000","last_undegraded":"2024-03-07T10:24:34.223958+0000","last_fullsized":"2024-03-07T10:24:34.223958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.223780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.223780+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.223780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:59.096235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.761771+0000","last_change":"2024-03-07T10:24:15.761796+0000","last_active":"2024-03-07T10:24:15.761771+0000","last_peered":"2024-03-07T10:24:15.761771+0000","last_clean":"2024-03-07T10:24:15.761771+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:15.761771+0000","last_undegraded":"2024-03-07T10:24:15.761771+0000","last_fullsized":"2024-03-07T10:24:15.761771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.761687+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:12:30.714756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.242937+0000","last_change":"2024-03-07T10:24:31.242980+0000","last_active":"2024-03-07T10:24:31.242937+0000","last_peered":"2024-03-07T10:24:31.242937+0000","last_clean":"2024-03-07T10:24:31.242937+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:24:31.242937+0000","last_undegraded":"2024-03-07T10:24:31.242937+0000","last_fullsized":"2024-03-07T10:24:31.242937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.242783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.242783+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.242783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:31.753801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'13","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.638516+0000","last_change":"2024-03-07T10:24:17.638567+0000","last_active":"2024-03-07T10:24:17.638516+0000","last_peered":"2024-03-07T10:24:17.638516+0000","last_clean":"2024-03-07T10:24:17.638516+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:17.638516+0000","last_undegraded":"2024-03-07T10:24:17.638516+0000","last_fullsized":"2024-03-07T10:24:17.638516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-03-07T10:24:17.638417+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-03-07T10:24:17.638417+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.638417+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:43:01.742130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047317+0000","last_change":"2024-03-07T10:21:09.311214+0000","last_active":"2024-03-07T10:23:58.047317+0000","last_peered":"2024-03-07T10:23:58.047317+0000","last_clean":"2024-03-07T10:23:58.047317+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:23:58.047317+0000","last_undegraded":"2024-03-07T10:23:58.047317+0000","last_fullsized":"2024-03-07T10:23:58.047317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:06.497359+0000","last_change":"2024-03-07T10:21:39.614139+0000","last_active":"2024-03-07T10:24:06.497359+0000","last_peered":"2024-03-07T10:24:06.497359+0000","last_clean":"2024-03-07T10:24:06.497359+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:06.497359+0000","last_undegraded":"2024-03-07T10:24:06.497359+0000","last_fullsized":"2024-03-07T10:24:06.497359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.152023+0000","last_change":"2024-03-07T10:24:27.152114+0000","last_active":"2024-03-07T10:24:27.152023+0000","last_peered":"2024-03-07T10:24:27.152023+0000","last_clean":"2024-03-07T10:24:27.152023+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:24:27.152023+0000","last_undegraded":"2024-03-07T10:24:27.152023+0000","last_fullsized":"2024-03-07T10:24:27.152023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-03-07T10:24:27.151809+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-03-07T10:24:27.151809+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.151809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:34.949661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.590288+0000","last_change":"2024-03-07T10:24:16.590322+0000","last_active":"2024-03-07T10:24:16.590288+0000","last_peered":"2024-03-07T10:24:16.590288+0000","last_clean":"2024-03-07T10:24:16.590288+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:24:16.590288+0000","last_undegraded":"2024-03-07T10:24:16.590288+0000","last_fullsized":"2024-03-07T10:24:16.590288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.590192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.590192+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.590192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:00:48.374838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.179141+0000","last_change":"2024-03-07T10:24:35.179306+0000","last_active":"2024-03-07T10:24:35.179141+0000","last_peered":"2024-03-07T10:24:35.179141+0000","last_clean":"2024-03-07T10:24:35.179141+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:24:35.179141+0000","last_undegraded":"2024-03-07T10:24:35.179141+0000","last_fullsized":"2024-03-07T10:24:35.179141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.178895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.178895+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.178895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:26:51.690038+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.809917+0000","last_change":"2024-03-07T10:24:16.809952+0000","last_active":"2024-03-07T10:24:16.809917+0000","last_peered":"2024-03-07T10:24:16.809917+0000","last_clean":"2024-03-07T10:24:16.809917+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:24:16.809917+0000","last_undegraded":"2024-03-07T10:24:16.809917+0000","last_fullsized":"2024-03-07T10:24:16.809917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:16.809824+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:16.809824+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.809824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:21.495507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.149422+0000","last_change":"2024-03-07T10:24:18.149446+0000","last_active":"2024-03-07T10:24:18.149422+0000","last_peered":"2024-03-07T10:24:18.149422+0000","last_clean":"2024-03-07T10:24:18.149422+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:18.149422+0000","last_undegraded":"2024-03-07T10:24:18.149422+0000","last_fullsized":"2024-03-07T10:24:18.149422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:18.149347+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:18.149347+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.149347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:46:50.413866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.207651+0000","last_change":"2024-03-07T10:24:32.207703+0000","last_active":"2024-03-07T10:24:32.207651+0000","last_peered":"2024-03-07T10:24:32.207651+0000","last_clean":"2024-03-07T10:24:32.207651+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:24:32.207651+0000","last_undegraded":"2024-03-07T10:24:32.207651+0000","last_fullsized":"2024-03-07T10:24:32.207651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.207439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.207439+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.207439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:40.596698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.809533+0000","last_change":"2024-03-07T10:24:31.809584+0000","last_active":"2024-03-07T10:24:31.809533+0000","last_peered":"2024-03-07T10:24:31.809533+0000","last_clean":"2024-03-07T10:24:31.809533+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:24:31.809533+0000","last_undegraded":"2024-03-07T10:24:31.809533+0000","last_fullsized":"2024-03-07T10:24:31.809533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.809330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.809330+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.809330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:15.880236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.232086+0000","last_change":"2024-03-07T10:24:33.232162+0000","last_active":"2024-03-07T10:24:33.232086+0000","last_peered":"2024-03-07T10:24:33.232086+0000","last_clean":"2024-03-07T10:24:33.232086+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:24:33.232086+0000","last_undegraded":"2024-03-07T10:24:33.232086+0000","last_fullsized":"2024-03-07T10:24:33.232086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:33.231859+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:33.231859+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.231859+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:14.740616+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.619540+0000","last_change":"2024-03-07T10:24:34.619649+0000","last_active":"2024-03-07T10:24:34.619540+0000","last_peered":"2024-03-07T10:24:34.619540+0000","last_clean":"2024-03-07T10:24:34.619540+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:34.619540+0000","last_undegraded":"2024-03-07T10:24:34.619540+0000","last_fullsized":"2024-03-07T10:24:34.619540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:34.619332+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:34.619332+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.619332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:19.936790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.623302+0000","last_change":"2024-03-07T10:24:31.623385+0000","last_active":"2024-03-07T10:24:31.623302+0000","last_peered":"2024-03-07T10:24:31.623302+0000","last_clean":"2024-03-07T10:24:31.623302+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:24:31.623302+0000","last_undegraded":"2024-03-07T10:24:31.623302+0000","last_fullsized":"2024-03-07T10:24:31.623302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.623044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.623044+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.623044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:48.603939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.287946+0000","last_change":"2024-03-07T10:24:36.288049+0000","last_active":"2024-03-07T10:24:36.287946+0000","last_peered":"2024-03-07T10:24:36.287946+0000","last_clean":"2024-03-07T10:24:36.287946+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:24:36.287946+0000","last_undegraded":"2024-03-07T10:24:36.287946+0000","last_fullsized":"2024-03-07T10:24:36.287946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.287650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.287650+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.287650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:03:28.780642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.102215+0000","last_change":"2024-03-07T10:24:26.102283+0000","last_active":"2024-03-07T10:24:26.102215+0000","last_peered":"2024-03-07T10:24:26.102215+0000","last_clean":"2024-03-07T10:24:26.102215+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:24:26.102215+0000","last_undegraded":"2024-03-07T10:24:26.102215+0000","last_fullsized":"2024-03-07T10:24:26.102215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:26.101998+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:26.101998+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.101998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:51:00.582494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.860776+0000","last_change":"2024-03-07T10:24:24.860928+0000","last_active":"2024-03-07T10:24:24.860776+0000","last_peered":"2024-03-07T10:24:24.860776+0000","last_clean":"2024-03-07T10:24:24.860776+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:24.860776+0000","last_undegraded":"2024-03-07T10:24:24.860776+0000","last_fullsized":"2024-03-07T10:24:24.860776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:24.860543+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:24.860543+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.860543+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:39.603723+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.214060+0000","last_change":"2024-03-07T10:24:23.214129+0000","last_active":"2024-03-07T10:24:23.214060+0000","last_peered":"2024-03-07T10:24:23.214060+0000","last_clean":"2024-03-07T10:24:23.214060+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:23.214060+0000","last_undegraded":"2024-03-07T10:24:23.214060+0000","last_fullsized":"2024-03-07T10:24:23.214060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:23.213826+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:23.213826+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.213826+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:15.474353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.620872+0000","last_change":"2024-03-07T10:24:34.620925+0000","last_active":"2024-03-07T10:24:34.620872+0000","last_peered":"2024-03-07T10:24:34.620872+0000","last_clean":"2024-03-07T10:24:34.620872+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:24:34.620872+0000","last_undegraded":"2024-03-07T10:24:34.620872+0000","last_fullsized":"2024-03-07T10:24:34.620872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.620679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.620679+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.620679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:20.693255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.583877+0000","last_change":"2024-03-07T10:24:33.583939+0000","last_active":"2024-03-07T10:24:33.583877+0000","last_peered":"2024-03-07T10:24:33.583877+0000","last_clean":"2024-03-07T10:24:33.583877+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:24:33.583877+0000","last_undegraded":"2024-03-07T10:24:33.583877+0000","last_fullsized":"2024-03-07T10:24:33.583877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:33.583615+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:33.583615+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:00.868428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.707167+0000","last_change":"2024-03-07T10:24:28.707237+0000","last_active":"2024-03-07T10:24:28.707167+0000","last_peered":"2024-03-07T10:24:28.707167+0000","last_clean":"2024-03-07T10:24:28.707167+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:28.707167+0000","last_undegraded":"2024-03-07T10:24:28.707167+0000","last_fullsized":"2024-03-07T10:24:28.707167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:28.706930+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:28.706930+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.706930+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:40.532390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.605352+0000","last_change":"2024-03-07T10:24:19.605380+0000","last_active":"2024-03-07T10:24:19.605352+0000","last_peered":"2024-03-07T10:24:19.605352+0000","last_clean":"2024-03-07T10:24:19.605352+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:19.605352+0000","last_undegraded":"2024-03-07T10:24:19.605352+0000","last_fullsized":"2024-03-07T10:24:19.605352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.605271+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.605271+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.605271+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:31.430731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.651085+0000","last_change":"2024-03-07T10:24:29.651148+0000","last_active":"2024-03-07T10:24:29.651085+0000","last_peered":"2024-03-07T10:24:29.651085+0000","last_clean":"2024-03-07T10:24:29.651085+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:24:29.651085+0000","last_undegraded":"2024-03-07T10:24:29.651085+0000","last_fullsized":"2024-03-07T10:24:29.651085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:29.650834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:29.650834+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.650834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:38.040093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.086170+0000","last_change":"2024-03-07T10:24:22.086227+0000","last_active":"2024-03-07T10:24:22.086170+0000","last_peered":"2024-03-07T10:24:22.086170+0000","last_clean":"2024-03-07T10:24:22.086170+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:22.086170+0000","last_undegraded":"2024-03-07T10:24:22.086170+0000","last_fullsized":"2024-03-07T10:24:22.086170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:22.085952+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:22.085952+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.085952+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:26.771635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023058+0000","last_change":"2024-03-07T10:21:09.319856+0000","last_active":"2024-03-07T10:23:58.023058+0000","last_peered":"2024-03-07T10:23:58.023058+0000","last_clean":"2024-03-07T10:23:58.023058+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:23:58.023058+0000","last_undegraded":"2024-03-07T10:23:58.023058+0000","last_fullsized":"2024-03-07T10:23:58.023058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.142740+0000","last_change":"2024-03-07T10:24:21.142801+0000","last_active":"2024-03-07T10:24:21.142740+0000","last_peered":"2024-03-07T10:24:21.142740+0000","last_clean":"2024-03-07T10:24:21.142740+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:21.142740+0000","last_undegraded":"2024-03-07T10:24:21.142740+0000","last_fullsized":"2024-03-07T10:24:21.142740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-03-07T10:24:21.142550+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-03-07T10:24:21.142550+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.142550+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:16:49.948251+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.130504+0000","last_change":"2024-03-07T10:24:36.130598+0000","last_active":"2024-03-07T10:24:36.130504+0000","last_peered":"2024-03-07T10:24:36.130504+0000","last_clean":"2024-03-07T10:24:36.130504+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:24:36.130504+0000","last_undegraded":"2024-03-07T10:24:36.130504+0000","last_fullsized":"2024-03-07T10:24:36.130504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.130271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.130271+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.130271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:03.415084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.109839+0000","last_change":"2024-03-07T10:24:25.109944+0000","last_active":"2024-03-07T10:24:25.109839+0000","last_peered":"2024-03-07T10:24:25.109839+0000","last_clean":"2024-03-07T10:24:25.109839+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:25.109839+0000","last_undegraded":"2024-03-07T10:24:25.109839+0000","last_fullsized":"2024-03-07T10:24:25.109839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:25.109651+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:25.109651+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.109651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:56:56.273706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023778+0000","last_change":"2024-03-07T10:21:09.317145+0000","last_active":"2024-03-07T10:23:58.023778+0000","last_peered":"2024-03-07T10:23:58.023778+0000","last_clean":"2024-03-07T10:23:58.023778+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:23:58.023778+0000","last_undegraded":"2024-03-07T10:23:58.023778+0000","last_fullsized":"2024-03-07T10:23:58.023778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.807567+0000","last_change":"2024-03-07T10:24:22.807687+0000","last_active":"2024-03-07T10:24:22.807567+0000","last_peered":"2024-03-07T10:24:22.807567+0000","last_clean":"2024-03-07T10:24:22.807567+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:22.807567+0000","last_undegraded":"2024-03-07T10:24:22.807567+0000","last_fullsized":"2024-03-07T10:24:22.807567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:22.807360+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:22.807360+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.807360+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:28.119365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.398574+0000","last_change":"2024-03-07T10:24:30.398623+0000","last_active":"2024-03-07T10:24:30.398574+0000","last_peered":"2024-03-07T10:24:30.398574+0000","last_clean":"2024-03-07T10:24:30.398574+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:24:30.398574+0000","last_undegraded":"2024-03-07T10:24:30.398574+0000","last_fullsized":"2024-03-07T10:24:30.398574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.398430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.398430+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.398430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:26.201845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.910470+0000","last_change":"2024-03-07T10:20:58.156546+0000","last_active":"2024-03-07T10:24:05.910470+0000","last_peered":"2024-03-07T10:24:05.910470+0000","last_clean":"2024-03-07T10:24:05.910470+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:05.910470+0000","last_undegraded":"2024-03-07T10:24:05.910470+0000","last_fullsized":"2024-03-07T10:24:05.910470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025026+0000","last_change":"2024-03-07T10:21:09.305417+0000","last_active":"2024-03-07T10:23:58.025026+0000","last_peered":"2024-03-07T10:23:58.025026+0000","last_clean":"2024-03-07T10:23:58.025026+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:23:58.025026+0000","last_undegraded":"2024-03-07T10:23:58.025026+0000","last_fullsized":"2024-03-07T10:23:58.025026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.189478+0000","last_change":"2024-03-07T10:24:22.189530+0000","last_active":"2024-03-07T10:24:22.189478+0000","last_peered":"2024-03-07T10:24:22.189478+0000","last_clean":"2024-03-07T10:24:22.189478+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:22.189478+0000","last_undegraded":"2024-03-07T10:24:22.189478+0000","last_fullsized":"2024-03-07T10:24:22.189478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:22.189327+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:22.189327+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.189327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:43:06.293040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047363+0000","last_change":"2024-03-07T10:21:09.306974+0000","last_active":"2024-03-07T10:23:58.047363+0000","last_peered":"2024-03-07T10:23:58.047363+0000","last_clean":"2024-03-07T10:23:58.047363+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:23:58.047363+0000","last_undegraded":"2024-03-07T10:23:58.047363+0000","last_fullsized":"2024-03-07T10:23:58.047363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.107323+0000","last_change":"2024-03-07T10:24:20.107361+0000","last_active":"2024-03-07T10:24:20.107323+0000","last_peered":"2024-03-07T10:24:20.107323+0000","last_clean":"2024-03-07T10:24:20.107323+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:20.107323+0000","last_undegraded":"2024-03-07T10:24:20.107323+0000","last_fullsized":"2024-03-07T10:24:20.107323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:20.107220+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:20.107220+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.107220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:45.922892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.036702+0000","last_change":"2024-03-07T10:21:09.308743+0000","last_active":"2024-03-07T10:23:58.036702+0000","last_peered":"2024-03-07T10:23:58.036702+0000","last_clean":"2024-03-07T10:23:58.036702+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:23:58.036702+0000","last_undegraded":"2024-03-07T10:23:58.036702+0000","last_fullsized":"2024-03-07T10:23:58.036702+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.904355+0000","last_change":"2024-03-07T10:20:58.153756+0000","last_active":"2024-03-07T10:24:05.904355+0000","last_peered":"2024-03-07T10:24:05.904355+0000","last_clean":"2024-03-07T10:24:05.904355+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:05.904355+0000","last_undegraded":"2024-03-07T10:24:05.904355+0000","last_fullsized":"2024-03-07T10:24:05.904355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020384+0000","last_change":"2024-03-07T10:21:09.322567+0000","last_active":"2024-03-07T10:23:58.020384+0000","last_peered":"2024-03-07T10:23:58.020384+0000","last_clean":"2024-03-07T10:23:58.020384+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:23:58.020384+0000","last_undegraded":"2024-03-07T10:23:58.020384+0000","last_fullsized":"2024-03-07T10:23:58.020384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.898853+0000","last_change":"2024-03-07T10:21:39.581098+0000","last_active":"2024-03-07T10:24:05.898853+0000","last_peered":"2024-03-07T10:24:05.898853+0000","last_clean":"2024-03-07T10:24:05.898853+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:05.898853+0000","last_undegraded":"2024-03-07T10:24:05.898853+0000","last_fullsized":"2024-03-07T10:24:05.898853+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048563+0000","last_change":"2024-03-07T10:21:09.304234+0000","last_active":"2024-03-07T10:23:58.048563+0000","last_peered":"2024-03-07T10:23:58.048563+0000","last_clean":"2024-03-07T10:23:58.048563+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:23:58.048563+0000","last_undegraded":"2024-03-07T10:23:58.048563+0000","last_fullsized":"2024-03-07T10:23:58.048563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.633519+0000","last_change":"2024-03-07T10:24:28.633694+0000","last_active":"2024-03-07T10:24:28.633519+0000","last_peered":"2024-03-07T10:24:28.633519+0000","last_clean":"2024-03-07T10:24:28.633519+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:28.633519+0000","last_undegraded":"2024-03-07T10:24:28.633519+0000","last_fullsized":"2024-03-07T10:24:28.633519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:28.633234+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:28.633234+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.633234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:29.144252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.179727+0000","last_change":"2024-03-07T10:24:24.179781+0000","last_active":"2024-03-07T10:24:24.179727+0000","last_peered":"2024-03-07T10:24:24.179727+0000","last_clean":"2024-03-07T10:24:24.179727+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:24:24.179727+0000","last_undegraded":"2024-03-07T10:24:24.179727+0000","last_fullsized":"2024-03-07T10:24:24.179727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:24.179549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:24.179549+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.179549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:49:21.925572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.289786+0000","last_change":"2024-03-07T10:24:31.289863+0000","last_active":"2024-03-07T10:24:31.289786+0000","last_peered":"2024-03-07T10:24:31.289786+0000","last_clean":"2024-03-07T10:24:31.289786+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:31.289786+0000","last_undegraded":"2024-03-07T10:24:31.289786+0000","last_fullsized":"2024-03-07T10:24:31.289786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:31.289608+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:31.289608+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.289608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:56.941899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.018200+0000","last_change":"2024-03-07T10:21:09.323984+0000","last_active":"2024-03-07T10:23:58.018200+0000","last_peered":"2024-03-07T10:23:58.018200+0000","last_clean":"2024-03-07T10:23:58.018200+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:23:58.018200+0000","last_undegraded":"2024-03-07T10:23:58.018200+0000","last_fullsized":"2024-03-07T10:23:58.018200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:14.713565+0000","last_change":"2024-03-07T10:24:14.713624+0000","last_active":"2024-03-07T10:24:14.713565+0000","last_peered":"2024-03-07T10:24:14.713565+0000","last_clean":"2024-03-07T10:24:14.713565+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:14.713565+0000","last_undegraded":"2024-03-07T10:24:14.713565+0000","last_fullsized":"2024-03-07T10:24:14.713565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_clean_scrub_stamp":"2024-03-07T10:24:14.713377+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:59:06.356523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.650405+0000","last_change":"2024-03-07T10:24:33.650462+0000","last_active":"2024-03-07T10:24:33.650405+0000","last_peered":"2024-03-07T10:24:33.650405+0000","last_clean":"2024-03-07T10:24:33.650405+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:24:33.650405+0000","last_undegraded":"2024-03-07T10:24:33.650405+0000","last_fullsized":"2024-03-07T10:24:33.650405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.650223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.650223+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.650223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:49.810636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.225326+0000","last_change":"2024-03-07T10:24:29.225384+0000","last_active":"2024-03-07T10:24:29.225326+0000","last_peered":"2024-03-07T10:24:29.225326+0000","last_clean":"2024-03-07T10:24:29.225326+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:29.225326+0000","last_undegraded":"2024-03-07T10:24:29.225326+0000","last_fullsized":"2024-03-07T10:24:29.225326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:29.225138+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:29.225138+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.225138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:30.403220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.024912+0000","last_change":"2024-03-07T10:21:09.310826+0000","last_active":"2024-03-07T10:23:58.024912+0000","last_peered":"2024-03-07T10:23:58.024912+0000","last_clean":"2024-03-07T10:23:58.024912+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:23:58.024912+0000","last_undegraded":"2024-03-07T10:23:58.024912+0000","last_fullsized":"2024-03-07T10:23:58.024912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.410732+0000","last_change":"2024-03-07T10:24:27.410795+0000","last_active":"2024-03-07T10:24:27.410732+0000","last_peered":"2024-03-07T10:24:27.410732+0000","last_clean":"2024-03-07T10:24:27.410732+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:27.410732+0000","last_undegraded":"2024-03-07T10:24:27.410732+0000","last_fullsized":"2024-03-07T10:24:27.410732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:27.410545+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:27.410545+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.410545+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:43.570958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025184+0000","last_change":"2024-03-07T10:21:09.321464+0000","last_active":"2024-03-07T10:23:58.025184+0000","last_peered":"2024-03-07T10:23:58.025184+0000","last_clean":"2024-03-07T10:23:58.025184+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:23:58.025184+0000","last_undegraded":"2024-03-07T10:23:58.025184+0000","last_fullsized":"2024-03-07T10:23:58.025184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.166778+0000","last_change":"2024-03-07T10:24:22.166901+0000","last_active":"2024-03-07T10:24:22.166778+0000","last_peered":"2024-03-07T10:24:22.166778+0000","last_clean":"2024-03-07T10:24:22.166778+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:22.166778+0000","last_undegraded":"2024-03-07T10:24:22.166778+0000","last_fullsized":"2024-03-07T10:24:22.166778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:22.166521+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:22.166521+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.166521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:36.197635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.820639+0000","last_change":"2024-03-07T10:24:30.820689+0000","last_active":"2024-03-07T10:24:30.820639+0000","last_peered":"2024-03-07T10:24:30.820639+0000","last_clean":"2024-03-07T10:24:30.820639+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:24:30.820639+0000","last_undegraded":"2024-03-07T10:24:30.820639+0000","last_fullsized":"2024-03-07T10:24:30.820639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.820448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.820448+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.820448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:17.145351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.321373+0000","last_change":"2024-03-07T10:24:32.321425+0000","last_active":"2024-03-07T10:24:32.321373+0000","last_peered":"2024-03-07T10:24:32.321373+0000","last_clean":"2024-03-07T10:24:32.321373+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:32.321373+0000","last_undegraded":"2024-03-07T10:24:32.321373+0000","last_fullsized":"2024-03-07T10:24:32.321373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:32.321206+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:32.321206+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.321206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:44.146666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.023053+0000","last_change":"2024-03-07T10:21:09.329263+0000","last_active":"2024-03-07T10:23:58.023053+0000","last_peered":"2024-03-07T10:23:58.023053+0000","last_clean":"2024-03-07T10:23:58.023053+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:23:58.023053+0000","last_undegraded":"2024-03-07T10:23:58.023053+0000","last_fullsized":"2024-03-07T10:23:58.023053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.189248+0000","last_change":"2024-03-07T10:24:34.189305+0000","last_active":"2024-03-07T10:24:34.189248+0000","last_peered":"2024-03-07T10:24:34.189248+0000","last_clean":"2024-03-07T10:24:34.189248+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:34.189248+0000","last_undegraded":"2024-03-07T10:24:34.189248+0000","last_fullsized":"2024-03-07T10:24:34.189248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:34.189056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:34.189056+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.189056+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:51.169951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.025522+0000","last_change":"2024-03-07T10:21:09.315716+0000","last_active":"2024-03-07T10:23:58.025522+0000","last_peered":"2024-03-07T10:23:58.025522+0000","last_clean":"2024-03-07T10:23:58.025522+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:23:58.025522+0000","last_undegraded":"2024-03-07T10:23:58.025522+0000","last_fullsized":"2024-03-07T10:23:58.025522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.223205+0000","last_change":"2024-03-07T10:24:24.223326+0000","last_active":"2024-03-07T10:24:24.223205+0000","last_peered":"2024-03-07T10:24:24.223205+0000","last_clean":"2024-03-07T10:24:24.223205+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:24.223205+0000","last_undegraded":"2024-03-07T10:24:24.223205+0000","last_fullsized":"2024-03-07T10:24:24.223205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:24.222992+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:24.222992+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.222992+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:05.731749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.062559+0000","last_change":"2024-03-07T10:24:24.062616+0000","last_active":"2024-03-07T10:24:24.062559+0000","last_peered":"2024-03-07T10:24:24.062559+0000","last_clean":"2024-03-07T10:24:24.062559+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:24:24.062559+0000","last_undegraded":"2024-03-07T10:24:24.062559+0000","last_fullsized":"2024-03-07T10:24:24.062559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:24.062314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:24.062314+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.062314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:02.965863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:13.761596+0000","last_change":"2024-03-07T10:24:13.761626+0000","last_active":"2024-03-07T10:24:13.761596+0000","last_peered":"2024-03-07T10:24:13.761596+0000","last_clean":"2024-03-07T10:24:13.761596+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:13.761596+0000","last_undegraded":"2024-03-07T10:24:13.761596+0000","last_fullsized":"2024-03-07T10:24:13.761596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_clean_scrub_stamp":"2024-03-07T10:24:13.761490+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:02.086659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.048228+0000","last_change":"2024-03-07T10:21:09.326895+0000","last_active":"2024-03-07T10:23:58.048228+0000","last_peered":"2024-03-07T10:23:58.048228+0000","last_clean":"2024-03-07T10:23:58.048228+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:23:58.048228+0000","last_undegraded":"2024-03-07T10:23:58.048228+0000","last_fullsized":"2024-03-07T10:23:58.048228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.672084+0000","last_change":"2024-03-07T10:24:30.672176+0000","last_active":"2024-03-07T10:24:30.672084+0000","last_peered":"2024-03-07T10:24:30.672084+0000","last_clean":"2024-03-07T10:24:30.672084+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:30.672084+0000","last_undegraded":"2024-03-07T10:24:30.672084+0000","last_fullsized":"2024-03-07T10:24:30.672084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:30.671826+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:30.671826+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.671826+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:22.000431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.016669+0000","last_change":"2024-03-07T10:21:09.316806+0000","last_active":"2024-03-07T10:23:58.016669+0000","last_peered":"2024-03-07T10:23:58.016669+0000","last_clean":"2024-03-07T10:23:58.016669+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:23:58.016669+0000","last_undegraded":"2024-03-07T10:23:58.016669+0000","last_fullsized":"2024-03-07T10:23:58.016669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.725661+0000","last_change":"2024-03-07T10:24:29.725723+0000","last_active":"2024-03-07T10:24:29.725661+0000","last_peered":"2024-03-07T10:24:29.725661+0000","last_clean":"2024-03-07T10:24:29.725661+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:29.725661+0000","last_undegraded":"2024-03-07T10:24:29.725661+0000","last_fullsized":"2024-03-07T10:24:29.725661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:29.725437+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:29.725437+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.725437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:40.039896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.264449+0000","last_change":"2024-03-07T10:24:30.264502+0000","last_active":"2024-03-07T10:24:30.264449+0000","last_peered":"2024-03-07T10:24:30.264449+0000","last_clean":"2024-03-07T10:24:30.264449+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:24:30.264449+0000","last_undegraded":"2024-03-07T10:24:30.264449+0000","last_fullsized":"2024-03-07T10:24:30.264449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.264240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.264240+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.264240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:07.591361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.082279+0000","last_change":"2024-03-07T10:24:21.082343+0000","last_active":"2024-03-07T10:24:21.082279+0000","last_peered":"2024-03-07T10:24:21.082279+0000","last_clean":"2024-03-07T10:24:21.082279+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:21.082279+0000","last_undegraded":"2024-03-07T10:24:21.082279+0000","last_fullsized":"2024-03-07T10:24:21.082279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:21.082014+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:21.082014+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.082014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:21:07.255204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047825+0000","last_change":"2024-03-07T10:21:09.303460+0000","last_active":"2024-03-07T10:23:58.047825+0000","last_peered":"2024-03-07T10:23:58.047825+0000","last_clean":"2024-03-07T10:23:58.047825+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:23:58.047825+0000","last_undegraded":"2024-03-07T10:23:58.047825+0000","last_fullsized":"2024-03-07T10:23:58.047825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.223509+0000","last_change":"2024-03-07T10:24:30.223578+0000","last_active":"2024-03-07T10:24:30.223509+0000","last_peered":"2024-03-07T10:24:30.223509+0000","last_clean":"2024-03-07T10:24:30.223509+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:30.223509+0000","last_undegraded":"2024-03-07T10:24:30.223509+0000","last_fullsized":"2024-03-07T10:24:30.223509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-03-07T10:24:30.223314+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-03-07T10:24:30.223314+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.223314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:36:38.101575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.150871+0000","last_change":"2024-03-07T10:24:26.150969+0000","last_active":"2024-03-07T10:24:26.150871+0000","last_peered":"2024-03-07T10:24:26.150871+0000","last_clean":"2024-03-07T10:24:26.150871+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:24:26.150871+0000","last_undegraded":"2024-03-07T10:24:26.150871+0000","last_fullsized":"2024-03-07T10:24:26.150871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.150688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.150688+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.150688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:10.221593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.403513+0000","last_change":"2024-03-07T10:24:24.403568+0000","last_active":"2024-03-07T10:24:24.403513+0000","last_peered":"2024-03-07T10:24:24.403513+0000","last_clean":"2024-03-07T10:24:24.403513+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:24.403513+0000","last_undegraded":"2024-03-07T10:24:24.403513+0000","last_fullsized":"2024-03-07T10:24:24.403513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:24.403348+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:24.403348+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.403348+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:03.306897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.020221+0000","last_change":"2024-03-07T10:21:09.310686+0000","last_active":"2024-03-07T10:23:58.020221+0000","last_peered":"2024-03-07T10:23:58.020221+0000","last_clean":"2024-03-07T10:23:58.020221+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:23:58.020221+0000","last_undegraded":"2024-03-07T10:23:58.020221+0000","last_fullsized":"2024-03-07T10:23:58.020221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.664057+0000","last_change":"2024-03-07T10:24:22.664120+0000","last_active":"2024-03-07T10:24:22.664057+0000","last_peered":"2024-03-07T10:24:22.664057+0000","last_clean":"2024-03-07T10:24:22.664057+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:22.664057+0000","last_undegraded":"2024-03-07T10:24:22.664057+0000","last_fullsized":"2024-03-07T10:24:22.664057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:22.663866+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:22.663866+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.663866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:56:53.827921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.204257+0000","last_change":"2024-03-07T10:24:36.204313+0000","last_active":"2024-03-07T10:24:36.204257+0000","last_peered":"2024-03-07T10:24:36.204257+0000","last_clean":"2024-03-07T10:24:36.204257+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:24:36.204257+0000","last_undegraded":"2024-03-07T10:24:36.204257+0000","last_fullsized":"2024-03-07T10:24:36.204257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.204064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.204064+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.204064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:16.509777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:05.912336+0000","last_change":"2024-03-07T10:20:58.144090+0000","last_active":"2024-03-07T10:24:05.912336+0000","last_peered":"2024-03-07T10:24:05.912336+0000","last_clean":"2024-03-07T10:24:05.912336+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:05.912336+0000","last_undegraded":"2024-03-07T10:24:05.912336+0000","last_fullsized":"2024-03-07T10:24:05.912336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:20:57.110628+0000","last_clean_scrub_stamp":"2024-03-07T10:20:57.110628+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.355009+0000","last_change":"2024-03-07T10:24:34.355060+0000","last_active":"2024-03-07T10:24:34.355009+0000","last_peered":"2024-03-07T10:24:34.355009+0000","last_clean":"2024-03-07T10:24:34.355009+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:24:34.355009+0000","last_undegraded":"2024-03-07T10:24:34.355009+0000","last_fullsized":"2024-03-07T10:24:34.355009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.354802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.354802+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.354802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:50:48.356285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.165239+0000","last_change":"2024-03-07T10:24:33.165300+0000","last_active":"2024-03-07T10:24:33.165239+0000","last_peered":"2024-03-07T10:24:33.165239+0000","last_clean":"2024-03-07T10:24:33.165239+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:33.165239+0000","last_undegraded":"2024-03-07T10:24:33.165239+0000","last_fullsized":"2024-03-07T10:24:33.165239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:33.165015+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:33.165015+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.165015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:24.493619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.027203+0000","last_change":"2024-03-07T10:21:09.317291+0000","last_active":"2024-03-07T10:23:58.027203+0000","last_peered":"2024-03-07T10:23:58.027203+0000","last_clean":"2024-03-07T10:23:58.027203+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:23:58.027203+0000","last_undegraded":"2024-03-07T10:23:58.027203+0000","last_fullsized":"2024-03-07T10:23:58.027203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.376995+0000","last_change":"2024-03-07T10:24:23.377074+0000","last_active":"2024-03-07T10:24:23.376995+0000","last_peered":"2024-03-07T10:24:23.376995+0000","last_clean":"2024-03-07T10:24:23.376995+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:23.376995+0000","last_undegraded":"2024-03-07T10:24:23.376995+0000","last_fullsized":"2024-03-07T10:24:23.376995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:23.376803+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:23.376803+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.376803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:33.691262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.015302+0000","last_change":"2024-03-07T10:21:09.299774+0000","last_active":"2024-03-07T10:23:58.015302+0000","last_peered":"2024-03-07T10:23:58.015302+0000","last_clean":"2024-03-07T10:23:58.015302+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:23:58.015302+0000","last_undegraded":"2024-03-07T10:23:58.015302+0000","last_fullsized":"2024-03-07T10:23:58.015302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.194782+0000","last_change":"2024-03-07T10:24:27.194840+0000","last_active":"2024-03-07T10:24:27.194782+0000","last_peered":"2024-03-07T10:24:27.194782+0000","last_clean":"2024-03-07T10:24:27.194782+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:27.194782+0000","last_undegraded":"2024-03-07T10:24:27.194782+0000","last_fullsized":"2024-03-07T10:24:27.194782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:27.194547+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:27.194547+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.194547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:43.354960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.214915+0000","last_change":"2024-03-07T10:24:26.215000+0000","last_active":"2024-03-07T10:24:26.214915+0000","last_peered":"2024-03-07T10:24:26.214915+0000","last_clean":"2024-03-07T10:24:26.214915+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:24:26.214915+0000","last_undegraded":"2024-03-07T10:24:26.214915+0000","last_fullsized":"2024-03-07T10:24:26.214915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.214669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.214669+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.214669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:34.012522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.839756+0000","last_change":"2024-03-07T10:24:21.839824+0000","last_active":"2024-03-07T10:24:21.839756+0000","last_peered":"2024-03-07T10:24:21.839756+0000","last_clean":"2024-03-07T10:24:21.839756+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:21.839756+0000","last_undegraded":"2024-03-07T10:24:21.839756+0000","last_fullsized":"2024-03-07T10:24:21.839756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:21.839562+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:21.839562+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.839562+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:29.637414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:23:58.047201+0000","last_change":"2024-03-07T10:21:09.316341+0000","last_active":"2024-03-07T10:23:58.047201+0000","last_peered":"2024-03-07T10:23:58.047201+0000","last_clean":"2024-03-07T10:23:58.047201+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:23:58.047201+0000","last_undegraded":"2024-03-07T10:23:58.047201+0000","last_fullsized":"2024-03-07T10:23:58.047201+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:21:08.240612+0000","last_clean_scrub_stamp":"2024-03-07T10:21:08.240612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.240509+0000","last_change":"2024-03-07T10:24:31.240580+0000","last_active":"2024-03-07T10:24:31.240509+0000","last_peered":"2024-03-07T10:24:31.240509+0000","last_clean":"2024-03-07T10:24:31.240509+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:31.240509+0000","last_undegraded":"2024-03-07T10:24:31.240509+0000","last_fullsized":"2024-03-07T10:24:31.240509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:31.240315+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:31.240315+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.240315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:21.731725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.381999+0000","last_change":"2024-03-07T10:24:28.382081+0000","last_active":"2024-03-07T10:24:28.381999+0000","last_peered":"2024-03-07T10:24:28.381999+0000","last_clean":"2024-03-07T10:24:28.381999+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:24:28.381999+0000","last_undegraded":"2024-03-07T10:24:28.381999+0000","last_fullsized":"2024-03-07T10:24:28.381999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.381797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.381797+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.381797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:14.454373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.371263+0000","last_change":"2024-03-07T10:24:19.371320+0000","last_active":"2024-03-07T10:24:19.371263+0000","last_peered":"2024-03-07T10:24:19.371263+0000","last_clean":"2024-03-07T10:24:19.371263+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:19.371263+0000","last_undegraded":"2024-03-07T10:24:19.371263+0000","last_fullsized":"2024-03-07T10:24:19.371263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:19.371028+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:19.371028+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.371028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:34.114208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":44910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":158,"num_read_kb":200,"num_write":101,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":89820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":134994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":216505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.243 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-03-07T10:20:56.096590+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=56, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.244 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.244 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.244 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.244 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.244 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.245 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.245 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.245 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.245 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.245 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.246 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.247 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-07T10:20:57.110628+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=20, tm_sec=57, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.248 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.249 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.249 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-03-07T10:21:08.240612+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=21, tm_sec=8, tm_wday=3, tm_yday=67, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=7, tm_hour=10, tm_min=24, tm_sec=11, tm_wday=3, tm_yday=67, tm_isdst=0) 2024-03-07T10:24:40.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-07T10:24:48.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:24:48.781 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:25:00.250 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-07T10:25:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.461+0000 7fcf12a00640 1 Processor -- start 2024-03-07T10:25:00.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.461+0000 7fcf12a00640 1 -- start start 2024-03-07T10:25:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.462+0000 7fcf12a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf0c14f240 0x7fcf0c06c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf12a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 0x7fcf0c151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf12a00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 0x7fcf0c152230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf12a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0a8e00 con 0x7fcf0c14f240 2024-03-07T10:25:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf12a00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf0c0a90a0 con 0x7fcf0c0c2630 2024-03-07T10:25:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf12a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c0c2c80 con 0x7fcf0c06fbf0 2024-03-07T10:25:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf0c14f240 0x7fcf0c06c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf0c14f240 0x7fcf0c06c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51246/0 (socket says 172.21.15.194:51246) 2024-03-07T10:25:00.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 -- 172.21.15.194:0/4134780061 learned_addr learned my addr 172.21.15.194:0/4134780061 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0b400640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 0x7fcf0c151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf10a00640 1 --2- 172.21.15.194:0/4134780061 >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 0x7fcf0c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 -- 172.21.15.194:0/4134780061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 msgr2=0x7fcf0c151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 0x7fcf0c151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 -- 172.21.15.194:0/4134780061 >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 msgr2=0x7fcf0c152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4134780061 >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 0x7fcf0c152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0be00640 1 -- 172.21.15.194:0/4134780061 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c14f620 con 0x7fcf0c14f240 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf0b400640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 0x7fcf0c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.463+0000 7fcf10a00640 1 --2- 172.21.15.194:0/4134780061 >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 0x7fcf0c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c14f240 0x7fcf0c06c090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c071250 tx=0x7fcefc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88208527fd8c4cbd server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf0aa00640 1 -- 172.21.15.194:0/4134780061 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc038070 con 0x7fcf0c14f240 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf0aa00640 1 -- 172.21.15.194:0/4134780061 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcefc02f050 con 0x7fcf0c14f240 2024-03-07T10:25:00.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf0aa00640 1 -- 172.21.15.194:0/4134780061 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc031970 con 0x7fcf0c14f240 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf12a00640 1 -- 172.21.15.194:0/4134780061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c14f240 msgr2=0x7fcf0c06c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.465+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c14f240 0x7fcf0c06c090 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c071250 tx=0x7fcefc02b7f0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 -- 172.21.15.194:0/4134780061 shutdown_connections 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4134780061 >> v2:172.21.15.196:3300/0 conn(0x7fcf0c0c2630 0x7fcf0c152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c06fbf0 0x7fcf0c151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4134780061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c14f240 0x7fcf0c06c090 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 -- 172.21.15.194:0/4134780061 >> 172.21.15.194:0/4134780061 conn(0x7fcf0c0c41a0 msgr2=0x7fcf0c0c4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:00.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 -- 172.21.15.194:0/4134780061 shutdown_connections 2024-03-07T10:25:00.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.466+0000 7fcf12a00640 1 -- 172.21.15.194:0/4134780061 wait complete. 2024-03-07T10:25:00.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.467+0000 7fcf12a00640 1 Processor -- start 2024-03-07T10:25:00.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.467+0000 7fcf12a00640 1 -- start start 2024-03-07T10:25:00.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0c0c2630 0x7fcf0c0ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c14f240 0x7fcf0c0ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06c750 con 0x7fcf0c155bb0 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06c5d0 con 0x7fcf0c0c2630 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.468+0000 7fcf12a00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0c06c8d0 con 0x7fcf0c14f240 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51260/0 (socket says 172.21.15.194:51260) 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 -- 172.21.15.194:0/4097971938 learned_addr learned my addr 172.21.15.194:0/4097971938 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0c0c2630 0x7fcf0c0ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf0b400640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c14f240 0x7fcf0c0ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 -- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c14f240 msgr2=0x7fcf0c0ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c14f240 0x7fcf0c0ace60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 -- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0c0c2630 msgr2=0x7fcf0c0ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0c0c2630 0x7fcf0c0ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.469+0000 7fcf10a00640 1 -- 172.21.15.194:0/4097971938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c06e590 con 0x7fcf0c155bb0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf10a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400cd40 tx=0x7fcf0400a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400f610 con 0x7fcf0c155bb0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0400f7b0 con 0x7fcf0c155bb0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0400fb80 con 0x7fcf0c155bb0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf0c06e870 con 0x7fcf0c155bb0 2024-03-07T10:25:00.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.470+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf0c0ab790 con 0x7fcf0c155bb0 2024-03-07T10:25:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.471+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf0c068170 con 0x7fcf0c155bb0 2024-03-07T10:25:00.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.472+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fcf040213a0 con 0x7fcf0c155bb0 2024-03-07T10:25:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.474+0000 7fcf03e00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 0x7fceec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.474+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fcf0408b170 con 0x7fcf0c155bb0 2024-03-07T10:25:00.475 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.474+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 0x7fceec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.476 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.475+0000 7fcf0be00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 0x7fceec06d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcefc035000 tx=0x7fcefc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.479 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.478+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fcf04014030 con 0x7fcf0c155bb0 2024-03-07T10:25:00.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.671+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 --> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf0c0c20a0 con 0x7fceec06b4d0 2024-03-07T10:25:00.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.706+0000 7fcf03e00640 1 -- 172.21.15.194:0/4097971938 <== mgr.4100 v2:172.21.15.196:6832/3213558195 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+490771 (secure 0 0 0) 0x7fcf0c0c20a0 con 0x7fceec06b4d0 2024-03-07T10:25:00.713 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:00.717 INFO:teuthology.orchestra.run.smithi194.stderr:dumped all 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.711+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 msgr2=0x7fceec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.711+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 0x7fceec06d990 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcefc035000 tx=0x7fcefc008030 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.711+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 msgr2=0x7fcf0c1eb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.711+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcf0400cd40 tx=0x7fcf0400a5e0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 shutdown_connections 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fceec06b4d0 0x7fceec06d990 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf0c155bb0 0x7fcf0c1eb940 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fcf0c14f240 0x7fcf0c0ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 --2- 172.21.15.194:0/4097971938 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fcf0c0c2630 0x7fcf0c0ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 >> 172.21.15.194:0/4097971938 conn(0x7fcf0c0c41a0 msgr2=0x7fcf0c14ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:00.719 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 shutdown_connections 2024-03-07T10:25:00.720 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.712+0000 7fcf12a00640 1 -- 172.21.15.194:0/4097971938 wait complete. 2024-03-07T10:25:00.731 INFO:teuthology.orchestra.run.smithi194.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-03-07T10:25:00.513601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":674491,"num_objects":48,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":354,"num_read_kb":388,"num_write":353,"num_write_kb":2577,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":860,"ondisk_log_size":860,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224208,"kb_used_data":3920,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750512,"statfs":{"total":773094113280,"available":772864524288,"internally_reserved":0,"allocated":4014080,"data_stored":2423862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005789"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.613797+0000","last_change":"2024-03-07T10:24:35.613855+0000","last_active":"2024-03-07T10:24:35.613797+0000","last_peered":"2024-03-07T10:24:35.613797+0000","last_clean":"2024-03-07T10:24:35.613797+0000","last_became_active":"2024-03-07T10:21:09.302837+0000","last_became_peered":"2024-03-07T10:21:09.302837+0000","last_unstale":"2024-03-07T10:24:35.613797+0000","last_undegraded":"2024-03-07T10:24:35.613797+0000","last_fullsized":"2024-03-07T10:24:35.613797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.613547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.613547+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.613547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:22.241083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"29'7","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.903340+0000","last_change":"2024-03-07T10:24:19.903430+0000","last_active":"2024-03-07T10:24:19.903340+0000","last_peered":"2024-03-07T10:24:19.903340+0000","last_clean":"2024-03-07T10:24:19.903340+0000","last_became_active":"2024-03-07T10:20:57.161324+0000","last_became_peered":"2024-03-07T10:20:57.161324+0000","last_unstale":"2024-03-07T10:24:19.903340+0000","last_undegraded":"2024-03-07T10:24:19.903340+0000","last_fullsized":"2024-03-07T10:24:19.903340+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:19.903087+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:19.903087+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.903087+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:12.221811+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.617279+0000","last_change":"2024-03-07T10:24:20.617342+0000","last_active":"2024-03-07T10:24:20.617279+0000","last_peered":"2024-03-07T10:24:20.617279+0000","last_clean":"2024-03-07T10:24:20.617279+0000","last_became_active":"2024-03-07T10:20:58.165968+0000","last_became_peered":"2024-03-07T10:20:58.165968+0000","last_unstale":"2024-03-07T10:24:20.617279+0000","last_undegraded":"2024-03-07T10:24:20.617279+0000","last_fullsized":"2024-03-07T10:24:20.617279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:20.617095+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:20.617095+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.617095+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:30.931553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.635573+0000","last_change":"2024-03-07T10:24:18.635607+0000","last_active":"2024-03-07T10:24:18.635573+0000","last_peered":"2024-03-07T10:24:18.635573+0000","last_clean":"2024-03-07T10:24:18.635573+0000","last_became_active":"2024-03-07T10:21:08.267214+0000","last_became_peered":"2024-03-07T10:21:08.267214+0000","last_unstale":"2024-03-07T10:24:18.635573+0000","last_undegraded":"2024-03-07T10:24:18.635573+0000","last_fullsized":"2024-03-07T10:24:18.635573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:18.635440+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:18.635440+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.635440+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:07:28.554825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.312005+0000","last_change":"2024-03-07T10:24:33.312062+0000","last_active":"2024-03-07T10:24:33.312005+0000","last_peered":"2024-03-07T10:24:33.312005+0000","last_clean":"2024-03-07T10:24:33.312005+0000","last_became_active":"2024-03-07T10:21:09.306544+0000","last_became_peered":"2024-03-07T10:21:09.306544+0000","last_unstale":"2024-03-07T10:24:33.312005+0000","last_undegraded":"2024-03-07T10:24:33.312005+0000","last_fullsized":"2024-03-07T10:24:33.312005+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.311760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.311760+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.311760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:55:32.570083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"28'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.605444+0000","last_change":"2024-03-07T10:24:32.605444+0000","last_active":"2024-03-07T10:24:32.605444+0000","last_peered":"2024-03-07T10:24:32.605444+0000","last_clean":"2024-03-07T10:24:32.605444+0000","last_became_active":"2024-03-07T10:20:57.151796+0000","last_became_peered":"2024-03-07T10:20:57.151796+0000","last_unstale":"2024-03-07T10:24:32.605444+0000","last_undegraded":"2024-03-07T10:24:32.605444+0000","last_fullsized":"2024-03-07T10:24:32.605444+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:32.605182+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:32.605182+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.605182+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:32.745693+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.836967+0000","last_change":"2024-03-07T10:24:17.837129+0000","last_active":"2024-03-07T10:24:17.836967+0000","last_peered":"2024-03-07T10:24:17.836967+0000","last_clean":"2024-03-07T10:24:17.836967+0000","last_became_active":"2024-03-07T10:20:58.163764+0000","last_became_peered":"2024-03-07T10:20:58.163764+0000","last_unstale":"2024-03-07T10:24:17.836967+0000","last_undegraded":"2024-03-07T10:24:17.836967+0000","last_fullsized":"2024-03-07T10:24:17.836967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:17.836720+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:17.836720+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.836720+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:23:47.650479+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.649199+0000","last_change":"2024-03-07T10:24:23.649251+0000","last_active":"2024-03-07T10:24:23.649199+0000","last_peered":"2024-03-07T10:24:23.649199+0000","last_clean":"2024-03-07T10:24:23.649199+0000","last_became_active":"2024-03-07T10:21:08.275558+0000","last_became_peered":"2024-03-07T10:21:08.275558+0000","last_unstale":"2024-03-07T10:24:23.649199+0000","last_undegraded":"2024-03-07T10:24:23.649199+0000","last_fullsized":"2024-03-07T10:24:23.649199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:23.648976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:23.648976+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.648976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:28.960981+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:44.415632+0000","last_change":"2024-03-07T10:24:44.415684+0000","last_active":"2024-03-07T10:24:44.415632+0000","last_peered":"2024-03-07T10:24:44.415632+0000","last_clean":"2024-03-07T10:24:44.415632+0000","last_became_active":"2024-03-07T10:21:09.311352+0000","last_became_peered":"2024-03-07T10:21:09.311352+0000","last_unstale":"2024-03-07T10:24:44.415632+0000","last_undegraded":"2024-03-07T10:24:44.415632+0000","last_fullsized":"2024-03-07T10:24:44.415632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:44.415437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:44.415437+0000","last_clean_scrub_stamp":"2024-03-07T10:24:44.415437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:07:01.899231+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.435021+0000","last_change":"2024-03-07T10:24:36.435181+0000","last_active":"2024-03-07T10:24:36.435021+0000","last_peered":"2024-03-07T10:24:36.435021+0000","last_clean":"2024-03-07T10:24:36.435021+0000","last_became_active":"2024-03-07T10:20:57.166013+0000","last_became_peered":"2024-03-07T10:20:57.166013+0000","last_unstale":"2024-03-07T10:24:36.435021+0000","last_undegraded":"2024-03-07T10:24:36.435021+0000","last_fullsized":"2024-03-07T10:24:36.435021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:36.434787+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:36.434787+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.434787+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:03.719600+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.055344+0000","last_change":"2024-03-07T10:24:21.055409+0000","last_active":"2024-03-07T10:24:21.055344+0000","last_peered":"2024-03-07T10:24:21.055344+0000","last_clean":"2024-03-07T10:24:21.055344+0000","last_became_active":"2024-03-07T10:20:58.162980+0000","last_became_peered":"2024-03-07T10:20:58.162980+0000","last_unstale":"2024-03-07T10:24:21.055344+0000","last_undegraded":"2024-03-07T10:24:21.055344+0000","last_fullsized":"2024-03-07T10:24:21.055344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:21.055203+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:21.055203+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.055203+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:07:30.974589+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.649014+0000","last_change":"2024-03-07T10:24:31.649103+0000","last_active":"2024-03-07T10:24:31.649014+0000","last_peered":"2024-03-07T10:24:31.649014+0000","last_clean":"2024-03-07T10:24:31.649014+0000","last_became_active":"2024-03-07T10:21:08.268260+0000","last_became_peered":"2024-03-07T10:21:08.268260+0000","last_unstale":"2024-03-07T10:24:31.649014+0000","last_undegraded":"2024-03-07T10:24:31.649014+0000","last_fullsized":"2024-03-07T10:24:31.649014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:31.648840+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:31.648840+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.648840+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:17.973743+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.114426+0000","last_change":"2024-03-07T10:24:37.114480+0000","last_active":"2024-03-07T10:24:37.114426+0000","last_peered":"2024-03-07T10:24:37.114426+0000","last_clean":"2024-03-07T10:24:37.114426+0000","last_became_active":"2024-03-07T10:21:09.305816+0000","last_became_peered":"2024-03-07T10:21:09.305816+0000","last_unstale":"2024-03-07T10:24:37.114426+0000","last_undegraded":"2024-03-07T10:24:37.114426+0000","last_fullsized":"2024-03-07T10:24:37.114426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:37.114260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:37.114260+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.114260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:22.431718+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.428982+0000","last_change":"2024-03-07T10:24:38.429088+0000","last_active":"2024-03-07T10:24:38.428982+0000","last_peered":"2024-03-07T10:24:38.428982+0000","last_clean":"2024-03-07T10:24:38.428982+0000","last_became_active":"2024-03-07T10:20:57.172654+0000","last_became_peered":"2024-03-07T10:20:57.172654+0000","last_unstale":"2024-03-07T10:24:38.428982+0000","last_undegraded":"2024-03-07T10:24:38.428982+0000","last_fullsized":"2024-03-07T10:24:38.428982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:38.428785+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:38.428785+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.428785+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:14:29.189428+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.072790+0000","last_change":"2024-03-07T10:24:23.072868+0000","last_active":"2024-03-07T10:24:23.072790+0000","last_peered":"2024-03-07T10:24:23.072790+0000","last_clean":"2024-03-07T10:24:23.072790+0000","last_became_active":"2024-03-07T10:20:58.152775+0000","last_became_peered":"2024-03-07T10:20:58.152775+0000","last_unstale":"2024-03-07T10:24:23.072790+0000","last_undegraded":"2024-03-07T10:24:23.072790+0000","last_fullsized":"2024-03-07T10:24:23.072790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:23.072576+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:23.072576+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.072576+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:33.387035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.682618+0000","last_change":"2024-03-07T10:24:30.682680+0000","last_active":"2024-03-07T10:24:30.682618+0000","last_peered":"2024-03-07T10:24:30.682618+0000","last_clean":"2024-03-07T10:24:30.682618+0000","last_became_active":"2024-03-07T10:21:08.264443+0000","last_became_peered":"2024-03-07T10:21:08.264443+0000","last_unstale":"2024-03-07T10:24:30.682618+0000","last_undegraded":"2024-03-07T10:24:30.682618+0000","last_fullsized":"2024-03-07T10:24:30.682618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:30.682446+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:30.682446+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.682446+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:09.585995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.307081+0000","last_change":"2024-03-07T10:24:35.307154+0000","last_active":"2024-03-07T10:24:35.307081+0000","last_peered":"2024-03-07T10:24:35.307081+0000","last_clean":"2024-03-07T10:24:35.307081+0000","last_became_active":"2024-03-07T10:21:09.315606+0000","last_became_peered":"2024-03-07T10:21:09.315606+0000","last_unstale":"2024-03-07T10:24:35.307081+0000","last_undegraded":"2024-03-07T10:24:35.307081+0000","last_fullsized":"2024-03-07T10:24:35.307081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.306891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.306891+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.306891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:28:04.073013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.100760+0000","last_change":"2024-03-07T10:24:19.100859+0000","last_active":"2024-03-07T10:24:19.100760+0000","last_peered":"2024-03-07T10:24:19.100760+0000","last_clean":"2024-03-07T10:24:19.100760+0000","last_became_active":"2024-03-07T10:20:58.161750+0000","last_became_peered":"2024-03-07T10:20:58.161750+0000","last_unstale":"2024-03-07T10:24:19.100760+0000","last_undegraded":"2024-03-07T10:24:19.100760+0000","last_fullsized":"2024-03-07T10:24:19.100760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.100537+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.100537+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.100537+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:43:37.181522+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.444615+0000","last_change":"2024-03-07T10:24:34.444684+0000","last_active":"2024-03-07T10:24:34.444615+0000","last_peered":"2024-03-07T10:24:34.444615+0000","last_clean":"2024-03-07T10:24:34.444615+0000","last_became_active":"2024-03-07T10:20:57.163727+0000","last_became_peered":"2024-03-07T10:20:57.163727+0000","last_unstale":"2024-03-07T10:24:34.444615+0000","last_undegraded":"2024-03-07T10:24:34.444615+0000","last_fullsized":"2024-03-07T10:24:34.444615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:34.444435+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:34.444435+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.444435+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:51.425330+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.572921+0000","last_change":"2024-03-07T10:24:17.572985+0000","last_active":"2024-03-07T10:24:17.572921+0000","last_peered":"2024-03-07T10:24:17.572921+0000","last_clean":"2024-03-07T10:24:17.572921+0000","last_became_active":"2024-03-07T10:21:08.279612+0000","last_became_peered":"2024-03-07T10:21:08.279612+0000","last_unstale":"2024-03-07T10:24:17.572921+0000","last_undegraded":"2024-03-07T10:24:17.572921+0000","last_fullsized":"2024-03-07T10:24:17.572921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:17.572756+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:17.572756+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.572756+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:16:46.378457+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.176195+0000","last_change":"2024-03-07T10:24:28.176249+0000","last_active":"2024-03-07T10:24:28.176195+0000","last_peered":"2024-03-07T10:24:28.176195+0000","last_clean":"2024-03-07T10:24:28.176195+0000","last_became_active":"2024-03-07T10:21:09.309552+0000","last_became_peered":"2024-03-07T10:21:09.309552+0000","last_unstale":"2024-03-07T10:24:28.176195+0000","last_undegraded":"2024-03-07T10:24:28.176195+0000","last_fullsized":"2024-03-07T10:24:28.176195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.176001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.176001+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.176001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:36.797759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.598807+0000","last_change":"2024-03-07T10:24:35.598889+0000","last_active":"2024-03-07T10:24:35.598807+0000","last_peered":"2024-03-07T10:24:35.598807+0000","last_clean":"2024-03-07T10:24:35.598807+0000","last_became_active":"2024-03-07T10:20:58.151340+0000","last_became_peered":"2024-03-07T10:20:58.151340+0000","last_unstale":"2024-03-07T10:24:35.598807+0000","last_undegraded":"2024-03-07T10:24:35.598807+0000","last_fullsized":"2024-03-07T10:24:35.598807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:35.598609+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:35.598609+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.598609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:14:26.359253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.243943+0000","last_change":"2024-03-07T10:24:25.243995+0000","last_active":"2024-03-07T10:24:25.243943+0000","last_peered":"2024-03-07T10:24:25.243943+0000","last_clean":"2024-03-07T10:24:25.243943+0000","last_became_active":"2024-03-07T10:20:57.152561+0000","last_became_peered":"2024-03-07T10:20:57.152561+0000","last_unstale":"2024-03-07T10:24:25.243943+0000","last_undegraded":"2024-03-07T10:24:25.243943+0000","last_fullsized":"2024-03-07T10:24:25.243943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.243691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.243691+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.243691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:50.116146+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.577457+0000","last_change":"2024-03-07T10:24:20.577513+0000","last_active":"2024-03-07T10:24:20.577457+0000","last_peered":"2024-03-07T10:24:20.577457+0000","last_clean":"2024-03-07T10:24:20.577457+0000","last_became_active":"2024-03-07T10:21:08.282366+0000","last_became_peered":"2024-03-07T10:21:08.282366+0000","last_unstale":"2024-03-07T10:24:20.577457+0000","last_undegraded":"2024-03-07T10:24:20.577457+0000","last_fullsized":"2024-03-07T10:24:20.577457+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:20.577284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:20.577284+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.577284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:29.295770+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.648627+0000","last_change":"2024-03-07T10:24:37.648730+0000","last_active":"2024-03-07T10:24:37.648627+0000","last_peered":"2024-03-07T10:24:37.648627+0000","last_clean":"2024-03-07T10:24:37.648627+0000","last_became_active":"2024-03-07T10:21:09.305168+0000","last_became_peered":"2024-03-07T10:21:09.305168+0000","last_unstale":"2024-03-07T10:24:37.648627+0000","last_undegraded":"2024-03-07T10:24:37.648627+0000","last_fullsized":"2024-03-07T10:24:37.648627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:37.648404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:37.648404+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.648404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:38.159422+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.650702+0000","last_change":"2024-03-07T10:24:26.650768+0000","last_active":"2024-03-07T10:24:26.650702+0000","last_peered":"2024-03-07T10:24:26.650702+0000","last_clean":"2024-03-07T10:24:26.650702+0000","last_became_active":"2024-03-07T10:20:58.160915+0000","last_became_peered":"2024-03-07T10:20:58.160915+0000","last_unstale":"2024-03-07T10:24:26.650702+0000","last_undegraded":"2024-03-07T10:24:26.650702+0000","last_fullsized":"2024-03-07T10:24:26.650702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:26.650539+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:26.650539+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.650539+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:17.141949+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.264506+0000","last_change":"2024-03-07T10:24:26.264635+0000","last_active":"2024-03-07T10:24:26.264506+0000","last_peered":"2024-03-07T10:24:26.264506+0000","last_clean":"2024-03-07T10:24:26.264506+0000","last_became_active":"2024-03-07T10:20:57.153184+0000","last_became_peered":"2024-03-07T10:20:57.153184+0000","last_unstale":"2024-03-07T10:24:26.264506+0000","last_undegraded":"2024-03-07T10:24:26.264506+0000","last_fullsized":"2024-03-07T10:24:26.264506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.264284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.264284+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.264284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:26:42.775427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.144215+0000","last_change":"2024-03-07T10:24:17.144266+0000","last_active":"2024-03-07T10:24:17.144215+0000","last_peered":"2024-03-07T10:24:17.144215+0000","last_clean":"2024-03-07T10:24:17.144215+0000","last_became_active":"2024-03-07T10:21:08.284870+0000","last_became_peered":"2024-03-07T10:21:08.284870+0000","last_unstale":"2024-03-07T10:24:17.144215+0000","last_undegraded":"2024-03-07T10:24:17.144215+0000","last_fullsized":"2024-03-07T10:24:17.144215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:17.144061+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:17.144061+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.144061+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:15.766733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.108879+0000","last_change":"2024-03-07T10:24:38.108935+0000","last_active":"2024-03-07T10:24:38.108879+0000","last_peered":"2024-03-07T10:24:38.108879+0000","last_clean":"2024-03-07T10:24:38.108879+0000","last_became_active":"2024-03-07T10:21:09.307708+0000","last_became_peered":"2024-03-07T10:21:09.307708+0000","last_unstale":"2024-03-07T10:24:38.108879+0000","last_undegraded":"2024-03-07T10:24:38.108879+0000","last_fullsized":"2024-03-07T10:24:38.108879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:38.108668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:38.108668+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.108668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:14:28.869311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.726377+0000","last_change":"2024-03-07T10:24:27.726437+0000","last_active":"2024-03-07T10:24:27.726377+0000","last_peered":"2024-03-07T10:24:27.726377+0000","last_clean":"2024-03-07T10:24:27.726377+0000","last_became_active":"2024-03-07T10:20:58.155519+0000","last_became_peered":"2024-03-07T10:20:58.155519+0000","last_unstale":"2024-03-07T10:24:27.726377+0000","last_undegraded":"2024-03-07T10:24:27.726377+0000","last_fullsized":"2024-03-07T10:24:27.726377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:27.726183+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:27.726183+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.726183+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:53.378474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.471009+0000","last_change":"2024-03-07T10:24:37.471094+0000","last_active":"2024-03-07T10:24:37.471009+0000","last_peered":"2024-03-07T10:24:37.471009+0000","last_clean":"2024-03-07T10:24:37.471009+0000","last_became_active":"2024-03-07T10:20:57.168677+0000","last_became_peered":"2024-03-07T10:20:57.168677+0000","last_unstale":"2024-03-07T10:24:37.471009+0000","last_undegraded":"2024-03-07T10:24:37.471009+0000","last_fullsized":"2024-03-07T10:24:37.471009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:37.470815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:37.470815+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.470815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:22.788273+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.582797+0000","last_change":"2024-03-07T10:24:19.582862+0000","last_active":"2024-03-07T10:24:19.582797+0000","last_peered":"2024-03-07T10:24:19.582797+0000","last_clean":"2024-03-07T10:24:19.582797+0000","last_became_active":"2024-03-07T10:21:08.277187+0000","last_became_peered":"2024-03-07T10:21:08.277187+0000","last_unstale":"2024-03-07T10:24:19.582797+0000","last_undegraded":"2024-03-07T10:24:19.582797+0000","last_fullsized":"2024-03-07T10:24:19.582797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:19.582625+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:19.582625+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.582625+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:11.843151+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:42.549287+0000","last_change":"2024-03-07T10:24:42.549338+0000","last_active":"2024-03-07T10:24:42.549287+0000","last_peered":"2024-03-07T10:24:42.549287+0000","last_clean":"2024-03-07T10:24:42.549287+0000","last_became_active":"2024-03-07T10:21:09.316516+0000","last_became_peered":"2024-03-07T10:21:09.316516+0000","last_unstale":"2024-03-07T10:24:42.549287+0000","last_undegraded":"2024-03-07T10:24:42.549287+0000","last_fullsized":"2024-03-07T10:24:42.549287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:42.549070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:42.549070+0000","last_clean_scrub_stamp":"2024-03-07T10:24:42.549070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:14.034327+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.840749+0000","last_change":"2024-03-07T10:24:25.840813+0000","last_active":"2024-03-07T10:24:25.840749+0000","last_peered":"2024-03-07T10:24:25.840749+0000","last_clean":"2024-03-07T10:24:25.840749+0000","last_became_active":"2024-03-07T10:20:58.161529+0000","last_became_peered":"2024-03-07T10:20:58.161529+0000","last_unstale":"2024-03-07T10:24:25.840749+0000","last_undegraded":"2024-03-07T10:24:25.840749+0000","last_fullsized":"2024-03-07T10:24:25.840749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:25.840555+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:25.840555+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.840555+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:03.167676+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.097855+0000","last_change":"2024-03-07T10:24:24.098025+0000","last_active":"2024-03-07T10:24:24.097855+0000","last_peered":"2024-03-07T10:24:24.097855+0000","last_clean":"2024-03-07T10:24:24.097855+0000","last_became_active":"2024-03-07T10:20:57.159965+0000","last_became_peered":"2024-03-07T10:20:57.159965+0000","last_unstale":"2024-03-07T10:24:24.097855+0000","last_undegraded":"2024-03-07T10:24:24.097855+0000","last_fullsized":"2024-03-07T10:24:24.097855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:24.097624+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:24.097624+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.097624+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:16.358151+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.551955+0000","last_change":"2024-03-07T10:24:18.552001+0000","last_active":"2024-03-07T10:24:18.551955+0000","last_peered":"2024-03-07T10:24:18.551955+0000","last_clean":"2024-03-07T10:24:18.551955+0000","last_became_active":"2024-03-07T10:21:08.280306+0000","last_became_peered":"2024-03-07T10:21:08.280306+0000","last_unstale":"2024-03-07T10:24:18.551955+0000","last_undegraded":"2024-03-07T10:24:18.551955+0000","last_fullsized":"2024-03-07T10:24:18.551955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:18.551803+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:18.551803+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.551803+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:48.543077+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.610903+0000","last_change":"2024-03-07T10:24:32.610959+0000","last_active":"2024-03-07T10:24:32.610903+0000","last_peered":"2024-03-07T10:24:32.610903+0000","last_clean":"2024-03-07T10:24:32.610903+0000","last_became_active":"2024-03-07T10:21:09.298052+0000","last_became_peered":"2024-03-07T10:21:09.298052+0000","last_unstale":"2024-03-07T10:24:32.610903+0000","last_undegraded":"2024-03-07T10:24:32.610903+0000","last_fullsized":"2024-03-07T10:24:32.610903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.610660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.610660+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.610660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:16.681565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.595816+0000","last_change":"2024-03-07T10:24:36.595899+0000","last_active":"2024-03-07T10:24:36.595816+0000","last_peered":"2024-03-07T10:24:36.595816+0000","last_clean":"2024-03-07T10:24:36.595816+0000","last_became_active":"2024-03-07T10:20:58.153343+0000","last_became_peered":"2024-03-07T10:20:58.153343+0000","last_unstale":"2024-03-07T10:24:36.595816+0000","last_undegraded":"2024-03-07T10:24:36.595816+0000","last_fullsized":"2024-03-07T10:24:36.595816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:36.595609+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:36.595609+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.595609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:13.948007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"29'11","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.240552+0000","last_change":"2024-03-07T10:24:29.240668+0000","last_active":"2024-03-07T10:24:29.240552+0000","last_peered":"2024-03-07T10:24:29.240552+0000","last_clean":"2024-03-07T10:24:29.240552+0000","last_became_active":"2024-03-07T10:20:57.161982+0000","last_became_peered":"2024-03-07T10:20:57.161982+0000","last_unstale":"2024-03-07T10:24:29.240552+0000","last_undegraded":"2024-03-07T10:24:29.240552+0000","last_fullsized":"2024-03-07T10:24:29.240552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:29.240301+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:29.240301+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.240301+0000","objects_scrubbed":1,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:31:09.122841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.667615+0000","last_change":"2024-03-07T10:24:21.667675+0000","last_active":"2024-03-07T10:24:21.667615+0000","last_peered":"2024-03-07T10:24:21.667615+0000","last_clean":"2024-03-07T10:24:21.667615+0000","last_became_active":"2024-03-07T10:21:08.282763+0000","last_became_peered":"2024-03-07T10:21:08.282763+0000","last_unstale":"2024-03-07T10:24:21.667615+0000","last_undegraded":"2024-03-07T10:24:21.667615+0000","last_fullsized":"2024-03-07T10:24:21.667615+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:21.667415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:21.667415+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.667415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:00.570964+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.157086+0000","last_change":"2024-03-07T10:24:37.157139+0000","last_active":"2024-03-07T10:24:37.157086+0000","last_peered":"2024-03-07T10:24:37.157086+0000","last_clean":"2024-03-07T10:24:37.157086+0000","last_became_active":"2024-03-07T10:21:09.301922+0000","last_became_peered":"2024-03-07T10:21:09.301922+0000","last_unstale":"2024-03-07T10:24:37.157086+0000","last_undegraded":"2024-03-07T10:24:37.157086+0000","last_fullsized":"2024-03-07T10:24:37.157086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:37.156874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:37.156874+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.156874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:57:08.320929+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.273242+0000","last_change":"2024-03-07T10:24:32.273352+0000","last_active":"2024-03-07T10:24:32.273242+0000","last_peered":"2024-03-07T10:24:32.273242+0000","last_clean":"2024-03-07T10:24:32.273242+0000","last_became_active":"2024-03-07T10:20:58.159138+0000","last_became_peered":"2024-03-07T10:20:58.159138+0000","last_unstale":"2024-03-07T10:24:32.273242+0000","last_undegraded":"2024-03-07T10:24:32.273242+0000","last_fullsized":"2024-03-07T10:24:32.273242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:32.273035+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:32.273035+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.273035+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:24.162315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.447414+0000","last_change":"2024-03-07T10:24:35.447486+0000","last_active":"2024-03-07T10:24:35.447414+0000","last_peered":"2024-03-07T10:24:35.447414+0000","last_clean":"2024-03-07T10:24:35.447414+0000","last_became_active":"2024-03-07T10:20:57.165488+0000","last_became_peered":"2024-03-07T10:20:57.165488+0000","last_unstale":"2024-03-07T10:24:35.447414+0000","last_undegraded":"2024-03-07T10:24:35.447414+0000","last_fullsized":"2024-03-07T10:24:35.447414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.447182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.447182+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.447182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:35.587694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.808069+0000","last_change":"2024-03-07T10:24:28.808182+0000","last_active":"2024-03-07T10:24:28.808069+0000","last_peered":"2024-03-07T10:24:28.808069+0000","last_clean":"2024-03-07T10:24:28.808069+0000","last_became_active":"2024-03-07T10:21:08.285298+0000","last_became_peered":"2024-03-07T10:21:08.285298+0000","last_unstale":"2024-03-07T10:24:28.808069+0000","last_undegraded":"2024-03-07T10:24:28.808069+0000","last_fullsized":"2024-03-07T10:24:28.808069+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.807820+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.807820+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.807820+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:39.122278+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.780440+0000","last_change":"2024-03-07T10:24:32.780490+0000","last_active":"2024-03-07T10:24:32.780440+0000","last_peered":"2024-03-07T10:24:32.780440+0000","last_clean":"2024-03-07T10:24:32.780440+0000","last_became_active":"2024-03-07T10:21:09.308182+0000","last_became_peered":"2024-03-07T10:21:09.308182+0000","last_unstale":"2024-03-07T10:24:32.780440+0000","last_undegraded":"2024-03-07T10:24:32.780440+0000","last_fullsized":"2024-03-07T10:24:32.780440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.780264+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.780264+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.780264+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:48.940677+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.075546+0000","last_change":"2024-03-07T10:24:19.075706+0000","last_active":"2024-03-07T10:24:19.075546+0000","last_peered":"2024-03-07T10:24:19.075546+0000","last_clean":"2024-03-07T10:24:19.075546+0000","last_became_active":"2024-03-07T10:20:58.164815+0000","last_became_peered":"2024-03-07T10:20:58.164815+0000","last_unstale":"2024-03-07T10:24:19.075546+0000","last_undegraded":"2024-03-07T10:24:19.075546+0000","last_fullsized":"2024-03-07T10:24:19.075546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.075279+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.075279+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.075279+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:00:50.859925+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.263979+0000","last_change":"2024-03-07T10:24:27.264030+0000","last_active":"2024-03-07T10:24:27.263979+0000","last_peered":"2024-03-07T10:24:27.263979+0000","last_clean":"2024-03-07T10:24:27.263979+0000","last_became_active":"2024-03-07T10:20:57.158399+0000","last_became_peered":"2024-03-07T10:20:57.158399+0000","last_unstale":"2024-03-07T10:24:27.263979+0000","last_undegraded":"2024-03-07T10:24:27.263979+0000","last_fullsized":"2024-03-07T10:24:27.263979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.263771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.263771+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.263771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:13.588674+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.195810+0000","last_change":"2024-03-07T10:24:19.195865+0000","last_active":"2024-03-07T10:24:19.195810+0000","last_peered":"2024-03-07T10:24:19.195810+0000","last_clean":"2024-03-07T10:24:19.195810+0000","last_became_active":"2024-03-07T10:21:08.286639+0000","last_became_peered":"2024-03-07T10:21:08.286639+0000","last_unstale":"2024-03-07T10:24:19.195810+0000","last_undegraded":"2024-03-07T10:24:19.195810+0000","last_fullsized":"2024-03-07T10:24:19.195810+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:19.195716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:19.195716+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.195716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:24.507722+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.792631+0000","last_change":"2024-03-07T10:24:33.792689+0000","last_active":"2024-03-07T10:24:33.792631+0000","last_peered":"2024-03-07T10:24:33.792631+0000","last_clean":"2024-03-07T10:24:33.792631+0000","last_became_active":"2024-03-07T10:21:09.323015+0000","last_became_peered":"2024-03-07T10:21:09.323015+0000","last_unstale":"2024-03-07T10:24:33.792631+0000","last_undegraded":"2024-03-07T10:24:33.792631+0000","last_fullsized":"2024-03-07T10:24:33.792631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.792444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.792444+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.792444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:19.865019+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.702860+0000","last_change":"2024-03-07T10:24:26.702953+0000","last_active":"2024-03-07T10:24:26.702860+0000","last_peered":"2024-03-07T10:24:26.702860+0000","last_clean":"2024-03-07T10:24:26.702860+0000","last_became_active":"2024-03-07T10:20:58.148938+0000","last_became_peered":"2024-03-07T10:20:58.148938+0000","last_unstale":"2024-03-07T10:24:26.702860+0000","last_undegraded":"2024-03-07T10:24:26.702860+0000","last_fullsized":"2024-03-07T10:24:26.702860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:26.702650+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:26.702650+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.702650+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:04.029771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.204243+0000","last_change":"2024-03-07T10:24:30.204294+0000","last_active":"2024-03-07T10:24:30.204243+0000","last_peered":"2024-03-07T10:24:30.204243+0000","last_clean":"2024-03-07T10:24:30.204243+0000","last_became_active":"2024-03-07T10:20:57.161512+0000","last_became_peered":"2024-03-07T10:20:57.161512+0000","last_unstale":"2024-03-07T10:24:30.204243+0000","last_undegraded":"2024-03-07T10:24:30.204243+0000","last_fullsized":"2024-03-07T10:24:30.204243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.204010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.204010+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.204010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:22.093290+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.191210+0000","last_change":"2024-03-07T10:24:16.191234+0000","last_active":"2024-03-07T10:24:16.191210+0000","last_peered":"2024-03-07T10:24:16.191210+0000","last_clean":"2024-03-07T10:24:16.191210+0000","last_became_active":"2024-03-07T10:21:08.275262+0000","last_became_peered":"2024-03-07T10:21:08.275262+0000","last_unstale":"2024-03-07T10:24:16.191210+0000","last_undegraded":"2024-03-07T10:24:16.191210+0000","last_fullsized":"2024-03-07T10:24:16.191210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.191110+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.191110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:24.909595+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.216539+0000","last_change":"2024-03-07T10:24:29.216643+0000","last_active":"2024-03-07T10:24:29.216539+0000","last_peered":"2024-03-07T10:24:29.216539+0000","last_clean":"2024-03-07T10:24:29.216539+0000","last_became_active":"2024-03-07T10:21:09.312726+0000","last_became_peered":"2024-03-07T10:21:09.312726+0000","last_unstale":"2024-03-07T10:24:29.216539+0000","last_undegraded":"2024-03-07T10:24:29.216539+0000","last_fullsized":"2024-03-07T10:24:29.216539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:29.216303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:29.216303+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.216303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:43.959483+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.182725+0000","last_change":"2024-03-07T10:24:20.182822+0000","last_active":"2024-03-07T10:24:20.182725+0000","last_peered":"2024-03-07T10:24:20.182725+0000","last_clean":"2024-03-07T10:24:20.182725+0000","last_became_active":"2024-03-07T10:20:58.168310+0000","last_became_peered":"2024-03-07T10:20:58.168310+0000","last_unstale":"2024-03-07T10:24:20.182725+0000","last_undegraded":"2024-03-07T10:24:20.182725+0000","last_fullsized":"2024-03-07T10:24:20.182725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:20.182491+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:20.182491+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.182491+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:28.804248+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.082890+0000","last_change":"2024-03-07T10:24:17.082914+0000","last_active":"2024-03-07T10:24:17.082890+0000","last_peered":"2024-03-07T10:24:17.082890+0000","last_clean":"2024-03-07T10:24:17.082890+0000","last_became_active":"2024-03-07T10:20:57.153925+0000","last_became_peered":"2024-03-07T10:20:57.153925+0000","last_unstale":"2024-03-07T10:24:17.082890+0000","last_undegraded":"2024-03-07T10:24:17.082890+0000","last_fullsized":"2024-03-07T10:24:17.082890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:17.082817+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:17.082817+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.082817+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:20:47.689380+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.169223+0000","last_change":"2024-03-07T10:24:21.169289+0000","last_active":"2024-03-07T10:24:21.169223+0000","last_peered":"2024-03-07T10:24:21.169223+0000","last_clean":"2024-03-07T10:24:21.169223+0000","last_became_active":"2024-03-07T10:21:08.289316+0000","last_became_peered":"2024-03-07T10:21:08.289316+0000","last_unstale":"2024-03-07T10:24:21.169223+0000","last_undegraded":"2024-03-07T10:24:21.169223+0000","last_fullsized":"2024-03-07T10:24:21.169223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:21.169045+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:21.169045+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.169045+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:36:29.047306+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:39.079520+0000","last_change":"2024-03-07T10:24:39.079578+0000","last_active":"2024-03-07T10:24:39.079520+0000","last_peered":"2024-03-07T10:24:39.079520+0000","last_clean":"2024-03-07T10:24:39.079520+0000","last_became_active":"2024-03-07T10:21:09.315425+0000","last_became_peered":"2024-03-07T10:21:09.315425+0000","last_unstale":"2024-03-07T10:24:39.079520+0000","last_undegraded":"2024-03-07T10:24:39.079520+0000","last_fullsized":"2024-03-07T10:24:39.079520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:39.079323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:39.079323+0000","last_clean_scrub_stamp":"2024-03-07T10:24:39.079323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:16.431720+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.842611+0000","last_change":"2024-03-07T10:24:23.842669+0000","last_active":"2024-03-07T10:24:23.842611+0000","last_peered":"2024-03-07T10:24:23.842611+0000","last_clean":"2024-03-07T10:24:23.842611+0000","last_became_active":"2024-03-07T10:20:58.156008+0000","last_became_peered":"2024-03-07T10:20:58.156008+0000","last_unstale":"2024-03-07T10:24:23.842611+0000","last_undegraded":"2024-03-07T10:24:23.842611+0000","last_fullsized":"2024-03-07T10:24:23.842611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:23.842435+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:23.842435+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.842435+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:32.464193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.450137+0000","last_change":"2024-03-07T10:24:33.450137+0000","last_active":"2024-03-07T10:24:33.450137+0000","last_peered":"2024-03-07T10:24:33.450137+0000","last_clean":"2024-03-07T10:24:33.450137+0000","last_became_active":"2024-03-07T10:20:57.161702+0000","last_became_peered":"2024-03-07T10:20:57.161702+0000","last_unstale":"2024-03-07T10:24:33.450137+0000","last_undegraded":"2024-03-07T10:24:33.450137+0000","last_fullsized":"2024-03-07T10:24:33.450137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.449842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.449842+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.449842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:24.778447+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"29'15","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.808708+0000","last_change":"2024-03-07T10:24:29.808830+0000","last_active":"2024-03-07T10:24:29.808708+0000","last_peered":"2024-03-07T10:24:29.808708+0000","last_clean":"2024-03-07T10:24:29.808708+0000","last_became_active":"2024-03-07T10:21:08.286197+0000","last_became_peered":"2024-03-07T10:21:08.286197+0000","last_unstale":"2024-03-07T10:24:29.808708+0000","last_undegraded":"2024-03-07T10:24:29.808708+0000","last_fullsized":"2024-03-07T10:24:29.808708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:29.808493+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:29.808493+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.808493+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:08.712042+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":25,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:46.440697+0000","last_change":"2024-03-07T10:24:46.440796+0000","last_active":"2024-03-07T10:24:46.440697+0000","last_peered":"2024-03-07T10:24:46.440697+0000","last_clean":"2024-03-07T10:24:46.440697+0000","last_became_active":"2024-03-07T10:21:09.316430+0000","last_became_peered":"2024-03-07T10:21:09.316430+0000","last_unstale":"2024-03-07T10:24:46.440697+0000","last_undegraded":"2024-03-07T10:24:46.440697+0000","last_fullsized":"2024-03-07T10:24:46.440697+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:46.440364+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:46.440364+0000","last_clean_scrub_stamp":"2024-03-07T10:24:46.440364+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:07:09.254225+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.645250+0000","last_change":"2024-03-07T10:24:24.645318+0000","last_active":"2024-03-07T10:24:24.645250+0000","last_peered":"2024-03-07T10:24:24.645250+0000","last_clean":"2024-03-07T10:24:24.645250+0000","last_became_active":"2024-03-07T10:20:58.163320+0000","last_became_peered":"2024-03-07T10:20:58.163320+0000","last_unstale":"2024-03-07T10:24:24.645250+0000","last_undegraded":"2024-03-07T10:24:24.645250+0000","last_fullsized":"2024-03-07T10:24:24.645250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:24.645054+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:24.645054+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.645054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:40.805467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.184248+0000","last_change":"2024-03-07T10:24:28.184332+0000","last_active":"2024-03-07T10:24:28.184248+0000","last_peered":"2024-03-07T10:24:28.184248+0000","last_clean":"2024-03-07T10:24:28.184248+0000","last_became_active":"2024-03-07T10:20:57.156535+0000","last_became_peered":"2024-03-07T10:20:57.156535+0000","last_unstale":"2024-03-07T10:24:28.184248+0000","last_undegraded":"2024-03-07T10:24:28.184248+0000","last_fullsized":"2024-03-07T10:24:28.184248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.183979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.183979+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.183979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:57:42.546996+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":201,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.425692+0000","last_change":"2024-03-07T10:24:32.425692+0000","last_active":"2024-03-07T10:24:32.425692+0000","last_peered":"2024-03-07T10:24:32.425692+0000","last_clean":"2024-03-07T10:24:32.425692+0000","last_became_active":"2024-03-07T10:20:48.053377+0000","last_became_peered":"2024-03-07T10:20:48.053377+0000","last_unstale":"2024-03-07T10:24:32.425692+0000","last_undegraded":"2024-03-07T10:24:32.425692+0000","last_fullsized":"2024-03-07T10:24:32.425692+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-03-07T10:24:32.425278+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-03-07T10:24:32.425278+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.425278+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:40.814537+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.215225+0000","last_change":"2024-03-07T10:24:32.215324+0000","last_active":"2024-03-07T10:24:32.215225+0000","last_peered":"2024-03-07T10:24:32.215225+0000","last_clean":"2024-03-07T10:24:32.215225+0000","last_became_active":"2024-03-07T10:21:08.289402+0000","last_became_peered":"2024-03-07T10:21:08.289402+0000","last_unstale":"2024-03-07T10:24:32.215225+0000","last_undegraded":"2024-03-07T10:24:32.215225+0000","last_fullsized":"2024-03-07T10:24:32.215225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.214879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.214879+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.214879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:22.080510+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.115052+0000","last_change":"2024-03-07T10:24:16.115076+0000","last_active":"2024-03-07T10:24:16.115052+0000","last_peered":"2024-03-07T10:24:16.115052+0000","last_clean":"2024-03-07T10:24:16.115052+0000","last_became_active":"2024-03-07T10:21:09.307611+0000","last_became_peered":"2024-03-07T10:21:09.307611+0000","last_unstale":"2024-03-07T10:24:16.115052+0000","last_undegraded":"2024-03-07T10:24:16.115052+0000","last_fullsized":"2024-03-07T10:24:16.115052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.114954+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.114954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:44:18.227347+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.407455+0000","last_change":"2024-03-07T10:24:22.407499+0000","last_active":"2024-03-07T10:24:22.407455+0000","last_peered":"2024-03-07T10:24:22.407455+0000","last_clean":"2024-03-07T10:24:22.407455+0000","last_became_active":"2024-03-07T10:20:58.171163+0000","last_became_peered":"2024-03-07T10:20:58.171163+0000","last_unstale":"2024-03-07T10:24:22.407455+0000","last_undegraded":"2024-03-07T10:24:22.407455+0000","last_fullsized":"2024-03-07T10:24:22.407455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:22.407299+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:22.407299+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.407299+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:34.232759+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.100469+0000","last_change":"2024-03-07T10:24:20.100525+0000","last_active":"2024-03-07T10:24:20.100469+0000","last_peered":"2024-03-07T10:24:20.100469+0000","last_clean":"2024-03-07T10:24:20.100469+0000","last_became_active":"2024-03-07T10:20:57.158646+0000","last_became_peered":"2024-03-07T10:20:57.158646+0000","last_unstale":"2024-03-07T10:24:20.100469+0000","last_undegraded":"2024-03-07T10:24:20.100469+0000","last_fullsized":"2024-03-07T10:24:20.100469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:20.100288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:20.100288+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.100288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:21:06.273478+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.233859+0000","last_change":"2024-03-07T10:24:31.233916+0000","last_active":"2024-03-07T10:24:31.233859+0000","last_peered":"2024-03-07T10:24:31.233859+0000","last_clean":"2024-03-07T10:24:31.233859+0000","last_became_active":"2024-03-07T10:21:08.288196+0000","last_became_peered":"2024-03-07T10:21:08.288196+0000","last_unstale":"2024-03-07T10:24:31.233859+0000","last_undegraded":"2024-03-07T10:24:31.233859+0000","last_fullsized":"2024-03-07T10:24:31.233859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.233657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.233657+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.233657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:08.560778+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.228538+0000","last_change":"2024-03-07T10:24:25.228592+0000","last_active":"2024-03-07T10:24:25.228538+0000","last_peered":"2024-03-07T10:24:25.228538+0000","last_clean":"2024-03-07T10:24:25.228538+0000","last_became_active":"2024-03-07T10:21:09.308446+0000","last_became_peered":"2024-03-07T10:21:09.308446+0000","last_unstale":"2024-03-07T10:24:25.228538+0000","last_undegraded":"2024-03-07T10:24:25.228538+0000","last_fullsized":"2024-03-07T10:24:25.228538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.228340+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.228340+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.228340+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:16:17.547064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.163645+0000","last_change":"2024-03-07T10:24:35.163702+0000","last_active":"2024-03-07T10:24:35.163645+0000","last_peered":"2024-03-07T10:24:35.163645+0000","last_clean":"2024-03-07T10:24:35.163645+0000","last_became_active":"2024-03-07T10:20:58.152322+0000","last_became_peered":"2024-03-07T10:20:58.152322+0000","last_unstale":"2024-03-07T10:24:35.163645+0000","last_undegraded":"2024-03-07T10:24:35.163645+0000","last_fullsized":"2024-03-07T10:24:35.163645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:35.163468+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:35.163468+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.163468+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:54:35.303980+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.247736+0000","last_change":"2024-03-07T10:24:28.247804+0000","last_active":"2024-03-07T10:24:28.247736+0000","last_peered":"2024-03-07T10:24:28.247736+0000","last_clean":"2024-03-07T10:24:28.247736+0000","last_became_active":"2024-03-07T10:20:57.158982+0000","last_became_peered":"2024-03-07T10:20:57.158982+0000","last_unstale":"2024-03-07T10:24:28.247736+0000","last_undegraded":"2024-03-07T10:24:28.247736+0000","last_fullsized":"2024-03-07T10:24:28.247736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:28.247546+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:28.247546+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.247546+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:07:52.089236+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.832792+0000","last_change":"2024-03-07T10:24:27.832886+0000","last_active":"2024-03-07T10:24:27.832792+0000","last_peered":"2024-03-07T10:24:27.832792+0000","last_clean":"2024-03-07T10:24:27.832792+0000","last_became_active":"2024-03-07T10:21:08.284063+0000","last_became_peered":"2024-03-07T10:21:08.284063+0000","last_unstale":"2024-03-07T10:24:27.832792+0000","last_undegraded":"2024-03-07T10:24:27.832792+0000","last_fullsized":"2024-03-07T10:24:27.832792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:27.832585+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:27.832585+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.832585+0000","objects_scrubbed":1,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:09.341343+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.433229+0000","last_change":"2024-03-07T10:24:26.433273+0000","last_active":"2024-03-07T10:24:26.433229+0000","last_peered":"2024-03-07T10:24:26.433229+0000","last_clean":"2024-03-07T10:24:26.433229+0000","last_became_active":"2024-03-07T10:21:09.299800+0000","last_became_peered":"2024-03-07T10:21:09.299800+0000","last_unstale":"2024-03-07T10:24:26.433229+0000","last_undegraded":"2024-03-07T10:24:26.433229+0000","last_fullsized":"2024-03-07T10:24:26.433229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.433065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.433065+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.433065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:10.503970+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.407165+0000","last_change":"2024-03-07T10:24:20.407222+0000","last_active":"2024-03-07T10:24:20.407165+0000","last_peered":"2024-03-07T10:24:20.407165+0000","last_clean":"2024-03-07T10:24:20.407165+0000","last_became_active":"2024-03-07T10:20:58.161684+0000","last_became_peered":"2024-03-07T10:20:58.161684+0000","last_unstale":"2024-03-07T10:24:20.407165+0000","last_undegraded":"2024-03-07T10:24:20.407165+0000","last_fullsized":"2024-03-07T10:24:20.407165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:20.406917+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:20.406917+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.406917+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:31:57.734038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.074194+0000","last_change":"2024-03-07T10:24:19.074238+0000","last_active":"2024-03-07T10:24:19.074194+0000","last_peered":"2024-03-07T10:24:19.074194+0000","last_clean":"2024-03-07T10:24:19.074194+0000","last_became_active":"2024-03-07T10:20:57.158035+0000","last_became_peered":"2024-03-07T10:20:57.158035+0000","last_unstale":"2024-03-07T10:24:19.074194+0000","last_undegraded":"2024-03-07T10:24:19.074194+0000","last_fullsized":"2024-03-07T10:24:19.074194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:19.074073+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:19.074073+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.074073+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:07.399242+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.092473+0000","last_change":"2024-03-07T10:24:18.092622+0000","last_active":"2024-03-07T10:24:18.092473+0000","last_peered":"2024-03-07T10:24:18.092473+0000","last_clean":"2024-03-07T10:24:18.092473+0000","last_became_active":"2024-03-07T10:21:08.277629+0000","last_became_peered":"2024-03-07T10:21:08.277629+0000","last_unstale":"2024-03-07T10:24:18.092473+0000","last_undegraded":"2024-03-07T10:24:18.092473+0000","last_fullsized":"2024-03-07T10:24:18.092473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:18.092241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:18.092241+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.092241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:32.835421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.204182+0000","last_change":"2024-03-07T10:24:27.204278+0000","last_active":"2024-03-07T10:24:27.204182+0000","last_peered":"2024-03-07T10:24:27.204182+0000","last_clean":"2024-03-07T10:24:27.204182+0000","last_became_active":"2024-03-07T10:21:09.310066+0000","last_became_peered":"2024-03-07T10:21:09.310066+0000","last_unstale":"2024-03-07T10:24:27.204182+0000","last_undegraded":"2024-03-07T10:24:27.204182+0000","last_fullsized":"2024-03-07T10:24:27.204182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.203910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.203910+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.203910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:32.515915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.399406+0000","last_change":"2024-03-07T10:24:21.399449+0000","last_active":"2024-03-07T10:24:21.399406+0000","last_peered":"2024-03-07T10:24:21.399406+0000","last_clean":"2024-03-07T10:24:21.399406+0000","last_became_active":"2024-03-07T10:20:58.158029+0000","last_became_peered":"2024-03-07T10:20:58.158029+0000","last_unstale":"2024-03-07T10:24:21.399406+0000","last_undegraded":"2024-03-07T10:24:21.399406+0000","last_fullsized":"2024-03-07T10:24:21.399406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:21.399257+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:21.399257+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.399257+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:47.051547+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"29'2","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.677238+0000","last_change":"2024-03-07T10:24:24.677301+0000","last_active":"2024-03-07T10:24:24.677238+0000","last_peered":"2024-03-07T10:24:24.677238+0000","last_clean":"2024-03-07T10:24:24.677238+0000","last_became_active":"2024-03-07T10:20:57.162581+0000","last_became_peered":"2024-03-07T10:20:57.162581+0000","last_unstale":"2024-03-07T10:24:24.677238+0000","last_undegraded":"2024-03-07T10:24:24.677238+0000","last_fullsized":"2024-03-07T10:24:24.677238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:24.677024+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:24.677024+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.677024+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:33.298781+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.645267+0000","last_change":"2024-03-07T10:24:22.645327+0000","last_active":"2024-03-07T10:24:22.645267+0000","last_peered":"2024-03-07T10:24:22.645267+0000","last_clean":"2024-03-07T10:24:22.645267+0000","last_became_active":"2024-03-07T10:21:08.287375+0000","last_became_peered":"2024-03-07T10:21:08.287375+0000","last_unstale":"2024-03-07T10:24:22.645267+0000","last_undegraded":"2024-03-07T10:24:22.645267+0000","last_fullsized":"2024-03-07T10:24:22.645267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:22.645025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:22.645025+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.645025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:30.442878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:44.517172+0000","last_change":"2024-03-07T10:24:44.517235+0000","last_active":"2024-03-07T10:24:44.517172+0000","last_peered":"2024-03-07T10:24:44.517172+0000","last_clean":"2024-03-07T10:24:44.517172+0000","last_became_active":"2024-03-07T10:21:09.321118+0000","last_became_peered":"2024-03-07T10:21:09.321118+0000","last_unstale":"2024-03-07T10:24:44.517172+0000","last_undegraded":"2024-03-07T10:24:44.517172+0000","last_fullsized":"2024-03-07T10:24:44.517172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:44.516987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:44.516987+0000","last_clean_scrub_stamp":"2024-03-07T10:24:44.516987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:30:13.598009+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.431714+0000","last_change":"2024-03-07T10:24:31.431869+0000","last_active":"2024-03-07T10:24:31.431714+0000","last_peered":"2024-03-07T10:24:31.431714+0000","last_clean":"2024-03-07T10:24:31.431714+0000","last_became_active":"2024-03-07T10:20:58.150485+0000","last_became_peered":"2024-03-07T10:20:58.150485+0000","last_unstale":"2024-03-07T10:24:31.431714+0000","last_undegraded":"2024-03-07T10:24:31.431714+0000","last_fullsized":"2024-03-07T10:24:31.431714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:31.431452+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:31.431452+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.431452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:31.942470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"29'13","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.101397+0000","last_change":"2024-03-07T10:24:18.101460+0000","last_active":"2024-03-07T10:24:18.101397+0000","last_peered":"2024-03-07T10:24:18.101397+0000","last_clean":"2024-03-07T10:24:18.101397+0000","last_became_active":"2024-03-07T10:20:57.155882+0000","last_became_peered":"2024-03-07T10:20:57.155882+0000","last_unstale":"2024-03-07T10:24:18.101397+0000","last_undegraded":"2024-03-07T10:24:18.101397+0000","last_fullsized":"2024-03-07T10:24:18.101397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-03-07T10:24:18.101276+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-03-07T10:24:18.101276+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.101276+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:30:54.326749+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.834340+0000","last_change":"2024-03-07T10:24:26.834394+0000","last_active":"2024-03-07T10:24:26.834340+0000","last_peered":"2024-03-07T10:24:26.834340+0000","last_clean":"2024-03-07T10:24:26.834340+0000","last_became_active":"2024-03-07T10:21:08.280970+0000","last_became_peered":"2024-03-07T10:21:08.280970+0000","last_unstale":"2024-03-07T10:24:26.834340+0000","last_undegraded":"2024-03-07T10:24:26.834340+0000","last_fullsized":"2024-03-07T10:24:26.834340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.834157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.834157+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.834157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:52.486448+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.073391+0000","last_change":"2024-03-07T10:24:22.073445+0000","last_active":"2024-03-07T10:24:22.073391+0000","last_peered":"2024-03-07T10:24:22.073391+0000","last_clean":"2024-03-07T10:24:22.073391+0000","last_became_active":"2024-03-07T10:21:09.297027+0000","last_became_peered":"2024-03-07T10:21:09.297027+0000","last_unstale":"2024-03-07T10:24:22.073391+0000","last_undegraded":"2024-03-07T10:24:22.073391+0000","last_fullsized":"2024-03-07T10:24:22.073391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:22.073194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:22.073194+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.073194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:33.898654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.198983+0000","last_change":"2024-03-07T10:24:28.199067+0000","last_active":"2024-03-07T10:24:28.198983+0000","last_peered":"2024-03-07T10:24:28.198983+0000","last_clean":"2024-03-07T10:24:28.198983+0000","last_became_active":"2024-03-07T10:20:58.157073+0000","last_became_peered":"2024-03-07T10:20:58.157073+0000","last_unstale":"2024-03-07T10:24:28.198983+0000","last_undegraded":"2024-03-07T10:24:28.198983+0000","last_fullsized":"2024-03-07T10:24:28.198983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:28.198777+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:28.198777+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.198777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:54:34.015482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.117686+0000","last_change":"2024-03-07T10:24:25.117796+0000","last_active":"2024-03-07T10:24:25.117686+0000","last_peered":"2024-03-07T10:24:25.117686+0000","last_clean":"2024-03-07T10:24:25.117686+0000","last_became_active":"2024-03-07T10:20:57.161390+0000","last_became_peered":"2024-03-07T10:20:57.161390+0000","last_unstale":"2024-03-07T10:24:25.117686+0000","last_undegraded":"2024-03-07T10:24:25.117686+0000","last_fullsized":"2024-03-07T10:24:25.117686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:25.117418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:25.117418+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.117418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:58:33.835903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'2","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.679550+0000","last_change":"2024-03-07T10:24:23.679713+0000","last_active":"2024-03-07T10:24:23.679550+0000","last_peered":"2024-03-07T10:24:23.679550+0000","last_clean":"2024-03-07T10:24:23.679550+0000","last_became_active":"2024-03-07T10:21:08.285622+0000","last_became_peered":"2024-03-07T10:21:08.285622+0000","last_unstale":"2024-03-07T10:24:23.679550+0000","last_undegraded":"2024-03-07T10:24:23.679550+0000","last_fullsized":"2024-03-07T10:24:23.679550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:23.679343+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:23.679343+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.679343+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:07.750248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:41.106563+0000","last_change":"2024-03-07T10:24:41.106614+0000","last_active":"2024-03-07T10:24:41.106563+0000","last_peered":"2024-03-07T10:24:41.106563+0000","last_clean":"2024-03-07T10:24:41.106563+0000","last_became_active":"2024-03-07T10:21:09.321083+0000","last_became_peered":"2024-03-07T10:21:09.321083+0000","last_unstale":"2024-03-07T10:24:41.106563+0000","last_undegraded":"2024-03-07T10:24:41.106563+0000","last_fullsized":"2024-03-07T10:24:41.106563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:41.106361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:41.106361+0000","last_clean_scrub_stamp":"2024-03-07T10:24:41.106361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:39.513185+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.422711+0000","last_change":"2024-03-07T10:24:29.422774+0000","last_active":"2024-03-07T10:24:29.422711+0000","last_peered":"2024-03-07T10:24:29.422711+0000","last_clean":"2024-03-07T10:24:29.422711+0000","last_became_active":"2024-03-07T10:20:58.151395+0000","last_became_peered":"2024-03-07T10:20:58.151395+0000","last_unstale":"2024-03-07T10:24:29.422711+0000","last_undegraded":"2024-03-07T10:24:29.422711+0000","last_fullsized":"2024-03-07T10:24:29.422711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:29.422505+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:29.422505+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.422505+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:20:16.050041+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"28'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.213423+0000","last_change":"2024-03-07T10:24:29.213512+0000","last_active":"2024-03-07T10:24:29.213423+0000","last_peered":"2024-03-07T10:24:29.213423+0000","last_clean":"2024-03-07T10:24:29.213423+0000","last_became_active":"2024-03-07T10:20:57.158429+0000","last_became_peered":"2024-03-07T10:20:57.158429+0000","last_unstale":"2024-03-07T10:24:29.213423+0000","last_undegraded":"2024-03-07T10:24:29.213423+0000","last_fullsized":"2024-03-07T10:24:29.213423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-03-07T10:24:29.213167+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-03-07T10:24:29.213167+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.213167+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:19.704576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.680128+0000","last_change":"2024-03-07T10:24:25.680211+0000","last_active":"2024-03-07T10:24:25.680128+0000","last_peered":"2024-03-07T10:24:25.680128+0000","last_clean":"2024-03-07T10:24:25.680128+0000","last_became_active":"2024-03-07T10:21:08.286285+0000","last_became_peered":"2024-03-07T10:21:08.286285+0000","last_unstale":"2024-03-07T10:24:25.680128+0000","last_undegraded":"2024-03-07T10:24:25.680128+0000","last_fullsized":"2024-03-07T10:24:25.680128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-03-07T10:24:25.679908+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-03-07T10:24:25.679908+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.679908+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:57:40.042925+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43708,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":55,"num_write":32,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.648323+0000","last_change":"2024-03-07T10:24:27.648358+0000","last_active":"2024-03-07T10:24:27.648323+0000","last_peered":"2024-03-07T10:24:27.648323+0000","last_clean":"2024-03-07T10:24:27.648323+0000","last_became_active":"2024-03-07T10:21:09.288980+0000","last_became_peered":"2024-03-07T10:21:09.288980+0000","last_unstale":"2024-03-07T10:24:27.648323+0000","last_undegraded":"2024-03-07T10:24:27.648323+0000","last_fullsized":"2024-03-07T10:24:27.648323+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:27.648219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:27.648219+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.648219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:56:19.537499+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.861100+0000","last_change":"2024-03-07T10:24:20.861238+0000","last_active":"2024-03-07T10:24:20.861100+0000","last_peered":"2024-03-07T10:24:20.861100+0000","last_clean":"2024-03-07T10:24:20.861100+0000","last_became_active":"2024-03-07T10:20:58.148238+0000","last_became_peered":"2024-03-07T10:20:58.148238+0000","last_unstale":"2024-03-07T10:24:20.861100+0000","last_undegraded":"2024-03-07T10:24:20.861100+0000","last_fullsized":"2024-03-07T10:24:20.861100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:20.860875+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:20.860875+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.860875+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:50:55.341370+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.884385+0000","last_change":"2024-03-07T10:24:18.884410+0000","last_active":"2024-03-07T10:24:18.884385+0000","last_peered":"2024-03-07T10:24:18.884385+0000","last_clean":"2024-03-07T10:24:18.884385+0000","last_became_active":"2024-03-07T10:20:57.159513+0000","last_became_peered":"2024-03-07T10:20:57.159513+0000","last_unstale":"2024-03-07T10:24:18.884385+0000","last_undegraded":"2024-03-07T10:24:18.884385+0000","last_fullsized":"2024-03-07T10:24:18.884385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:18.884322+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:18.884322+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.884322+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:49:16.630344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.084060+0000","last_change":"2024-03-07T10:24:20.084135+0000","last_active":"2024-03-07T10:24:20.084060+0000","last_peered":"2024-03-07T10:24:20.084060+0000","last_clean":"2024-03-07T10:24:20.084060+0000","last_became_active":"2024-03-07T10:21:08.288363+0000","last_became_peered":"2024-03-07T10:21:08.288363+0000","last_unstale":"2024-03-07T10:24:20.084060+0000","last_undegraded":"2024-03-07T10:24:20.084060+0000","last_fullsized":"2024-03-07T10:24:20.084060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:20.083833+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:20.083833+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.083833+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:20:09.949465+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:41.549442+0000","last_change":"2024-03-07T10:24:41.549499+0000","last_active":"2024-03-07T10:24:41.549442+0000","last_peered":"2024-03-07T10:24:41.549442+0000","last_clean":"2024-03-07T10:24:41.549442+0000","last_became_active":"2024-03-07T10:21:09.312384+0000","last_became_peered":"2024-03-07T10:21:09.312384+0000","last_unstale":"2024-03-07T10:24:41.549442+0000","last_undegraded":"2024-03-07T10:24:41.549442+0000","last_fullsized":"2024-03-07T10:24:41.549442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:41.549227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:41.549227+0000","last_clean_scrub_stamp":"2024-03-07T10:24:41.549227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:06:59.033021+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.439169+0000","last_change":"2024-03-07T10:24:25.439299+0000","last_active":"2024-03-07T10:24:25.439169+0000","last_peered":"2024-03-07T10:24:25.439169+0000","last_clean":"2024-03-07T10:24:25.439169+0000","last_became_active":"2024-03-07T10:20:58.155946+0000","last_became_peered":"2024-03-07T10:20:58.155946+0000","last_unstale":"2024-03-07T10:24:25.439169+0000","last_undegraded":"2024-03-07T10:24:25.439169+0000","last_fullsized":"2024-03-07T10:24:25.439169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:25.438885+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:25.438885+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.438885+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:11.763788+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"29'31","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.081326+0000","last_change":"2024-03-07T10:24:23.081397+0000","last_active":"2024-03-07T10:24:23.081326+0000","last_peered":"2024-03-07T10:24:23.081326+0000","last_clean":"2024-03-07T10:24:23.081326+0000","last_became_active":"2024-03-07T10:20:57.153444+0000","last_became_peered":"2024-03-07T10:20:57.153444+0000","last_unstale":"2024-03-07T10:24:23.081326+0000","last_undegraded":"2024-03-07T10:24:23.081326+0000","last_fullsized":"2024-03-07T10:24:23.081326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2024-03-07T10:24:23.081141+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2024-03-07T10:24:23.081141+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.081141+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:53.072415+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":14,"num_write":27,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"27'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.180090+0000","last_change":"2024-03-07T10:24:15.180114+0000","last_active":"2024-03-07T10:24:15.180090+0000","last_peered":"2024-03-07T10:24:15.180090+0000","last_clean":"2024-03-07T10:24:15.180090+0000","last_became_active":"2024-03-07T10:21:08.280211+0000","last_became_peered":"2024-03-07T10:21:08.280211+0000","last_unstale":"2024-03-07T10:24:15.180090+0000","last_undegraded":"2024-03-07T10:24:15.180090+0000","last_fullsized":"2024-03-07T10:24:15.180090+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'1","last_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_deep_scrub":"27'1","last_deep_scrub_stamp":"2024-03-07T10:24:15.180026+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.180026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:10:58.716023+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.218516+0000","last_change":"2024-03-07T10:24:23.218565+0000","last_active":"2024-03-07T10:24:23.218516+0000","last_peered":"2024-03-07T10:24:23.218516+0000","last_clean":"2024-03-07T10:24:23.218516+0000","last_became_active":"2024-03-07T10:21:09.306409+0000","last_became_peered":"2024-03-07T10:21:09.306409+0000","last_unstale":"2024-03-07T10:24:23.218516+0000","last_undegraded":"2024-03-07T10:24:23.218516+0000","last_fullsized":"2024-03-07T10:24:23.218516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:23.218343+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:23.218343+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.218343+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:48.870634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.669916+0000","last_change":"2024-03-07T10:24:25.669979+0000","last_active":"2024-03-07T10:24:25.669916+0000","last_peered":"2024-03-07T10:24:25.669916+0000","last_clean":"2024-03-07T10:24:25.669916+0000","last_became_active":"2024-03-07T10:20:58.145550+0000","last_became_peered":"2024-03-07T10:20:58.145550+0000","last_unstale":"2024-03-07T10:24:25.669916+0000","last_undegraded":"2024-03-07T10:24:25.669916+0000","last_fullsized":"2024-03-07T10:24:25.669916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:25.669717+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:25.669717+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.669717+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:40.412897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"29'7","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.209961+0000","last_change":"2024-03-07T10:24:30.210091+0000","last_active":"2024-03-07T10:24:30.209961+0000","last_peered":"2024-03-07T10:24:30.209961+0000","last_clean":"2024-03-07T10:24:30.209961+0000","last_became_active":"2024-03-07T10:20:57.164358+0000","last_became_peered":"2024-03-07T10:20:57.164358+0000","last_unstale":"2024-03-07T10:24:30.209961+0000","last_undegraded":"2024-03-07T10:24:30.209961+0000","last_fullsized":"2024-03-07T10:24:30.209961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:30.209704+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:30.209704+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.209704+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:00:12.903281+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.620842+0000","last_change":"2024-03-07T10:24:21.620978+0000","last_active":"2024-03-07T10:24:21.620842+0000","last_peered":"2024-03-07T10:24:21.620842+0000","last_clean":"2024-03-07T10:24:21.620842+0000","last_became_active":"2024-03-07T10:21:08.275683+0000","last_became_peered":"2024-03-07T10:21:08.275683+0000","last_unstale":"2024-03-07T10:24:21.620842+0000","last_undegraded":"2024-03-07T10:24:21.620842+0000","last_fullsized":"2024-03-07T10:24:21.620842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:21.620661+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:21.620661+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.620661+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:33:20.243333+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.223958+0000","last_change":"2024-03-07T10:24:34.224001+0000","last_active":"2024-03-07T10:24:34.223958+0000","last_peered":"2024-03-07T10:24:34.223958+0000","last_clean":"2024-03-07T10:24:34.223958+0000","last_became_active":"2024-03-07T10:21:09.286363+0000","last_became_peered":"2024-03-07T10:21:09.286363+0000","last_unstale":"2024-03-07T10:24:34.223958+0000","last_undegraded":"2024-03-07T10:24:34.223958+0000","last_fullsized":"2024-03-07T10:24:34.223958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.223780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.223780+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.223780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:55:59.096235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:15.761771+0000","last_change":"2024-03-07T10:24:15.761796+0000","last_active":"2024-03-07T10:24:15.761771+0000","last_peered":"2024-03-07T10:24:15.761771+0000","last_clean":"2024-03-07T10:24:15.761771+0000","last_became_active":"2024-03-07T10:20:58.163955+0000","last_became_peered":"2024-03-07T10:20:58.163955+0000","last_unstale":"2024-03-07T10:24:15.761771+0000","last_undegraded":"2024-03-07T10:24:15.761771+0000","last_fullsized":"2024-03-07T10:24:15.761771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:15.761687+0000","last_clean_scrub_stamp":"2024-03-07T10:24:15.761687+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:12:30.714756+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.242937+0000","last_change":"2024-03-07T10:24:31.242980+0000","last_active":"2024-03-07T10:24:31.242937+0000","last_peered":"2024-03-07T10:24:31.242937+0000","last_clean":"2024-03-07T10:24:31.242937+0000","last_became_active":"2024-03-07T10:20:57.163738+0000","last_became_peered":"2024-03-07T10:20:57.163738+0000","last_unstale":"2024-03-07T10:24:31.242937+0000","last_undegraded":"2024-03-07T10:24:31.242937+0000","last_fullsized":"2024-03-07T10:24:31.242937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.242783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.242783+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.242783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:31.753801+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"29'13","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:17.638516+0000","last_change":"2024-03-07T10:24:17.638567+0000","last_active":"2024-03-07T10:24:17.638516+0000","last_peered":"2024-03-07T10:24:17.638516+0000","last_clean":"2024-03-07T10:24:17.638516+0000","last_became_active":"2024-03-07T10:21:08.279199+0000","last_became_peered":"2024-03-07T10:21:08.279199+0000","last_unstale":"2024-03-07T10:24:17.638516+0000","last_undegraded":"2024-03-07T10:24:17.638516+0000","last_fullsized":"2024-03-07T10:24:17.638516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-03-07T10:24:17.638417+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-03-07T10:24:17.638417+0000","last_clean_scrub_stamp":"2024-03-07T10:24:17.638417+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:43:01.742130+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:43.399853+0000","last_change":"2024-03-07T10:24:43.399908+0000","last_active":"2024-03-07T10:24:43.399853+0000","last_peered":"2024-03-07T10:24:43.399853+0000","last_clean":"2024-03-07T10:24:43.399853+0000","last_became_active":"2024-03-07T10:21:09.310862+0000","last_became_peered":"2024-03-07T10:21:09.310862+0000","last_unstale":"2024-03-07T10:24:43.399853+0000","last_undegraded":"2024-03-07T10:24:43.399853+0000","last_fullsized":"2024-03-07T10:24:43.399853+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:43.399615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:43.399615+0000","last_clean_scrub_stamp":"2024-03-07T10:24:43.399615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:06:52.124178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'10","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:40.303889+0000","last_change":"2024-03-07T10:24:40.303948+0000","last_active":"2024-03-07T10:24:40.303889+0000","last_peered":"2024-03-07T10:24:40.303889+0000","last_clean":"2024-03-07T10:24:40.303889+0000","last_became_active":"2024-03-07T10:21:39.613625+0000","last_became_peered":"2024-03-07T10:21:39.613625+0000","last_unstale":"2024-03-07T10:24:40.303889+0000","last_undegraded":"2024-03-07T10:24:40.303889+0000","last_fullsized":"2024-03-07T10:24:40.303889+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:40.303663+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:40.303663+0000","last_clean_scrub_stamp":"2024-03-07T10:24:40.303663+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:27:46.492004+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'1","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.152023+0000","last_change":"2024-03-07T10:24:27.152114+0000","last_active":"2024-03-07T10:24:27.152023+0000","last_peered":"2024-03-07T10:24:27.152023+0000","last_clean":"2024-03-07T10:24:27.152023+0000","last_became_active":"2024-03-07T10:20:57.164229+0000","last_became_peered":"2024-03-07T10:20:57.164229+0000","last_unstale":"2024-03-07T10:24:27.152023+0000","last_undegraded":"2024-03-07T10:24:27.152023+0000","last_fullsized":"2024-03-07T10:24:27.152023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1","last_scrub_stamp":"2024-03-07T10:24:27.151809+0000","last_deep_scrub":"28'1","last_deep_scrub_stamp":"2024-03-07T10:24:27.151809+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.151809+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:34.949661+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.590288+0000","last_change":"2024-03-07T10:24:16.590322+0000","last_active":"2024-03-07T10:24:16.590288+0000","last_peered":"2024-03-07T10:24:16.590288+0000","last_clean":"2024-03-07T10:24:16.590288+0000","last_became_active":"2024-03-07T10:21:08.277613+0000","last_became_peered":"2024-03-07T10:21:08.277613+0000","last_unstale":"2024-03-07T10:24:16.590288+0000","last_undegraded":"2024-03-07T10:24:16.590288+0000","last_fullsized":"2024-03-07T10:24:16.590288+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:16.590192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:16.590192+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.590192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:00:48.374838+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:35.179141+0000","last_change":"2024-03-07T10:24:35.179306+0000","last_active":"2024-03-07T10:24:35.179141+0000","last_peered":"2024-03-07T10:24:35.179141+0000","last_clean":"2024-03-07T10:24:35.179141+0000","last_became_active":"2024-03-07T10:21:09.291146+0000","last_became_peered":"2024-03-07T10:21:09.291146+0000","last_unstale":"2024-03-07T10:24:35.179141+0000","last_undegraded":"2024-03-07T10:24:35.179141+0000","last_fullsized":"2024-03-07T10:24:35.179141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:35.178895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:35.178895+0000","last_clean_scrub_stamp":"2024-03-07T10:24:35.178895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:26:51.690038+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:16.809917+0000","last_change":"2024-03-07T10:24:16.809952+0000","last_active":"2024-03-07T10:24:16.809917+0000","last_peered":"2024-03-07T10:24:16.809917+0000","last_clean":"2024-03-07T10:24:16.809917+0000","last_became_active":"2024-03-07T10:21:08.278102+0000","last_became_peered":"2024-03-07T10:21:08.278102+0000","last_unstale":"2024-03-07T10:24:16.809917+0000","last_undegraded":"2024-03-07T10:24:16.809917+0000","last_fullsized":"2024-03-07T10:24:16.809917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:16.809824+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:16.809824+0000","last_clean_scrub_stamp":"2024-03-07T10:24:16.809824+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:21.495507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:18.149422+0000","last_change":"2024-03-07T10:24:18.149446+0000","last_active":"2024-03-07T10:24:18.149422+0000","last_peered":"2024-03-07T10:24:18.149422+0000","last_clean":"2024-03-07T10:24:18.149422+0000","last_became_active":"2024-03-07T10:20:58.169449+0000","last_became_peered":"2024-03-07T10:20:58.169449+0000","last_unstale":"2024-03-07T10:24:18.149422+0000","last_undegraded":"2024-03-07T10:24:18.149422+0000","last_fullsized":"2024-03-07T10:24:18.149422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:18.149347+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:18.149347+0000","last_clean_scrub_stamp":"2024-03-07T10:24:18.149347+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:46:50.413866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.207651+0000","last_change":"2024-03-07T10:24:32.207703+0000","last_active":"2024-03-07T10:24:32.207651+0000","last_peered":"2024-03-07T10:24:32.207651+0000","last_clean":"2024-03-07T10:24:32.207651+0000","last_became_active":"2024-03-07T10:20:57.167747+0000","last_became_peered":"2024-03-07T10:20:57.167747+0000","last_unstale":"2024-03-07T10:24:32.207651+0000","last_undegraded":"2024-03-07T10:24:32.207651+0000","last_fullsized":"2024-03-07T10:24:32.207651+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:32.207439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:32.207439+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.207439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:40.596698+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.809533+0000","last_change":"2024-03-07T10:24:31.809584+0000","last_active":"2024-03-07T10:24:31.809533+0000","last_peered":"2024-03-07T10:24:31.809533+0000","last_clean":"2024-03-07T10:24:31.809533+0000","last_became_active":"2024-03-07T10:21:09.308189+0000","last_became_peered":"2024-03-07T10:21:09.308189+0000","last_unstale":"2024-03-07T10:24:31.809533+0000","last_undegraded":"2024-03-07T10:24:31.809533+0000","last_fullsized":"2024-03-07T10:24:31.809533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.809330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.809330+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.809330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:15.880236+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"29'8","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.232086+0000","last_change":"2024-03-07T10:24:33.232162+0000","last_active":"2024-03-07T10:24:33.232086+0000","last_peered":"2024-03-07T10:24:33.232086+0000","last_clean":"2024-03-07T10:24:33.232086+0000","last_became_active":"2024-03-07T10:21:08.291608+0000","last_became_peered":"2024-03-07T10:21:08.291608+0000","last_unstale":"2024-03-07T10:24:33.232086+0000","last_undegraded":"2024-03-07T10:24:33.232086+0000","last_fullsized":"2024-03-07T10:24:33.232086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:33.231859+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:33.231859+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.231859+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:14.740616+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.619540+0000","last_change":"2024-03-07T10:24:34.619649+0000","last_active":"2024-03-07T10:24:34.619540+0000","last_peered":"2024-03-07T10:24:34.619540+0000","last_clean":"2024-03-07T10:24:34.619540+0000","last_became_active":"2024-03-07T10:20:58.147369+0000","last_became_peered":"2024-03-07T10:20:58.147369+0000","last_unstale":"2024-03-07T10:24:34.619540+0000","last_undegraded":"2024-03-07T10:24:34.619540+0000","last_fullsized":"2024-03-07T10:24:34.619540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:34.619332+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:34.619332+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.619332+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:00:19.936790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.623302+0000","last_change":"2024-03-07T10:24:31.623385+0000","last_active":"2024-03-07T10:24:31.623302+0000","last_peered":"2024-03-07T10:24:31.623302+0000","last_clean":"2024-03-07T10:24:31.623302+0000","last_became_active":"2024-03-07T10:20:57.149418+0000","last_became_peered":"2024-03-07T10:20:57.149418+0000","last_unstale":"2024-03-07T10:24:31.623302+0000","last_undegraded":"2024-03-07T10:24:31.623302+0000","last_fullsized":"2024-03-07T10:24:31.623302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:31.623044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:31.623044+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.623044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:48.603939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.287946+0000","last_change":"2024-03-07T10:24:36.288049+0000","last_active":"2024-03-07T10:24:36.287946+0000","last_peered":"2024-03-07T10:24:36.287946+0000","last_clean":"2024-03-07T10:24:36.287946+0000","last_became_active":"2024-03-07T10:21:09.316188+0000","last_became_peered":"2024-03-07T10:21:09.316188+0000","last_unstale":"2024-03-07T10:24:36.287946+0000","last_undegraded":"2024-03-07T10:24:36.287946+0000","last_fullsized":"2024-03-07T10:24:36.287946+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.287650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.287650+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.287650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T17:03:28.780642+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.102215+0000","last_change":"2024-03-07T10:24:26.102283+0000","last_active":"2024-03-07T10:24:26.102215+0000","last_peered":"2024-03-07T10:24:26.102215+0000","last_clean":"2024-03-07T10:24:26.102215+0000","last_became_active":"2024-03-07T10:20:57.162208+0000","last_became_peered":"2024-03-07T10:20:57.162208+0000","last_unstale":"2024-03-07T10:24:26.102215+0000","last_undegraded":"2024-03-07T10:24:26.102215+0000","last_fullsized":"2024-03-07T10:24:26.102215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:26.101998+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:26.101998+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.101998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:51:00.582494+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.860776+0000","last_change":"2024-03-07T10:24:24.860928+0000","last_active":"2024-03-07T10:24:24.860776+0000","last_peered":"2024-03-07T10:24:24.860776+0000","last_clean":"2024-03-07T10:24:24.860776+0000","last_became_active":"2024-03-07T10:20:58.156291+0000","last_became_peered":"2024-03-07T10:20:58.156291+0000","last_unstale":"2024-03-07T10:24:24.860776+0000","last_undegraded":"2024-03-07T10:24:24.860776+0000","last_fullsized":"2024-03-07T10:24:24.860776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:24.860543+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:24.860543+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.860543+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:39.603723+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.214060+0000","last_change":"2024-03-07T10:24:23.214129+0000","last_active":"2024-03-07T10:24:23.214060+0000","last_peered":"2024-03-07T10:24:23.214060+0000","last_clean":"2024-03-07T10:24:23.214060+0000","last_became_active":"2024-03-07T10:21:08.283384+0000","last_became_peered":"2024-03-07T10:21:08.283384+0000","last_unstale":"2024-03-07T10:24:23.214060+0000","last_undegraded":"2024-03-07T10:24:23.214060+0000","last_fullsized":"2024-03-07T10:24:23.214060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-03-07T10:24:23.213826+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-03-07T10:24:23.213826+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.213826+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:47:15.474353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.620872+0000","last_change":"2024-03-07T10:24:34.620925+0000","last_active":"2024-03-07T10:24:34.620872+0000","last_peered":"2024-03-07T10:24:34.620872+0000","last_clean":"2024-03-07T10:24:34.620872+0000","last_became_active":"2024-03-07T10:21:09.300121+0000","last_became_peered":"2024-03-07T10:21:09.300121+0000","last_unstale":"2024-03-07T10:24:34.620872+0000","last_undegraded":"2024-03-07T10:24:34.620872+0000","last_fullsized":"2024-03-07T10:24:34.620872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.620679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.620679+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.620679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:20.693255+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.583877+0000","last_change":"2024-03-07T10:24:33.583939+0000","last_active":"2024-03-07T10:24:33.583877+0000","last_peered":"2024-03-07T10:24:33.583877+0000","last_clean":"2024-03-07T10:24:33.583877+0000","last_became_active":"2024-03-07T10:20:57.151929+0000","last_became_peered":"2024-03-07T10:20:57.151929+0000","last_unstale":"2024-03-07T10:24:33.583877+0000","last_undegraded":"2024-03-07T10:24:33.583877+0000","last_fullsized":"2024-03-07T10:24:33.583877+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2","last_scrub_stamp":"2024-03-07T10:24:33.583615+0000","last_deep_scrub":"28'2","last_deep_scrub_stamp":"2024-03-07T10:24:33.583615+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.583615+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:00.868428+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.707167+0000","last_change":"2024-03-07T10:24:28.707237+0000","last_active":"2024-03-07T10:24:28.707167+0000","last_peered":"2024-03-07T10:24:28.707167+0000","last_clean":"2024-03-07T10:24:28.707167+0000","last_became_active":"2024-03-07T10:20:58.162245+0000","last_became_peered":"2024-03-07T10:20:58.162245+0000","last_unstale":"2024-03-07T10:24:28.707167+0000","last_undegraded":"2024-03-07T10:24:28.707167+0000","last_fullsized":"2024-03-07T10:24:28.707167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:28.706930+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:28.706930+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.706930+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:40.532390+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.605352+0000","last_change":"2024-03-07T10:24:19.605380+0000","last_active":"2024-03-07T10:24:19.605352+0000","last_peered":"2024-03-07T10:24:19.605352+0000","last_clean":"2024-03-07T10:24:19.605352+0000","last_became_active":"2024-03-07T10:21:08.279037+0000","last_became_peered":"2024-03-07T10:21:08.279037+0000","last_unstale":"2024-03-07T10:24:19.605352+0000","last_undegraded":"2024-03-07T10:24:19.605352+0000","last_fullsized":"2024-03-07T10:24:19.605352+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:19.605271+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:19.605271+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.605271+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:31.430731+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.651085+0000","last_change":"2024-03-07T10:24:29.651148+0000","last_active":"2024-03-07T10:24:29.651085+0000","last_peered":"2024-03-07T10:24:29.651085+0000","last_clean":"2024-03-07T10:24:29.651085+0000","last_became_active":"2024-03-07T10:21:09.298468+0000","last_became_peered":"2024-03-07T10:21:09.298468+0000","last_unstale":"2024-03-07T10:24:29.651085+0000","last_undegraded":"2024-03-07T10:24:29.651085+0000","last_fullsized":"2024-03-07T10:24:29.651085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:29.650834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:29.650834+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.650834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:38.040093+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.086170+0000","last_change":"2024-03-07T10:24:22.086227+0000","last_active":"2024-03-07T10:24:22.086170+0000","last_peered":"2024-03-07T10:24:22.086170+0000","last_clean":"2024-03-07T10:24:22.086170+0000","last_became_active":"2024-03-07T10:20:58.157488+0000","last_became_peered":"2024-03-07T10:20:58.157488+0000","last_unstale":"2024-03-07T10:24:22.086170+0000","last_undegraded":"2024-03-07T10:24:22.086170+0000","last_fullsized":"2024-03-07T10:24:22.086170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:22.085952+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:22.085952+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.085952+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:26.771635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.274399+0000","last_change":"2024-03-07T10:24:38.274456+0000","last_active":"2024-03-07T10:24:38.274399+0000","last_peered":"2024-03-07T10:24:38.274399+0000","last_clean":"2024-03-07T10:24:38.274399+0000","last_became_active":"2024-03-07T10:21:09.319532+0000","last_became_peered":"2024-03-07T10:21:09.319532+0000","last_unstale":"2024-03-07T10:24:38.274399+0000","last_undegraded":"2024-03-07T10:24:38.274399+0000","last_fullsized":"2024-03-07T10:24:38.274399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:38.274228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:38.274228+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.274228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:58:07.080563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"29'12","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.142740+0000","last_change":"2024-03-07T10:24:21.142801+0000","last_active":"2024-03-07T10:24:21.142740+0000","last_peered":"2024-03-07T10:24:21.142740+0000","last_clean":"2024-03-07T10:24:21.142740+0000","last_became_active":"2024-03-07T10:20:58.140373+0000","last_became_peered":"2024-03-07T10:20:58.140373+0000","last_unstale":"2024-03-07T10:24:21.142740+0000","last_undegraded":"2024-03-07T10:24:21.142740+0000","last_fullsized":"2024-03-07T10:24:21.142740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-03-07T10:24:21.142550+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-03-07T10:24:21.142550+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.142550+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:16:49.948251+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.130504+0000","last_change":"2024-03-07T10:24:36.130598+0000","last_active":"2024-03-07T10:24:36.130504+0000","last_peered":"2024-03-07T10:24:36.130504+0000","last_clean":"2024-03-07T10:24:36.130504+0000","last_became_active":"2024-03-07T10:21:09.301435+0000","last_became_peered":"2024-03-07T10:21:09.301435+0000","last_unstale":"2024-03-07T10:24:36.130504+0000","last_undegraded":"2024-03-07T10:24:36.130504+0000","last_fullsized":"2024-03-07T10:24:36.130504+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.130271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.130271+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.130271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:18:03.415084+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:25.109839+0000","last_change":"2024-03-07T10:24:25.109944+0000","last_active":"2024-03-07T10:24:25.109839+0000","last_peered":"2024-03-07T10:24:25.109839+0000","last_clean":"2024-03-07T10:24:25.109839+0000","last_became_active":"2024-03-07T10:20:58.153177+0000","last_became_peered":"2024-03-07T10:20:58.153177+0000","last_unstale":"2024-03-07T10:24:25.109839+0000","last_undegraded":"2024-03-07T10:24:25.109839+0000","last_fullsized":"2024-03-07T10:24:25.109839+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:25.109651+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:25.109651+0000","last_clean_scrub_stamp":"2024-03-07T10:24:25.109651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:56:56.273706+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.313490+0000","last_change":"2024-03-07T10:24:37.313514+0000","last_active":"2024-03-07T10:24:37.313490+0000","last_peered":"2024-03-07T10:24:37.313490+0000","last_clean":"2024-03-07T10:24:37.313490+0000","last_became_active":"2024-03-07T10:21:09.316554+0000","last_became_peered":"2024-03-07T10:21:09.316554+0000","last_unstale":"2024-03-07T10:24:37.313490+0000","last_undegraded":"2024-03-07T10:24:37.313490+0000","last_fullsized":"2024-03-07T10:24:37.313490+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:37.313413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:37.313413+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.313413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:46:39.725771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.807567+0000","last_change":"2024-03-07T10:24:22.807687+0000","last_active":"2024-03-07T10:24:22.807567+0000","last_peered":"2024-03-07T10:24:22.807567+0000","last_clean":"2024-03-07T10:24:22.807567+0000","last_became_active":"2024-03-07T10:20:58.154345+0000","last_became_peered":"2024-03-07T10:20:58.154345+0000","last_unstale":"2024-03-07T10:24:22.807567+0000","last_undegraded":"2024-03-07T10:24:22.807567+0000","last_fullsized":"2024-03-07T10:24:22.807567+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:22.807360+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:22.807360+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.807360+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:02:28.119365+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.398574+0000","last_change":"2024-03-07T10:24:30.398623+0000","last_active":"2024-03-07T10:24:30.398574+0000","last_peered":"2024-03-07T10:24:30.398574+0000","last_clean":"2024-03-07T10:24:30.398574+0000","last_became_active":"2024-03-07T10:21:09.300596+0000","last_became_peered":"2024-03-07T10:21:09.300596+0000","last_unstale":"2024-03-07T10:24:30.398574+0000","last_undegraded":"2024-03-07T10:24:30.398574+0000","last_fullsized":"2024-03-07T10:24:30.398574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.398430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.398430+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.398430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:26.201845+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.570817+0000","last_change":"2024-03-07T10:24:38.570983+0000","last_active":"2024-03-07T10:24:38.570817+0000","last_peered":"2024-03-07T10:24:38.570817+0000","last_clean":"2024-03-07T10:24:38.570817+0000","last_became_active":"2024-03-07T10:20:58.156246+0000","last_became_peered":"2024-03-07T10:20:58.156246+0000","last_unstale":"2024-03-07T10:24:38.570817+0000","last_undegraded":"2024-03-07T10:24:38.570817+0000","last_fullsized":"2024-03-07T10:24:38.570817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:38.570590+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:38.570590+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.570590+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:36.977414+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.634771+0000","last_change":"2024-03-07T10:24:36.634825+0000","last_active":"2024-03-07T10:24:36.634771+0000","last_peered":"2024-03-07T10:24:36.634771+0000","last_clean":"2024-03-07T10:24:36.634771+0000","last_became_active":"2024-03-07T10:21:09.305128+0000","last_became_peered":"2024-03-07T10:21:09.305128+0000","last_unstale":"2024-03-07T10:24:36.634771+0000","last_undegraded":"2024-03-07T10:24:36.634771+0000","last_fullsized":"2024-03-07T10:24:36.634771+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.634591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.634591+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.634591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:11:32.438006+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.189478+0000","last_change":"2024-03-07T10:24:22.189530+0000","last_active":"2024-03-07T10:24:22.189478+0000","last_peered":"2024-03-07T10:24:22.189478+0000","last_clean":"2024-03-07T10:24:22.189478+0000","last_became_active":"2024-03-07T10:20:58.163900+0000","last_became_peered":"2024-03-07T10:20:58.163900+0000","last_unstale":"2024-03-07T10:24:22.189478+0000","last_undegraded":"2024-03-07T10:24:22.189478+0000","last_fullsized":"2024-03-07T10:24:22.189478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:22.189327+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:22.189327+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.189327+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:43:06.293040+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:42.408410+0000","last_change":"2024-03-07T10:24:42.408557+0000","last_active":"2024-03-07T10:24:42.408410+0000","last_peered":"2024-03-07T10:24:42.408410+0000","last_clean":"2024-03-07T10:24:42.408410+0000","last_became_active":"2024-03-07T10:21:09.306611+0000","last_became_peered":"2024-03-07T10:21:09.306611+0000","last_unstale":"2024-03-07T10:24:42.408410+0000","last_undegraded":"2024-03-07T10:24:42.408410+0000","last_fullsized":"2024-03-07T10:24:42.408410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:42.408132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:42.408132+0000","last_clean_scrub_stamp":"2024-03-07T10:24:42.408132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:34:59.243434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:20.107323+0000","last_change":"2024-03-07T10:24:20.107361+0000","last_active":"2024-03-07T10:24:20.107323+0000","last_peered":"2024-03-07T10:24:20.107323+0000","last_clean":"2024-03-07T10:24:20.107323+0000","last_became_active":"2024-03-07T10:20:58.160745+0000","last_became_peered":"2024-03-07T10:20:58.160745+0000","last_unstale":"2024-03-07T10:24:20.107323+0000","last_undegraded":"2024-03-07T10:24:20.107323+0000","last_fullsized":"2024-03-07T10:24:20.107323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-03-07T10:24:20.107220+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-03-07T10:24:20.107220+0000","last_clean_scrub_stamp":"2024-03-07T10:24:20.107220+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:45.922892+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.129777+0000","last_change":"2024-03-07T10:24:38.129835+0000","last_active":"2024-03-07T10:24:38.129777+0000","last_peered":"2024-03-07T10:24:38.129777+0000","last_clean":"2024-03-07T10:24:38.129777+0000","last_became_active":"2024-03-07T10:21:09.308520+0000","last_became_peered":"2024-03-07T10:21:09.308520+0000","last_unstale":"2024-03-07T10:24:38.129777+0000","last_undegraded":"2024-03-07T10:24:38.129777+0000","last_fullsized":"2024-03-07T10:24:38.129777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:38.129516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:38.129516+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.129516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:22.200421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:37.569685+0000","last_change":"2024-03-07T10:24:37.569753+0000","last_active":"2024-03-07T10:24:37.569685+0000","last_peered":"2024-03-07T10:24:37.569685+0000","last_clean":"2024-03-07T10:24:37.569685+0000","last_became_active":"2024-03-07T10:20:58.153321+0000","last_became_peered":"2024-03-07T10:20:58.153321+0000","last_unstale":"2024-03-07T10:24:37.569685+0000","last_undegraded":"2024-03-07T10:24:37.569685+0000","last_fullsized":"2024-03-07T10:24:37.569685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-03-07T10:24:37.569488+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-03-07T10:24:37.569488+0000","last_clean_scrub_stamp":"2024-03-07T10:24:37.569488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:06:54.804406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:45.500026+0000","last_change":"2024-03-07T10:24:45.500079+0000","last_active":"2024-03-07T10:24:45.500026+0000","last_peered":"2024-03-07T10:24:45.500026+0000","last_clean":"2024-03-07T10:24:45.500026+0000","last_became_active":"2024-03-07T10:21:09.321111+0000","last_became_peered":"2024-03-07T10:21:09.321111+0000","last_unstale":"2024-03-07T10:24:45.500026+0000","last_undegraded":"2024-03-07T10:24:45.500026+0000","last_fullsized":"2024-03-07T10:24:45.500026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:45.499801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:45.499801+0000","last_clean_scrub_stamp":"2024-03-07T10:24:45.499801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:35:58.029989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"29'6","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:43.055630+0000","last_change":"2024-03-07T10:24:43.055691+0000","last_active":"2024-03-07T10:24:43.055630+0000","last_peered":"2024-03-07T10:24:43.055630+0000","last_clean":"2024-03-07T10:24:43.055630+0000","last_became_active":"2024-03-07T10:21:39.580784+0000","last_became_peered":"2024-03-07T10:21:39.580784+0000","last_unstale":"2024-03-07T10:24:43.055630+0000","last_undegraded":"2024-03-07T10:24:43.055630+0000","last_fullsized":"2024-03-07T10:24:43.055630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:43.055432+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:43.055432+0000","last_clean_scrub_stamp":"2024-03-07T10:24:43.055432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:06:51.779994+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:41.423074+0000","last_change":"2024-03-07T10:24:41.423132+0000","last_active":"2024-03-07T10:24:41.423074+0000","last_peered":"2024-03-07T10:24:41.423074+0000","last_clean":"2024-03-07T10:24:41.423074+0000","last_became_active":"2024-03-07T10:21:09.302670+0000","last_became_peered":"2024-03-07T10:21:09.302670+0000","last_unstale":"2024-03-07T10:24:41.423074+0000","last_undegraded":"2024-03-07T10:24:41.423074+0000","last_fullsized":"2024-03-07T10:24:41.423074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:41.422825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:41.422825+0000","last_clean_scrub_stamp":"2024-03-07T10:24:41.422825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:39.829648+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.633519+0000","last_change":"2024-03-07T10:24:28.633694+0000","last_active":"2024-03-07T10:24:28.633519+0000","last_peered":"2024-03-07T10:24:28.633519+0000","last_clean":"2024-03-07T10:24:28.633519+0000","last_became_active":"2024-03-07T10:20:58.153477+0000","last_became_peered":"2024-03-07T10:20:58.153477+0000","last_unstale":"2024-03-07T10:24:28.633519+0000","last_undegraded":"2024-03-07T10:24:28.633519+0000","last_fullsized":"2024-03-07T10:24:28.633519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:28.633234+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:28.633234+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.633234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:32:29.144252+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.179727+0000","last_change":"2024-03-07T10:24:24.179781+0000","last_active":"2024-03-07T10:24:24.179727+0000","last_peered":"2024-03-07T10:24:24.179727+0000","last_clean":"2024-03-07T10:24:24.179727+0000","last_became_active":"2024-03-07T10:21:09.303116+0000","last_became_peered":"2024-03-07T10:21:09.303116+0000","last_unstale":"2024-03-07T10:24:24.179727+0000","last_undegraded":"2024-03-07T10:24:24.179727+0000","last_fullsized":"2024-03-07T10:24:24.179727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:24.179549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:24.179549+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.179549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:49:21.925572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"29'10","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.289786+0000","last_change":"2024-03-07T10:24:31.289863+0000","last_active":"2024-03-07T10:24:31.289786+0000","last_peered":"2024-03-07T10:24:31.289786+0000","last_clean":"2024-03-07T10:24:31.289786+0000","last_became_active":"2024-03-07T10:21:39.612675+0000","last_became_peered":"2024-03-07T10:21:39.612675+0000","last_unstale":"2024-03-07T10:24:31.289786+0000","last_undegraded":"2024-03-07T10:24:31.289786+0000","last_fullsized":"2024-03-07T10:24:31.289786+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:31.289608+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:31.289608+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.289608+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:55:56.941899+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:46.452537+0000","last_change":"2024-03-07T10:24:46.452587+0000","last_active":"2024-03-07T10:24:46.452537+0000","last_peered":"2024-03-07T10:24:46.452537+0000","last_clean":"2024-03-07T10:24:46.452537+0000","last_became_active":"2024-03-07T10:21:09.322256+0000","last_became_peered":"2024-03-07T10:21:09.322256+0000","last_unstale":"2024-03-07T10:24:46.452537+0000","last_undegraded":"2024-03-07T10:24:46.452537+0000","last_fullsized":"2024-03-07T10:24:46.452537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:46.452367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:46.452367+0000","last_clean_scrub_stamp":"2024-03-07T10:24:46.452367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:45:55.053438+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:14.713565+0000","last_change":"2024-03-07T10:24:14.713624+0000","last_active":"2024-03-07T10:24:14.713565+0000","last_peered":"2024-03-07T10:24:14.713565+0000","last_clean":"2024-03-07T10:24:14.713565+0000","last_became_active":"2024-03-07T10:20:58.166135+0000","last_became_peered":"2024-03-07T10:20:58.166135+0000","last_unstale":"2024-03-07T10:24:14.713565+0000","last_undegraded":"2024-03-07T10:24:14.713565+0000","last_fullsized":"2024-03-07T10:24:14.713565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:14.713377+0000","last_clean_scrub_stamp":"2024-03-07T10:24:14.713377+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:59:06.356523+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.650405+0000","last_change":"2024-03-07T10:24:33.650462+0000","last_active":"2024-03-07T10:24:33.650405+0000","last_peered":"2024-03-07T10:24:33.650405+0000","last_clean":"2024-03-07T10:24:33.650405+0000","last_became_active":"2024-03-07T10:21:09.300010+0000","last_became_peered":"2024-03-07T10:21:09.300010+0000","last_unstale":"2024-03-07T10:24:33.650405+0000","last_undegraded":"2024-03-07T10:24:33.650405+0000","last_fullsized":"2024-03-07T10:24:33.650405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:33.650223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:33.650223+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.650223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:49.810636+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.225326+0000","last_change":"2024-03-07T10:24:29.225384+0000","last_active":"2024-03-07T10:24:29.225326+0000","last_peered":"2024-03-07T10:24:29.225326+0000","last_clean":"2024-03-07T10:24:29.225326+0000","last_became_active":"2024-03-07T10:20:58.158363+0000","last_became_peered":"2024-03-07T10:20:58.158363+0000","last_unstale":"2024-03-07T10:24:29.225326+0000","last_undegraded":"2024-03-07T10:24:29.225326+0000","last_fullsized":"2024-03-07T10:24:29.225326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:29.225138+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:29.225138+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.225138+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:04:30.403220+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:38.637594+0000","last_change":"2024-03-07T10:24:38.637694+0000","last_active":"2024-03-07T10:24:38.637594+0000","last_peered":"2024-03-07T10:24:38.637594+0000","last_clean":"2024-03-07T10:24:38.637594+0000","last_became_active":"2024-03-07T10:21:09.309918+0000","last_became_peered":"2024-03-07T10:21:09.309918+0000","last_unstale":"2024-03-07T10:24:38.637594+0000","last_undegraded":"2024-03-07T10:24:38.637594+0000","last_fullsized":"2024-03-07T10:24:38.637594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:38.637392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:38.637392+0000","last_clean_scrub_stamp":"2024-03-07T10:24:38.637392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:44:47.026651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.410732+0000","last_change":"2024-03-07T10:24:27.410795+0000","last_active":"2024-03-07T10:24:27.410732+0000","last_peered":"2024-03-07T10:24:27.410732+0000","last_clean":"2024-03-07T10:24:27.410732+0000","last_became_active":"2024-03-07T10:20:58.151471+0000","last_became_peered":"2024-03-07T10:20:58.151471+0000","last_unstale":"2024-03-07T10:24:27.410732+0000","last_undegraded":"2024-03-07T10:24:27.410732+0000","last_fullsized":"2024-03-07T10:24:27.410732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:27.410545+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:27.410545+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.410545+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:43.570958+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:42.081270+0000","last_change":"2024-03-07T10:24:42.081324+0000","last_active":"2024-03-07T10:24:42.081270+0000","last_peered":"2024-03-07T10:24:42.081270+0000","last_clean":"2024-03-07T10:24:42.081270+0000","last_became_active":"2024-03-07T10:21:09.321139+0000","last_became_peered":"2024-03-07T10:21:09.321139+0000","last_unstale":"2024-03-07T10:24:42.081270+0000","last_undegraded":"2024-03-07T10:24:42.081270+0000","last_fullsized":"2024-03-07T10:24:42.081270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:42.081019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:42.081019+0000","last_clean_scrub_stamp":"2024-03-07T10:24:42.081019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:34:58.916321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.166778+0000","last_change":"2024-03-07T10:24:22.166901+0000","last_active":"2024-03-07T10:24:22.166778+0000","last_peered":"2024-03-07T10:24:22.166778+0000","last_clean":"2024-03-07T10:24:22.166778+0000","last_became_active":"2024-03-07T10:20:58.161774+0000","last_became_peered":"2024-03-07T10:20:58.161774+0000","last_unstale":"2024-03-07T10:24:22.166778+0000","last_undegraded":"2024-03-07T10:24:22.166778+0000","last_fullsized":"2024-03-07T10:24:22.166778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:22.166521+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:22.166521+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.166521+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:02:36.197635+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.820639+0000","last_change":"2024-03-07T10:24:30.820689+0000","last_active":"2024-03-07T10:24:30.820639+0000","last_peered":"2024-03-07T10:24:30.820639+0000","last_clean":"2024-03-07T10:24:30.820639+0000","last_became_active":"2024-03-07T10:21:09.302755+0000","last_became_peered":"2024-03-07T10:21:09.302755+0000","last_unstale":"2024-03-07T10:24:30.820639+0000","last_undegraded":"2024-03-07T10:24:30.820639+0000","last_fullsized":"2024-03-07T10:24:30.820639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.820448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.820448+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.820448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:26:17.145351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"29'8","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:32.321373+0000","last_change":"2024-03-07T10:24:32.321425+0000","last_active":"2024-03-07T10:24:32.321373+0000","last_peered":"2024-03-07T10:24:32.321373+0000","last_clean":"2024-03-07T10:24:32.321373+0000","last_became_active":"2024-03-07T10:21:39.613170+0000","last_became_peered":"2024-03-07T10:21:39.613170+0000","last_unstale":"2024-03-07T10:24:32.321373+0000","last_undegraded":"2024-03-07T10:24:32.321373+0000","last_fullsized":"2024-03-07T10:24:32.321373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:32.321206+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:32.321206+0000","last_clean_scrub_stamp":"2024-03-07T10:24:32.321206+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:52:44.146666+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:39.274541+0000","last_change":"2024-03-07T10:24:39.274649+0000","last_active":"2024-03-07T10:24:39.274541+0000","last_peered":"2024-03-07T10:24:39.274541+0000","last_clean":"2024-03-07T10:24:39.274541+0000","last_became_active":"2024-03-07T10:21:09.329039+0000","last_became_peered":"2024-03-07T10:21:09.329039+0000","last_unstale":"2024-03-07T10:24:39.274541+0000","last_undegraded":"2024-03-07T10:24:39.274541+0000","last_fullsized":"2024-03-07T10:24:39.274541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:39.274315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:39.274315+0000","last_clean_scrub_stamp":"2024-03-07T10:24:39.274315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:17:49.729265+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.189248+0000","last_change":"2024-03-07T10:24:34.189305+0000","last_active":"2024-03-07T10:24:34.189248+0000","last_peered":"2024-03-07T10:24:34.189248+0000","last_clean":"2024-03-07T10:24:34.189248+0000","last_became_active":"2024-03-07T10:20:58.146886+0000","last_became_peered":"2024-03-07T10:20:58.146886+0000","last_unstale":"2024-03-07T10:24:34.189248+0000","last_undegraded":"2024-03-07T10:24:34.189248+0000","last_fullsized":"2024-03-07T10:24:34.189248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:34.189056+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:34.189056+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.189056+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T19:29:51.169951+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:39.672850+0000","last_change":"2024-03-07T10:24:39.672902+0000","last_active":"2024-03-07T10:24:39.672850+0000","last_peered":"2024-03-07T10:24:39.672850+0000","last_clean":"2024-03-07T10:24:39.672850+0000","last_became_active":"2024-03-07T10:21:09.315406+0000","last_became_peered":"2024-03-07T10:21:09.315406+0000","last_unstale":"2024-03-07T10:24:39.672850+0000","last_undegraded":"2024-03-07T10:24:39.672850+0000","last_fullsized":"2024-03-07T10:24:39.672850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:39.672688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:39.672688+0000","last_clean_scrub_stamp":"2024-03-07T10:24:39.672688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:31.001293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.223205+0000","last_change":"2024-03-07T10:24:24.223326+0000","last_active":"2024-03-07T10:24:24.223205+0000","last_peered":"2024-03-07T10:24:24.223205+0000","last_clean":"2024-03-07T10:24:24.223205+0000","last_became_active":"2024-03-07T10:20:58.161017+0000","last_became_peered":"2024-03-07T10:20:58.161017+0000","last_unstale":"2024-03-07T10:24:24.223205+0000","last_undegraded":"2024-03-07T10:24:24.223205+0000","last_fullsized":"2024-03-07T10:24:24.223205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:24.222992+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:24.222992+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.222992+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T12:55:05.731749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.062559+0000","last_change":"2024-03-07T10:24:24.062616+0000","last_active":"2024-03-07T10:24:24.062559+0000","last_peered":"2024-03-07T10:24:24.062559+0000","last_clean":"2024-03-07T10:24:24.062559+0000","last_became_active":"2024-03-07T10:21:09.297790+0000","last_became_peered":"2024-03-07T10:21:09.297790+0000","last_unstale":"2024-03-07T10:24:24.062559+0000","last_undegraded":"2024-03-07T10:24:24.062559+0000","last_fullsized":"2024-03-07T10:24:24.062559+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:24.062314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:24.062314+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.062314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:02.965863+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:13.761596+0000","last_change":"2024-03-07T10:24:13.761626+0000","last_active":"2024-03-07T10:24:13.761596+0000","last_peered":"2024-03-07T10:24:13.761596+0000","last_clean":"2024-03-07T10:24:13.761596+0000","last_became_active":"2024-03-07T10:20:58.161226+0000","last_became_peered":"2024-03-07T10:20:58.161226+0000","last_unstale":"2024-03-07T10:24:13.761596+0000","last_undegraded":"2024-03-07T10:24:13.761596+0000","last_fullsized":"2024-03-07T10:24:13.761596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:13.761490+0000","last_clean_scrub_stamp":"2024-03-07T10:24:13.761490+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:48:02.086659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:47.469158+0000","last_change":"2024-03-07T10:24:47.469212+0000","last_active":"2024-03-07T10:24:47.469158+0000","last_peered":"2024-03-07T10:24:47.469158+0000","last_clean":"2024-03-07T10:24:47.469158+0000","last_became_active":"2024-03-07T10:21:09.326612+0000","last_became_peered":"2024-03-07T10:21:09.326612+0000","last_unstale":"2024-03-07T10:24:47.469158+0000","last_undegraded":"2024-03-07T10:24:47.469158+0000","last_fullsized":"2024-03-07T10:24:47.469158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:47.468918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:47.468918+0000","last_clean_scrub_stamp":"2024-03-07T10:24:47.468918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:30:16.549941+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.672084+0000","last_change":"2024-03-07T10:24:30.672176+0000","last_active":"2024-03-07T10:24:30.672084+0000","last_peered":"2024-03-07T10:24:30.672084+0000","last_clean":"2024-03-07T10:24:30.672084+0000","last_became_active":"2024-03-07T10:20:58.157148+0000","last_became_peered":"2024-03-07T10:20:58.157148+0000","last_unstale":"2024-03-07T10:24:30.672084+0000","last_undegraded":"2024-03-07T10:24:30.672084+0000","last_fullsized":"2024-03-07T10:24:30.672084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-03-07T10:24:30.671826+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-03-07T10:24:30.671826+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.671826+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:22.000431+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"27'3","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:43.539017+0000","last_change":"2024-03-07T10:24:43.539081+0000","last_active":"2024-03-07T10:24:43.539017+0000","last_peered":"2024-03-07T10:24:43.539017+0000","last_clean":"2024-03-07T10:24:43.539017+0000","last_became_active":"2024-03-07T10:21:09.316445+0000","last_became_peered":"2024-03-07T10:21:09.316445+0000","last_unstale":"2024-03-07T10:24:43.539017+0000","last_undegraded":"2024-03-07T10:24:43.539017+0000","last_fullsized":"2024-03-07T10:24:43.539017+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-03-07T10:24:43.538789+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-03-07T10:24:43.538789+0000","last_clean_scrub_stamp":"2024-03-07T10:24:43.538789+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:30:53.988058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:29.725661+0000","last_change":"2024-03-07T10:24:29.725723+0000","last_active":"2024-03-07T10:24:29.725661+0000","last_peered":"2024-03-07T10:24:29.725661+0000","last_clean":"2024-03-07T10:24:29.725661+0000","last_became_active":"2024-03-07T10:20:58.163163+0000","last_became_peered":"2024-03-07T10:20:58.163163+0000","last_unstale":"2024-03-07T10:24:29.725661+0000","last_undegraded":"2024-03-07T10:24:29.725661+0000","last_fullsized":"2024-03-07T10:24:29.725661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:29.725437+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:29.725437+0000","last_clean_scrub_stamp":"2024-03-07T10:24:29.725437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:40.039896+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.264449+0000","last_change":"2024-03-07T10:24:30.264502+0000","last_active":"2024-03-07T10:24:30.264449+0000","last_peered":"2024-03-07T10:24:30.264449+0000","last_clean":"2024-03-07T10:24:30.264449+0000","last_became_active":"2024-03-07T10:21:09.317556+0000","last_became_peered":"2024-03-07T10:21:09.317556+0000","last_unstale":"2024-03-07T10:24:30.264449+0000","last_undegraded":"2024-03-07T10:24:30.264449+0000","last_fullsized":"2024-03-07T10:24:30.264449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:30.264240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:30.264240+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.264240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:32:07.591361+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.082279+0000","last_change":"2024-03-07T10:24:21.082343+0000","last_active":"2024-03-07T10:24:21.082279+0000","last_peered":"2024-03-07T10:24:21.082279+0000","last_clean":"2024-03-07T10:24:21.082279+0000","last_became_active":"2024-03-07T10:20:58.169260+0000","last_became_peered":"2024-03-07T10:20:58.169260+0000","last_unstale":"2024-03-07T10:24:21.082279+0000","last_undegraded":"2024-03-07T10:24:21.082279+0000","last_fullsized":"2024-03-07T10:24:21.082279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:21.082014+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:21.082014+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.082014+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T22:21:07.255204+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:40.449420+0000","last_change":"2024-03-07T10:24:40.449540+0000","last_active":"2024-03-07T10:24:40.449420+0000","last_peered":"2024-03-07T10:24:40.449420+0000","last_clean":"2024-03-07T10:24:40.449420+0000","last_became_active":"2024-03-07T10:21:09.303057+0000","last_became_peered":"2024-03-07T10:21:09.303057+0000","last_unstale":"2024-03-07T10:24:40.449420+0000","last_undegraded":"2024-03-07T10:24:40.449420+0000","last_fullsized":"2024-03-07T10:24:40.449420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:40.449185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:40.449185+0000","last_clean_scrub_stamp":"2024-03-07T10:24:40.449185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:06:57.684103+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"29'16","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:30.223509+0000","last_change":"2024-03-07T10:24:30.223578+0000","last_active":"2024-03-07T10:24:30.223509+0000","last_peered":"2024-03-07T10:24:30.223509+0000","last_clean":"2024-03-07T10:24:30.223509+0000","last_became_active":"2024-03-07T10:20:58.155850+0000","last_became_peered":"2024-03-07T10:20:58.155850+0000","last_unstale":"2024-03-07T10:24:30.223509+0000","last_undegraded":"2024-03-07T10:24:30.223509+0000","last_fullsized":"2024-03-07T10:24:30.223509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-03-07T10:24:30.223314+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-03-07T10:24:30.223314+0000","last_clean_scrub_stamp":"2024-03-07T10:24:30.223314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:36:38.101575+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.150871+0000","last_change":"2024-03-07T10:24:26.150969+0000","last_active":"2024-03-07T10:24:26.150871+0000","last_peered":"2024-03-07T10:24:26.150871+0000","last_clean":"2024-03-07T10:24:26.150871+0000","last_became_active":"2024-03-07T10:21:09.298479+0000","last_became_peered":"2024-03-07T10:21:09.298479+0000","last_unstale":"2024-03-07T10:24:26.150871+0000","last_undegraded":"2024-03-07T10:24:26.150871+0000","last_fullsized":"2024-03-07T10:24:26.150871+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.150688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.150688+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.150688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:51:10.221593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"29'11","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:24.403513+0000","last_change":"2024-03-07T10:24:24.403568+0000","last_active":"2024-03-07T10:24:24.403513+0000","last_peered":"2024-03-07T10:24:24.403513+0000","last_clean":"2024-03-07T10:24:24.403513+0000","last_became_active":"2024-03-07T10:20:58.173649+0000","last_became_peered":"2024-03-07T10:20:58.173649+0000","last_unstale":"2024-03-07T10:24:24.403513+0000","last_undegraded":"2024-03-07T10:24:24.403513+0000","last_fullsized":"2024-03-07T10:24:24.403513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'11","last_scrub_stamp":"2024-03-07T10:24:24.403348+0000","last_deep_scrub":"29'11","last_deep_scrub_stamp":"2024-03-07T10:24:24.403348+0000","last_clean_scrub_stamp":"2024-03-07T10:24:24.403348+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T16:34:03.306897+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:40.528868+0000","last_change":"2024-03-07T10:24:40.528907+0000","last_active":"2024-03-07T10:24:40.528868+0000","last_peered":"2024-03-07T10:24:40.528868+0000","last_clean":"2024-03-07T10:24:40.528868+0000","last_became_active":"2024-03-07T10:21:09.310414+0000","last_became_peered":"2024-03-07T10:21:09.310414+0000","last_unstale":"2024-03-07T10:24:40.528868+0000","last_undegraded":"2024-03-07T10:24:40.528868+0000","last_fullsized":"2024-03-07T10:24:40.528868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:40.528729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:40.528729+0000","last_clean_scrub_stamp":"2024-03-07T10:24:40.528729+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:06:49.253292+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"29'9","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:22.664057+0000","last_change":"2024-03-07T10:24:22.664120+0000","last_active":"2024-03-07T10:24:22.664057+0000","last_peered":"2024-03-07T10:24:22.664057+0000","last_clean":"2024-03-07T10:24:22.664057+0000","last_became_active":"2024-03-07T10:20:58.164832+0000","last_became_peered":"2024-03-07T10:20:58.164832+0000","last_unstale":"2024-03-07T10:24:22.664057+0000","last_undegraded":"2024-03-07T10:24:22.664057+0000","last_fullsized":"2024-03-07T10:24:22.664057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'9","last_scrub_stamp":"2024-03-07T10:24:22.663866+0000","last_deep_scrub":"29'9","last_deep_scrub_stamp":"2024-03-07T10:24:22.663866+0000","last_clean_scrub_stamp":"2024-03-07T10:24:22.663866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:56:53.827921+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:36.204257+0000","last_change":"2024-03-07T10:24:36.204313+0000","last_active":"2024-03-07T10:24:36.204257+0000","last_peered":"2024-03-07T10:24:36.204257+0000","last_clean":"2024-03-07T10:24:36.204257+0000","last_became_active":"2024-03-07T10:21:09.296693+0000","last_became_peered":"2024-03-07T10:21:09.296693+0000","last_unstale":"2024-03-07T10:24:36.204257+0000","last_undegraded":"2024-03-07T10:24:36.204257+0000","last_fullsized":"2024-03-07T10:24:36.204257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:36.204064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:36.204064+0000","last_clean_scrub_stamp":"2024-03-07T10:24:36.204064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:21:16.509777+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"29'5","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:39.423921+0000","last_change":"2024-03-07T10:24:39.423985+0000","last_active":"2024-03-07T10:24:39.423921+0000","last_peered":"2024-03-07T10:24:39.423921+0000","last_clean":"2024-03-07T10:24:39.423921+0000","last_became_active":"2024-03-07T10:20:58.143634+0000","last_became_peered":"2024-03-07T10:20:58.143634+0000","last_unstale":"2024-03-07T10:24:39.423921+0000","last_undegraded":"2024-03-07T10:24:39.423921+0000","last_fullsized":"2024-03-07T10:24:39.423921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-03-07T10:24:39.423737+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-03-07T10:24:39.423737+0000","last_clean_scrub_stamp":"2024-03-07T10:24:39.423737+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:00:16.776134+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:34.355009+0000","last_change":"2024-03-07T10:24:34.355060+0000","last_active":"2024-03-07T10:24:34.355009+0000","last_peered":"2024-03-07T10:24:34.355009+0000","last_clean":"2024-03-07T10:24:34.355009+0000","last_became_active":"2024-03-07T10:21:09.314212+0000","last_became_peered":"2024-03-07T10:21:09.314212+0000","last_unstale":"2024-03-07T10:24:34.355009+0000","last_undegraded":"2024-03-07T10:24:34.355009+0000","last_fullsized":"2024-03-07T10:24:34.355009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:34.354802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:34.354802+0000","last_clean_scrub_stamp":"2024-03-07T10:24:34.354802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T15:50:48.356285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"29'6","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:33.165239+0000","last_change":"2024-03-07T10:24:33.165300+0000","last_active":"2024-03-07T10:24:33.165239+0000","last_peered":"2024-03-07T10:24:33.165239+0000","last_clean":"2024-03-07T10:24:33.165239+0000","last_became_active":"2024-03-07T10:20:58.146382+0000","last_became_peered":"2024-03-07T10:20:58.146382+0000","last_unstale":"2024-03-07T10:24:33.165239+0000","last_undegraded":"2024-03-07T10:24:33.165239+0000","last_fullsized":"2024-03-07T10:24:33.165239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-03-07T10:24:33.165015+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-03-07T10:24:33.165015+0000","last_clean_scrub_stamp":"2024-03-07T10:24:33.165015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:58:24.493619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:40.088730+0000","last_change":"2024-03-07T10:24:40.088785+0000","last_active":"2024-03-07T10:24:40.088730+0000","last_peered":"2024-03-07T10:24:40.088730+0000","last_clean":"2024-03-07T10:24:40.088730+0000","last_became_active":"2024-03-07T10:21:09.317099+0000","last_became_peered":"2024-03-07T10:21:09.317099+0000","last_unstale":"2024-03-07T10:24:40.088730+0000","last_undegraded":"2024-03-07T10:24:40.088730+0000","last_fullsized":"2024-03-07T10:24:40.088730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:40.088524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:40.088524+0000","last_clean_scrub_stamp":"2024-03-07T10:24:40.088524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T13:06:57.323442+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:23.376995+0000","last_change":"2024-03-07T10:24:23.377074+0000","last_active":"2024-03-07T10:24:23.376995+0000","last_peered":"2024-03-07T10:24:23.376995+0000","last_clean":"2024-03-07T10:24:23.376995+0000","last_became_active":"2024-03-07T10:20:58.157833+0000","last_became_peered":"2024-03-07T10:20:58.157833+0000","last_unstale":"2024-03-07T10:24:23.376995+0000","last_undegraded":"2024-03-07T10:24:23.376995+0000","last_fullsized":"2024-03-07T10:24:23.376995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:23.376803+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:23.376803+0000","last_clean_scrub_stamp":"2024-03-07T10:24:23.376803+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:47:33.691262+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:39.568863+0000","last_change":"2024-03-07T10:24:39.568920+0000","last_active":"2024-03-07T10:24:39.568863+0000","last_peered":"2024-03-07T10:24:39.568863+0000","last_clean":"2024-03-07T10:24:39.568863+0000","last_became_active":"2024-03-07T10:21:09.297667+0000","last_became_peered":"2024-03-07T10:21:09.297667+0000","last_unstale":"2024-03-07T10:24:39.568863+0000","last_undegraded":"2024-03-07T10:24:39.568863+0000","last_fullsized":"2024-03-07T10:24:39.568863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:39.568641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:39.568641+0000","last_clean_scrub_stamp":"2024-03-07T10:24:39.568641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:34:56.403943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:27.194782+0000","last_change":"2024-03-07T10:24:27.194840+0000","last_active":"2024-03-07T10:24:27.194782+0000","last_peered":"2024-03-07T10:24:27.194782+0000","last_clean":"2024-03-07T10:24:27.194782+0000","last_became_active":"2024-03-07T10:20:58.151944+0000","last_became_peered":"2024-03-07T10:20:58.151944+0000","last_unstale":"2024-03-07T10:24:27.194782+0000","last_undegraded":"2024-03-07T10:24:27.194782+0000","last_fullsized":"2024-03-07T10:24:27.194782+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:27.194547+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:27.194547+0000","last_clean_scrub_stamp":"2024-03-07T10:24:27.194547+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T14:59:43.354960+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:26.214915+0000","last_change":"2024-03-07T10:24:26.215000+0000","last_active":"2024-03-07T10:24:26.214915+0000","last_peered":"2024-03-07T10:24:26.214915+0000","last_clean":"2024-03-07T10:24:26.214915+0000","last_became_active":"2024-03-07T10:21:09.309009+0000","last_became_peered":"2024-03-07T10:21:09.309009+0000","last_unstale":"2024-03-07T10:24:26.214915+0000","last_undegraded":"2024-03-07T10:24:26.214915+0000","last_fullsized":"2024-03-07T10:24:26.214915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:26.214669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:26.214669+0000","last_clean_scrub_stamp":"2024-03-07T10:24:26.214669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:34.012522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"29'7","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:21.839756+0000","last_change":"2024-03-07T10:24:21.839824+0000","last_active":"2024-03-07T10:24:21.839756+0000","last_peered":"2024-03-07T10:24:21.839756+0000","last_clean":"2024-03-07T10:24:21.839756+0000","last_became_active":"2024-03-07T10:20:58.152230+0000","last_became_peered":"2024-03-07T10:20:58.152230+0000","last_unstale":"2024-03-07T10:24:21.839756+0000","last_undegraded":"2024-03-07T10:24:21.839756+0000","last_fullsized":"2024-03-07T10:24:21.839756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-03-07T10:24:21.839562+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-03-07T10:24:21.839562+0000","last_clean_scrub_stamp":"2024-03-07T10:24:21.839562+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T20:57:29.637414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:45.401777+0000","last_change":"2024-03-07T10:24:45.401833+0000","last_active":"2024-03-07T10:24:45.401777+0000","last_peered":"2024-03-07T10:24:45.401777+0000","last_clean":"2024-03-07T10:24:45.401777+0000","last_became_active":"2024-03-07T10:21:09.315749+0000","last_became_peered":"2024-03-07T10:21:09.315749+0000","last_unstale":"2024-03-07T10:24:45.401777+0000","last_undegraded":"2024-03-07T10:24:45.401777+0000","last_fullsized":"2024-03-07T10:24:45.401777+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:45.401607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:45.401607+0000","last_clean_scrub_stamp":"2024-03-07T10:24:45.401607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:16.886863+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:31.240509+0000","last_change":"2024-03-07T10:24:31.240580+0000","last_active":"2024-03-07T10:24:31.240509+0000","last_peered":"2024-03-07T10:24:31.240509+0000","last_clean":"2024-03-07T10:24:31.240509+0000","last_became_active":"2024-03-07T10:20:58.159072+0000","last_became_peered":"2024-03-07T10:20:58.159072+0000","last_unstale":"2024-03-07T10:24:31.240509+0000","last_undegraded":"2024-03-07T10:24:31.240509+0000","last_fullsized":"2024-03-07T10:24:31.240509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-03-07T10:24:31.240315+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-03-07T10:24:31.240315+0000","last_clean_scrub_stamp":"2024-03-07T10:24:31.240315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T10:33:21.731725+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:28.381999+0000","last_change":"2024-03-07T10:24:28.382081+0000","last_active":"2024-03-07T10:24:28.381999+0000","last_peered":"2024-03-07T10:24:28.381999+0000","last_clean":"2024-03-07T10:24:28.381999+0000","last_became_active":"2024-03-07T10:21:09.300045+0000","last_became_peered":"2024-03-07T10:21:09.300045+0000","last_unstale":"2024-03-07T10:24:28.381999+0000","last_undegraded":"2024-03-07T10:24:28.381999+0000","last_fullsized":"2024-03-07T10:24:28.381999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-07T10:24:28.381797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-07T10:24:28.381797+0000","last_clean_scrub_stamp":"2024-03-07T10:24:28.381797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T18:26:14.454373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-03-07T10:24:19.371263+0000","last_change":"2024-03-07T10:24:19.371320+0000","last_active":"2024-03-07T10:24:19.371263+0000","last_peered":"2024-03-07T10:24:19.371263+0000","last_clean":"2024-03-07T10:24:19.371263+0000","last_became_active":"2024-03-07T10:20:58.158652+0000","last_became_peered":"2024-03-07T10:20:58.158652+0000","last_unstale":"2024-03-07T10:24:19.371263+0000","last_undegraded":"2024-03-07T10:24:19.371263+0000","last_fullsized":"2024-03-07T10:24:19.371263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-03-07T10:24:19.371028+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-03-07T10:24:19.371028+0000","last_clean_scrub_stamp":"2024-03-07T10:24:19.371028+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-08T21:19:34.114208+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":44910,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":158,"num_read_kb":200,"num_write":101,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":89820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39213,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":80,"num_read_kb":88,"num_write":89,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":78426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":107,"ondisk_log_size":107,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":917504,"data_stored":725400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":372736,"data_stored":172987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":331776,"data_stored":135526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":134994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":425984,"data_stored":216505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27332,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344508,"statfs":{"total":96636764160,"available":96608776192,"internally_reserved":0,"allocated":323584,"data_stored":134834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":380928,"data_stored":178250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":921600,"data_stored":725366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":38415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":43730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-07T10:25:00.743 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-07T10:25:00.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.969+0000 7fa7d6200640 1 Processor -- start 2024-03-07T10:25:00.971 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.969+0000 7fa7d6200640 1 -- start start 2024-03-07T10:25:00.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d6200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fa7d00c8d90 0x7fa7d0155550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.973 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d6200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7d0159020 0x7fa7d0159490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d6200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d0155b30 con 0x7fa7d014f7c0 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d6200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d0155e10 con 0x7fa7d0159020 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d6200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d01560f0 con 0x7fa7d00c8d90 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7d0159020 0x7fa7d0159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7d0159020 0x7fa7d0159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51270/0 (socket says 172.21.15.194:51270) 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7d5800640 1 -- 172.21.15.194:0/2383185118 learned_addr learned my addr 172.21.15.194:0/2383185118 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.971+0000 7fa7cfe00640 1 --2- 172.21.15.194:0/2383185118 >> v2:172.21.15.196:3300/0 conn(0x7fa7d00c8d90 0x7fa7d0155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.972+0000 7fa7d5800640 1 -- 172.21.15.194:0/2383185118 >> v2:172.21.15.196:3300/0 conn(0x7fa7d00c8d90 msgr2=0x7fa7d0155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.972+0000 7fa7d5800640 1 --2- 172.21.15.194:0/2383185118 >> v2:172.21.15.196:3300/0 conn(0x7fa7d00c8d90 0x7fa7d0155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.972+0000 7fa7d5800640 1 -- 172.21.15.194:0/2383185118 >> v1:172.21.15.196:6789/0 conn(0x7fa7d014f7c0 legacy=0x7fa7d00c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:00.974 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.972+0000 7fa7d5800640 1 -- 172.21.15.194:0/2383185118 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d01563d0 con 0x7fa7d0159020 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.973+0000 7fa7d5800640 1 --2- 172.21.15.194:0/2383185118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0159020 0x7fa7d0159490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00c8990 tx=0x7fa7c802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e5d1a0dcb7103f server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.973+0000 7fa7cf400640 1 -- 172.21.15.194:0/2383185118 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c802c9f0 con 0x7fa7d0159020 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.973+0000 7fa7cf400640 1 -- 172.21.15.194:0/2383185118 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c802cb90 con 0x7fa7d0159020 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.973+0000 7fa7cf400640 1 -- 172.21.15.194:0/2383185118 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80343f0 con 0x7fa7d0159020 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 -- 172.21.15.194:0/2383185118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0159020 msgr2=0x7fa7d0159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 --2- 172.21.15.194:0/2383185118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0159020 0x7fa7d0159490 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00c8990 tx=0x7fa7c802be50 comp rx=0 tx=0).stop 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 -- 172.21.15.194:0/2383185118 shutdown_connections 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 --2- 172.21.15.194:0/2383185118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d0159020 0x7fa7d0159490 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 --2- 172.21.15.194:0/2383185118 >> v2:172.21.15.196:3300/0 conn(0x7fa7d00c8d90 0x7fa7d0155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 -- 172.21.15.194:0/2383185118 >> 172.21.15.194:0/2383185118 conn(0x7fa7d006b4a0 msgr2=0x7fa7d006b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:00.976 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 -- 172.21.15.194:0/2383185118 shutdown_connections 2024-03-07T10:25:00.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.974+0000 7fa7d6200640 1 -- 172.21.15.194:0/2383185118 wait complete. 2024-03-07T10:25:00.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.976+0000 7fa7d6200640 1 Processor -- start 2024-03-07T10:25:00.977 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.976+0000 7fa7d6200640 1 -- start start 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 0x7fa7d014fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d0159020 0x7fa7d00c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0072890 con 0x7fa7d014f7c0 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c9740 con 0x7fa7d00c8d90 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d6200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c5f20 con 0x7fa7d0159020 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7cfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7cfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51272/0 (socket says 172.21.15.194:51272) 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7cfe00640 1 -- 172.21.15.194:0/817643793 learned_addr learned my addr 172.21.15.194:0/817643793 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d5800640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d0159020 0x7fa7d00c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.980 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.977+0000 7fa7d4e00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 0x7fa7d014fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 -- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d0159020 msgr2=0x7fa7d00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d0159020 0x7fa7d00c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 -- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 msgr2=0x7fa7d014fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 0x7fa7d014fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 -- 172.21.15.194:0/817643793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d0158220 con 0x7fa7d014f7c0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7d4e00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 0x7fa7d014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7cfe00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00d5f0 tx=0x7fa7bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0125f0 con 0x7fa7d014f7c0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7bc019070 con 0x7fa7d014f7c0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00c3e70 con 0x7fa7d014f7c0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0129d0 con 0x7fa7d014f7c0 2024-03-07T10:25:00.981 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.978+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d01572c0 con 0x7fa7d014f7c0 2024-03-07T10:25:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.980+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0075600 con 0x7fa7d014f7c0 2024-03-07T10:25:00.982 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.980+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fa7bc012b70 con 0x7fa7d014f7c0 2024-03-07T10:25:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.981+0000 7fa7ccc00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 0x7fa7b006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.981+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7fa7bc08aa00 con 0x7fa7d014f7c0 2024-03-07T10:25:00.983 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.982+0000 7fa7d4e00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 0x7fa7b006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:00.984 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.983+0000 7fa7d4e00640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 0x7fa7b006d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400a830 tx=0x7fa7c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:00.987 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:00.986+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fa7bc059470 con 0x7fa7d014f7c0 2024-03-07T10:25:01.183 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.182+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fa7d0072590 con 0x7fa7d014f7c0 2024-03-07T10:25:01.188 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.187+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fa7bc058d70 con 0x7fa7d014f7c0 2024-03-07T10:25:01.189 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.188+0000 7fa7ccc00640 1 -- 172.21.15.194:0/817643793 <== mon.0 v2:172.21.15.194:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa7bc05cec0 con 0x7fa7d014f7c0 2024-03-07T10:25:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 msgr2=0x7fa7b006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 0x7fa7b006d990 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400a830 tx=0x7fa7c4008040 comp rx=0 tx=0).stop 2024-03-07T10:25:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 msgr2=0x7fa7d00c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.192 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc00d5f0 tx=0x7fa7bc00dab0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 shutdown_connections 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fa7b006b4d0 0x7fa7b006d990 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fa7d0159020 0x7fa7d00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7d014f7c0 0x7fa7d00c33f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 --2- 172.21.15.194:0/817643793 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fa7d00c8d90 0x7fa7d014fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.190+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 >> 172.21.15.194:0/817643793 conn(0x7fa7d006b4a0 msgr2=0x7fa7d00ca220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.191+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 shutdown_connections 2024-03-07T10:25:01.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.191+0000 7fa7d6200640 1 -- 172.21.15.194:0/817643793 wait complete. 2024-03-07T10:25:01.210 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-03-07T10:25:01.211 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:25:01.415 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.414+0000 7f83fd600640 1 Processor -- start 2024-03-07T10:25:01.416 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.414+0000 7f83fd600640 1 -- start start 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.415+0000 7f83fd600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83f80c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.415+0000 7f83fd600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f80c33b0 con 0x7f83f80c4130 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.415+0000 7f83fd600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f8072d80 con 0x7f83f80c2690 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.415+0000 7f83fd600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8072b50 con 0x7f83f8150a90 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83efe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f83f80c4130 0x7f83f80c16d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56532/0 (socket says 172.21.15.194:56532) 2024-03-07T10:25:01.417 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83efe00640 1 -- 172.21.15.194:0/2150340169 learned_addr learned my addr 172.21.15.194:0/2150340169 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7e00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83f80c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453809322 0 0) 0x7f83f80c33b0 con 0x7f83f80c4130 2024-03-07T10:25:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83dc003520 con 0x7f83f80c4130 2024-03-07T10:25:01.419 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807124051 0 0) 0x7f83dc003520 con 0x7f83f80c4130 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 msgr2=0x7f83f80c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83f80c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 >> v1:172.21.15.196:6789/0 conn(0x7f83f80c2690 legacy=0x7f83f80c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8073060 con 0x7f83f80c4130 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f83e0001670 con 0x7f83f80c4130 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.416+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 >> v1:172.21.15.194:6789/0 conn(0x7f83f80c4130 legacy=0x7f83f80c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83dc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83dc003f60 0x7f83dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc00bb50 con 0x7f83dc003f60 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc00bcd0 con 0x7f83dc004d40 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83dc00bed0 con 0x7f83f8150a90 2024-03-07T10:25:01.420 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83dc003f60 0x7f83dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83fcc00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7e00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83dc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 -- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 msgr2=0x7f83dc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83dc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 -- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83dc004d40 msgr2=0x7f83dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83dc004d40 0x7f83dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83efe00640 1 -- 172.21.15.194:0/2150340169 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc003520 con 0x7f83dc003f60 2024-03-07T10:25:01.421 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.417+0000 7f83f7e00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83f8150a90 0x7f83dc0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:01.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.418+0000 7f83efe00640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83dc003f60 0x7f83dc004800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c210 tx=0x7f83dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac7df9b653488c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.422 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e0007d30 con 0x7f83dc003f60 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f83e0030070 con 0x7f83dc003f60 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83f7400640 1 -- 172.21.15.194:0/2150340169 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e002cd80 con 0x7f83dc003f60 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 -- 172.21.15.194:0/2150340169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83dc003f60 msgr2=0x7f83dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 --2- 172.21.15.194:0/2150340169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83dc003f60 0x7f83dc004800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f83e000c210 tx=0x7f83dc005830 comp rx=0 tx=0).stop 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fcc00640 1 -- 172.21.15.194:0/2150340169 reap_dead start 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 -- 172.21.15.194:0/2150340169 shutdown_connections 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 -- 172.21.15.194:0/2150340169 >> 172.21.15.194:0/2150340169 conn(0x7f83f80c70f0 msgr2=0x7f83f80c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 -- 172.21.15.194:0/2150340169 shutdown_connections 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.419+0000 7f83fd600640 1 -- 172.21.15.194:0/2150340169 wait complete. 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.421+0000 7f83fd600640 1 Processor -- start 2024-03-07T10:25:01.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.421+0000 7f83fd600640 1 -- start start 2024-03-07T10:25:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 0x7f83f81ecc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.424 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83f80a69f0 0x7f83f814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8071cf0 con 0x7f83f8146090 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8150e70 con 0x7f83f80a69f0 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.422+0000 7f83fd600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f8071520 con 0x7f83dc003f60 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51280/0 (socket says 172.21.15.194:51280) 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 -- 172.21.15.194:0/1915743047 learned_addr learned my addr 172.21.15.194:0/1915743047 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83efe00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83f80a69f0 0x7f83f814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83f7e00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 0x7f83f81ecc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 -- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 msgr2=0x7f83f81ecc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 0x7f83f81ecc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 -- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83f80a69f0 msgr2=0x7f83f814f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83f80a69f0 0x7f83f814f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83fcc00640 1 -- 172.21.15.194:0/1915743047 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f81ec1e0 con 0x7f83f8146090 2024-03-07T10:25:01.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.423+0000 7f83f7e00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 0x7f83f81ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83fcc00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83f81544e0 tx=0x7f83f000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0003b80 con 0x7f83f8146090 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f83f0018070 con 0x7f83f8146090 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80a6e80 con 0x7f83f8146090 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00050d0 con 0x7f83f8146090 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.424+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80a7160 con 0x7f83f8146090 2024-03-07T10:25:01.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.425+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f8068170 con 0x7f83f8146090 2024-03-07T10:25:01.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.427+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f83f0005270 con 0x7f83f8146090 2024-03-07T10:25:01.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.428+0000 7f83f4c00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 0x7f83d406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.428+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f83f008a200 con 0x7f83f8146090 2024-03-07T10:25:01.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.428+0000 7f83f7e00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 0x7f83d406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.431 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.429+0000 7f83f7e00640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 0x7f83d406d9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009b40 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.433+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f83f0058be0 con 0x7f83f8146090 2024-03-07T10:25:01.669 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.667+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83f80c69f0 con 0x7f83f8146090 2024-03-07T10:25:01.670 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.668+0000 7f83f4c00640 1 -- 172.21.15.194:0/1915743047 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6263 (secure 0 0 0) 0x7f83f00584e0 con 0x7f83f8146090 2024-03-07T10:25:01.671 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:01.671 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4277918804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4277918804},{"type":"v1","addr":"172.21.15.194:6833","nonce":4277918804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:25:01.671 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 30 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 msgr2=0x7f83d406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 0x7f83d406d9c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83e8009b40 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 msgr2=0x7f83f80a75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f83f81544e0 tx=0x7f83f000ea00 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 shutdown_connections 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f83d406b500 0x7f83d406d9c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83f8146090 0x7f83f80a75d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f83f80a69f0 0x7f83f814f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 --2- 172.21.15.194:0/1915743047 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f83dc003f60 0x7f83f81ecc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 >> 172.21.15.194:0/1915743047 conn(0x7f83f80c70f0 msgr2=0x7f83f814ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 shutdown_connections 2024-03-07T10:25:01.673 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.671+0000 7f83fd600640 1 -- 172.21.15.194:0/1915743047 wait complete. 2024-03-07T10:25:01.695 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:25:01.891 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.890+0000 7f0266000640 1 Processor -- start 2024-03-07T10:25:01.892 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.890+0000 7f0266000640 1 -- start start 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.891+0000 7f0266000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f02600c5bc0 0x7f02600c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.891+0000 7f0266000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f0260152c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0266000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0260155b20 con 0x7f026006c1c0 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0266000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02601531c0 con 0x7f02600c5bc0 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0266000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0260155dc0 con 0x7f02601528a0 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0264c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f02600c5bc0 0x7f02600c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0265600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f026006c1c0 0x7f026006c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56546/0 (socket says 172.21.15.194:56546) 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0265600640 1 -- 172.21.15.194:0/4015114539 learned_addr learned my addr 172.21.15.194:0/4015114539 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f025fe00640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f0260152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0264c00640 1 -- 172.21.15.194:0/4015114539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 msgr2=0x7f0260152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0264c00640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f0260152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.898 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0264c00640 1 -- 172.21.15.194:0/4015114539 >> v1:172.21.15.194:6789/0 conn(0x7f026006c1c0 legacy=0x7f026006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f0264c00640 1 -- 172.21.15.194:0/4015114539 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0260156080 con 0x7f02600c5bc0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.892+0000 7f025f400640 1 -- 172.21.15.194:0/4015114539 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954110135 0 0) 0x7f0260155b20 con 0x7f026006c1c0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.893+0000 7f0264c00640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02600c5bc0 0x7f02600c8ed0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f02540097a0 tx=0x7f025402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4378cdb053ce46 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f025f400640 1 -- 172.21.15.194:0/4015114539 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540315a0 con 0x7f02600c5bc0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f025f400640 1 -- 172.21.15.194:0/4015114539 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0254037070 con 0x7f02600c5bc0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f025f400640 1 -- 172.21.15.194:0/4015114539 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254031980 con 0x7f02600c5bc0 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 -- 172.21.15.194:0/4015114539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02600c5bc0 msgr2=0x7f02600c8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02600c5bc0 0x7f02600c8ed0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f02540097a0 tx=0x7f025402b840 comp rx=0 tx=0).stop 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 -- 172.21.15.194:0/4015114539 shutdown_connections 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f0260152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 --2- 172.21.15.194:0/4015114539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02600c5bc0 0x7f02600c8ed0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.894+0000 7f0266000640 1 -- 172.21.15.194:0/4015114539 >> 172.21.15.194:0/4015114539 conn(0x7f02600675e0 msgr2=0x7f02600cafd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.895+0000 7f0266000640 1 -- 172.21.15.194:0/4015114539 shutdown_connections 2024-03-07T10:25:01.899 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.895+0000 7f0266000640 1 -- 172.21.15.194:0/4015114539 wait complete. 2024-03-07T10:25:01.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.896+0000 7f0266000640 1 Processor -- start 2024-03-07T10:25:01.900 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.896+0000 7f0266000640 1 -- start start 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 0x7f0260156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f026014c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026006cd40 con 0x7f026006c1c0 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0260156640 con 0x7f02600c5bc0 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0266000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026006cec0 con 0x7f02601528a0 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0264c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0264c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51288/0 (socket says 172.21.15.194:51288) 2024-03-07T10:25:01.902 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.897+0000 7f0264c00640 1 -- 172.21.15.194:0/3391733024 learned_addr learned my addr 172.21.15.194:0/3391733024 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f025fe00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 0x7f0260156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 -- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 msgr2=0x7f026014c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0265600640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f026014c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f026014c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 -- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 msgr2=0x7f0260156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 0x7f0260156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 -- 172.21.15.194:0/3391733024 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02600c4190 con 0x7f026006c1c0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f025fe00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 0x7f0260156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0265600640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f026014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f0264c00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0254000c00 tx=0x7f02540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254032840 con 0x7f026006c1c0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.898+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0254032a00 con 0x7f026006c1c0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.899+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254032e10 con 0x7f026006c1c0 2024-03-07T10:25:01.903 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.899+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02601ee400 con 0x7f026006c1c0 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.899+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02601ee9c0 con 0x7f026006c1c0 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.900+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02600c6a90 con 0x7f026006c1c0 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.901+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f025404e430 con 0x7f026006c1c0 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.902+0000 7f025cc00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 0x7f024006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.902+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f025402f030 con 0x7f026006c1c0 2024-03-07T10:25:01.904 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.903+0000 7f025fe00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 0x7f024006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:01.905 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.904+0000 7f025fe00640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 0x7f024006d9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f024c006fd0 tx=0x7f024c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:01.908 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:01.907+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f02600c6a90 con 0x7f026006c1c0 2024-03-07T10:25:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.155+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0260068170 con 0x7f026006c1c0 2024-03-07T10:25:02.157 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.156+0000 7f025cc00640 1 -- 172.21.15.194:0/3391733024 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+6263 (secure 0 0 0) 0x7f0254040070 con 0x7f026006c1c0 2024-03-07T10:25:02.158 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:02.158 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4277918804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4277918804},{"type":"v1","addr":"172.21.15.194:6833","nonce":4277918804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:20:57.593298+0000","modified":"2024-03-07T10:23:41.019647+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4882},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4882":{"gid":4882,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":12,"addr":"172.21.15.194:6835/3339340096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3339340096},{"type":"v1","addr":"172.21.15.194:6835","nonce":3339340096}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4882,"qdb_cluster":[4882]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:25:02.158 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 30 2024-03-07T10:25:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.158+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 msgr2=0x7f024006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.158+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 0x7f024006d9c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f024c006fd0 tx=0x7f024c008040 comp rx=0 tx=0).stop 2024-03-07T10:25:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.158+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 msgr2=0x7f0260157e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.158+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0254000c00 tx=0x7f02540046c0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.160 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 shutdown_connections 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f024006b500 0x7f024006d9c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f02601528a0 0x7f026014c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f02600c5bc0 0x7f0260156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 --2- 172.21.15.194:0/3391733024 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f026006c1c0 0x7f0260157e60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 >> 172.21.15.194:0/3391733024 conn(0x7f02600675e0 msgr2=0x7f02600cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 shutdown_connections 2024-03-07T10:25:02.161 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.159+0000 7f0266000640 1 -- 172.21.15.194:0/3391733024 wait complete. 2024-03-07T10:25:02.179 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:25:02.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.369+0000 7f8c23c00640 1 Processor -- start 2024-03-07T10:25:02.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.369+0000 7f8c23c00640 1 -- start start 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.370+0000 7f8c23c00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f8c1c158cd0 0x7f8c1c0ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c23c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c1531a0 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c23c00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0c6300 con 0x7f8c1c06bbe0 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c23c00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c94c0 con 0x7f8c1c158cd0 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c1be00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8c1c0c8f50 0x7f8c1c15e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56562/0 (socket says 172.21.15.194:56562) 2024-03-07T10:25:02.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c1be00640 1 -- 172.21.15.194:0/2726571201 learned_addr learned my addr 172.21.15.194:0/2726571201 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:02.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c21c00640 1 --2- 172.21.15.194:0/2726571201 >> v2:172.21.15.196:3300/0 conn(0x7f8c1c158cd0 0x7f8c1c0ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610776142 0 0) 0x7f8c08001110 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.371+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c04003520 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2044629620 0 0) 0x7f8c04003520 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 >> v2:172.21.15.196:3300/0 conn(0x7f8c1c158cd0 msgr2=0x7f8c1c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 --2- 172.21.15.194:0/2726571201 >> v2:172.21.15.196:3300/0 conn(0x7f8c1c158cd0 0x7f8c1c0ca560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 >> v1:172.21.15.196:6789/0 conn(0x7f8c1c06bbe0 legacy=0x7f8c1c0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0c97a0 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f8c08001840 con 0x7f8c1c0c8f50 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 >> v1:172.21.15.194:6789/0 conn(0x7f8c1c0c8f50 legacy=0x7f8c1c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 0x7f8c04003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04004800 0x7f8c04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c04005210 0x7f8c0400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c94c0 con 0x7f8c04003a00 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c160 con 0x7f8c04005210 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0400c360 con 0x7f8c04004800 2024-03-07T10:25:02.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.372+0000 7f8c21200640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 0x7f8c04003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21200640 1 -- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04004800 msgr2=0x7f8c04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21200640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04004800 0x7f8c04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21200640 1 -- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c04005210 msgr2=0x7f8c0400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21200640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c04005210 0x7f8c0400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21200640 1 -- 172.21.15.194:0/2726571201 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c04003520 con 0x7f8c04003a00 2024-03-07T10:25:02.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.373+0000 7f8c21c00640 1 -- 172.21.15.194:0/2726571201 reap_dead start 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.374+0000 7f8c21200640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 0x7f8c04003e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c10001720 tx=0x7f8c04005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b50fcadd6b77890 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.374+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10001370 con 0x7f8c04003a00 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.374+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c100052d0 con 0x7f8c04003a00 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.374+0000 7f8c1b400640 1 -- 172.21.15.194:0/2726571201 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10003850 con 0x7f8c04003a00 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 -- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 msgr2=0x7f8c04003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 0x7f8c04003e20 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8c10001720 tx=0x7f8c04005830 comp rx=0 tx=0).stop 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 -- 172.21.15.194:0/2726571201 shutdown_connections 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 --2- 172.21.15.194:0/2726571201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c04003a00 0x7f8c04003e20 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 -- 172.21.15.194:0/2726571201 >> 172.21.15.194:0/2726571201 conn(0x7f8c1c0cb050 msgr2=0x7f8c1c0cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:02.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 -- 172.21.15.194:0/2726571201 shutdown_connections 2024-03-07T10:25:02.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.375+0000 7f8c23c00640 1 -- 172.21.15.194:0/2726571201 wait complete. 2024-03-07T10:25:02.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.376+0000 7f8c23c00640 1 Processor -- start 2024-03-07T10:25:02.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 -- start start 2024-03-07T10:25:02.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04003a00 0x7f8c1c1e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c0c1210 0x7f8c1c0bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0cad40 con 0x7f8c1c0bf590 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0c9d60 con 0x7f8c1c0c1210 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.377+0000 7f8c23c00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c0ca560 con 0x7f8c04003a00 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51316/0 (socket says 172.21.15.194:51316) 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 -- 172.21.15.194:0/57651924 learned_addr learned my addr 172.21.15.194:0/57651924 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c21200640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04003a00 0x7f8c1c1e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 -- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04003a00 msgr2=0x7f8c1c1e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04003a00 0x7f8c1c1e95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c21c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c0c1210 0x7f8c1c0bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.380 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 -- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c0c1210 msgr2=0x7f8c1c0bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c0c1210 0x7f8c1c0bfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 -- 172.21.15.194:0/57651924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c1e0680 con 0x7f8c1c0bf590 2024-03-07T10:25:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.378+0000 7f8c1be00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c700 tx=0x7f8c0800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.379+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c08018070 con 0x7f8c1c0bf590 2024-03-07T10:25:02.381 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.379+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8c080072d0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.379+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080047e0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.379+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c0bec20 con 0x7f8c1c0bf590 2024-03-07T10:25:02.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.379+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c0beec0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.380+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c1525d0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.382 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.381+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f8c0801b070 con 0x7f8c1c0bf590 2024-03-07T10:25:02.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.382+0000 7f8c18c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 0x7f8bfc06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.382+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f8c08089a70 con 0x7f8c1c0bf590 2024-03-07T10:25:02.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.382+0000 7f8c21200640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 0x7f8bfc06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.384 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.383+0000 7f8c21200640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 0x7f8bfc06d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8c10033000 tx=0x7f8c10009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.391 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.390+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8c1c1525d0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.587 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.586+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c1c068880 con 0x7f8c1c0bf590 2024-03-07T10:25:02.591 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.590+0000 7f8c18c00640 1 -- 172.21.15.194:0/57651924 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+21036 (secure 0 0 0) 0x7f8c1c1531a0 con 0x7f8c1c0bf590 2024-03-07T10:25:02.592 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:02.592 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":29,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:23:58.005671+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-03-07T10:20:55.864525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-03-07T10:20:56.608790+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.16","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.196:6835/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6832/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.196:6834/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6835/1436303034":"2024-03-08T10:22:52.989185+0000","172.21.15.194:6833/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.194:6834/1436303034":"2024-03-08T10:22:52.989185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:25:02.594 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 msgr2=0x7f8bfc06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 0x7f8bfc06d9c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8c10033000 tx=0x7f8c10009030 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 msgr2=0x7f8c1c0c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c700 tx=0x7f8c0800cbc0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 shutdown_connections 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f8bfc06b500 0x7f8bfc06d9c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f8c1c0c1210 0x7f8c1c0bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8c1c0bf590 0x7f8c1c0c0cd0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 --2- 172.21.15.194:0/57651924 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f8c04003a00 0x7f8c1c1e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 >> 172.21.15.194:0/57651924 conn(0x7f8c1c0cb050 msgr2=0x7f8c1c0ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 shutdown_connections 2024-03-07T10:25:02.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.593+0000 7f8c23c00640 1 -- 172.21.15.194:0/57651924 wait complete. 2024-03-07T10:25:02.612 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-03-07T10:25:02.816 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.814+0000 7f862c400640 1 Processor -- start 2024-03-07T10:25:02.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.814+0000 7f862c400640 1 -- start start 2024-03-07T10:25:02.817 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862c400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f86240c62d0 0x7f86240c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862c400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8624157a30 con 0x7f8624157600 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862c400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8624154230 con 0x7f8624153da0 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862c400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240c6ff0 con 0x7f86240c62d0 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862a400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f8624157600 0x7f86240c8260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56574/0 (socket says 172.21.15.194:56574) 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f862a400640 1 -- 172.21.15.194:0/343739891 learned_addr learned my addr 172.21.15.194:0/343739891 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:02.818 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.816+0000 7f8629a00640 1 --2- 172.21.15.194:0/343739891 >> v2:172.21.15.196:3300/0 conn(0x7f86240c62d0 0x7f86240c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159589766 0 0) 0x7f8624157a30 con 0x7f8624157600 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860c003520 con 0x7f8624157600 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2147551686 0 0) 0x7f860c003520 con 0x7f8624157600 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 >> v2:172.21.15.196:3300/0 conn(0x7f86240c62d0 msgr2=0x7f86240c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 --2- 172.21.15.194:0/343739891 >> v2:172.21.15.196:3300/0 conn(0x7f86240c62d0 0x7f86240c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 >> v1:172.21.15.196:6789/0 conn(0x7f8624153da0 legacy=0x7f86241549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240c72d0 con 0x7f8624157600 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f861c0019f0 con 0x7f8624157600 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 >> v1:172.21.15.194:6789/0 conn(0x7f8624157600 legacy=0x7f86240c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.820 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f860c003a00 0x7f860c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c004800 0x7f860c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 0x7f860c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240c6ff0 con 0x7f860c005210 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c00c160 con 0x7f860c003a00 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c00c360 con 0x7f860c004800 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.817+0000 7f8629a00640 1 --2- 172.21.15.194:0/343739891 >> v2:172.21.15.196:3300/0 conn(0x7f86240c62d0 0x7f86240c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 0x7f860c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f8629a00640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f860c003a00 0x7f860c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f8629000640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c004800 0x7f860c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.821 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 -- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c004800 msgr2=0x7f860c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c004800 0x7f860c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 -- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f860c003a00 msgr2=0x7f860c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:02.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f860c003a00 0x7f860c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.822 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.818+0000 7f862a400640 1 -- 172.21.15.194:0/343739891 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c003520 con 0x7f860c005210 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.819+0000 7f862a400640 1 -- 172.21.15.194:0/343739891 reap_dead start 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.819+0000 7f862a400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 0x7f860c00b9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f861c00a740 tx=0x7f860c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe6ddb9dc33aebc server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c00a390 con 0x7f860c005210 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f861c034630 con 0x7f860c005210 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f8623e00640 1 -- 172.21.15.194:0/343739891 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c034a40 con 0x7f860c005210 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 -- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 msgr2=0x7f860c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 0x7f860c00b9c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f861c00a740 tx=0x7f860c005830 comp rx=0 tx=0).stop 2024-03-07T10:25:02.823 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 -- 172.21.15.194:0/343739891 shutdown_connections 2024-03-07T10:25:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 --2- 172.21.15.194:0/343739891 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860c005210 0x7f860c00b9c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 -- 172.21.15.194:0/343739891 >> 172.21.15.194:0/343739891 conn(0x7f86240c8f50 msgr2=0x7f86240c9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 -- 172.21.15.194:0/343739891 shutdown_connections 2024-03-07T10:25:02.824 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.820+0000 7f862c400640 1 -- 172.21.15.194:0/343739891 wait complete. 2024-03-07T10:25:02.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.822+0000 7f862c400640 1 Processor -- start 2024-03-07T10:25:02.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.822+0000 7f862c400640 1 -- start start 2024-03-07T10:25:02.826 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c005210 0x7f862414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 0x7f862414b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86240c7ad0 con 0x7f8624070ff0 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624153790 con 0x7f862414b000 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f862c400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86240c7c50 con 0x7f860c005210 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f8629000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f8629000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51336/0 (socket says 172.21.15.194:51336) 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.823+0000 7f8629000640 1 -- 172.21.15.194:0/718838551 learned_addr learned my addr 172.21.15.194:0/718838551 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 -- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c005210 msgr2=0x7f862414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629a00640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c005210 0x7f862414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f862a400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 0x7f862414b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c005210 0x7f862414ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 -- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 msgr2=0x7f862414b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:02.827 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 0x7f862414b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 -- 172.21.15.194:0/718838551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862414c2f0 con 0x7f8624070ff0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f862a400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 0x7f862414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8629000640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f861000e4b0 tx=0x7f861000e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.824+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86100052e0 con 0x7f8624070ff0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.825+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8610018070 con 0x7f8624070ff0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.825+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610003850 con 0x7f8624070ff0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.825+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862414c5d0 con 0x7f8624070ff0 2024-03-07T10:25:02.828 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.825+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862414cd30 con 0x7f8624070ff0 2024-03-07T10:25:02.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.826+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8624068880 con 0x7f8624070ff0 2024-03-07T10:25:02.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.827+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f86100039f0 con 0x7f8624070ff0 2024-03-07T10:25:02.829 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.828+0000 7f8621600640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 0x7f860406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:02.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.828+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6895+0+0 (secure 0 0 0) 0x7f861008a220 con 0x7f8624070ff0 2024-03-07T10:25:02.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.828+0000 7f8629a00640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 0x7f860406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:02.830 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.829+0000 7f8629a00640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 0x7f860406d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86240707b0 tx=0x7f8618008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:02.834 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:02.832+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f8610058c90 con 0x7f8624070ff0 2024-03-07T10:25:03.073 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.071+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) v1 -- 0x7f86240c8040 con 0x7f8624070ff0 2024-03-07T10:25:03.078 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.077+0000 7f8621600640 1 -- 172.21.15.194:0/718838551 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 151+0+0 (secure 0 0 0) 0x7f8610058590 con 0x7f8624070ff0 2024-03-07T10:25:03.078 INFO:teuthology.orchestra.run.smithi194.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 msgr2=0x7f860406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 0x7f860406d990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f86240707b0 tx=0x7f8618008040 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 msgr2=0x7f862406d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f861000e4b0 tx=0x7f861000e970 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 shutdown_connections 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f860406b4d0 0x7f860406d990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f862414b000 0x7f862414b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8624070ff0 0x7f862406d5f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 --2- 172.21.15.194:0/718838551 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f860c005210 0x7f862414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 >> 172.21.15.194:0/718838551 conn(0x7f86240c8f50 msgr2=0x7f86240c9330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 shutdown_connections 2024-03-07T10:25:03.083 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.081+0000 7f862c400640 1 -- 172.21.15.194:0/718838551 wait complete. 2024-03-07T10:25:03.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-03-07T10:25:03.110 INFO:tasks.ceph.mds.c.smithi194.stderr: -4297> 2024-03-07T10:23:45.056+0000 7fd75d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:25:03.172 INFO:tasks.ceph.mds.c.smithi194.stdout:starting mds.c at 2024-03-07T10:25:03.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.288+0000 7f580f200640 1 Processor -- start 2024-03-07T10:25:03.289 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.288+0000 7f580f200640 1 -- start start 2024-03-07T10:25:03.290 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.289+0000 7f580f200640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5810150aa0 0x7f58100a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.289+0000 7f580f200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 0x7f58100a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.289+0000 7f580f200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58100c3a70 con 0x7f5810156fb0 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.289+0000 7f580f200640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100a6270 con 0x7f5810150aa0 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.289+0000 7f580f200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100c3d50 con 0x7f58100a8620 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.290+0000 7f580de00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5810150aa0 0x7f58100a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.290+0000 7f5807e00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 0x7f58100a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.290+0000 7f580e800640 1 --1- >> v1:172.21.15.196:6789/0 conn(0x7f5810156fb0 0x7f58101573b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.196:6789/0 says I am v1:172.21.15.194:34696/0 (socket says 172.21.15.194:34696) 2024-03-07T10:25:03.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.290+0000 7f580e800640 1 -- 172.21.15.194:0/398075222 learned_addr learned my addr 172.21.15.194:0/398075222 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:03.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.291+0000 7f5807e00640 1 -- 172.21.15.194:0/398075222 >> v2:172.21.15.196:3300/0 conn(0x7f5810150aa0 msgr2=0x7f58100a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:03.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.291+0000 7f5807e00640 1 --2- 172.21.15.194:0/398075222 >> v2:172.21.15.196:3300/0 conn(0x7f5810150aa0 0x7f58100a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.291+0000 7f5807e00640 1 -- 172.21.15.194:0/398075222 >> v1:172.21.15.196:6789/0 conn(0x7f5810156fb0 legacy=0x7f58101573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.292 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.291+0000 7f5807e00640 1 -- 172.21.15.194:0/398075222 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100c4030 con 0x7f58100a8620 2024-03-07T10:25:03.293 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.292+0000 7f5807e00640 1 --2- 172.21.15.194:0/398075222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 0x7f58100a8a80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f57f80097a0 tx=0x7f57f802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd0a7f6f444257f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:03.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.292+0000 7f580d400640 1 -- 172.21.15.194:0/398075222 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8031780 con 0x7f58100a8620 2024-03-07T10:25:03.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.292+0000 7f580d400640 1 -- 172.21.15.194:0/398075222 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f57f8037070 con 0x7f58100a8620 2024-03-07T10:25:03.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.292+0000 7f580d400640 1 -- 172.21.15.194:0/398075222 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f8031b60 con 0x7f58100a8620 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 -- 172.21.15.194:0/398075222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 msgr2=0x7f58100a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 --2- 172.21.15.194:0/398075222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 0x7f58100a8a80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f57f80097a0 tx=0x7f57f802b820 comp rx=0 tx=0).stop 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 -- 172.21.15.194:0/398075222 shutdown_connections 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 --2- 172.21.15.194:0/398075222 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f58100a8620 0x7f58100a8a80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 --2- 172.21.15.194:0/398075222 >> v2:172.21.15.196:3300/0 conn(0x7f5810150aa0 0x7f58100a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.295 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 -- 172.21.15.194:0/398075222 >> 172.21.15.194:0/398075222 conn(0x7f581006cd60 msgr2=0x7f581006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:03.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 -- 172.21.15.194:0/398075222 shutdown_connections 2024-03-07T10:25:03.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.293+0000 7f580f200640 1 -- 172.21.15.194:0/398075222 wait complete. 2024-03-07T10:25:03.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.295+0000 7f580f200640 1 Processor -- start 2024-03-07T10:25:03.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.295+0000 7f580f200640 1 -- start start 2024-03-07T10:25:03.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5810150aa0 0x7f5810154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.298 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 0x7f5810155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810150e80 con 0x7f58100a8620 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810156a90 con 0x7f5810156fb0 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580f200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810151000 con 0x7f5810150aa0 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51366/0 (socket says 172.21.15.194:51366) 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.296+0000 7f580de00640 1 -- 172.21.15.194:0/92534110 learned_addr learned my addr 172.21.15.194:0/92534110 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f5807e00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5810150aa0 0x7f5810154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580e800640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 0x7f5810155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 -- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5810150aa0 msgr2=0x7f5810154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5810150aa0 0x7f5810154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 -- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 msgr2=0x7f5810155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 0x7f5810155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 -- 172.21.15.194:0/92534110 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100aaa80 con 0x7f58100a8620 2024-03-07T10:25:03.299 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580e800640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 0x7f5810155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-07T10:25:03.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.297+0000 7f580de00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9b0 tx=0x7f580000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:03.300 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.298+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800017070 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.298+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f580000c9a0 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.298+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580000cdb0 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.298+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58100aad60 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.298+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58101e2500 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.299+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5810075600 con 0x7f58100a8620 2024-03-07T10:25:03.301 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.300+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f580001a070 con 0x7f58100a8620 2024-03-07T10:25:03.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.301+0000 7f5806000640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:03.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.302+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6981+0+0 (secure 0 0 0) 0x7f580008abc0 con 0x7f58100a8620 2024-03-07T10:25:03.303 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.302+0000 7f5807e00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:03.304 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.303+0000 7f5807e00640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 0x7f57ec06d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f57f8036000 tx=0x7f57f803d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:03.308 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.307+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5800059490 con 0x7f58100a8620 2024-03-07T10:25:03.547 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:03.545+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58100a9180 con 0x7f58100a8620 2024-03-07T10:25:04.082 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.080+0000 7f5806000640 1 -- 172.21.15.194:0/92534110 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 99+0+0 (secure 0 0 0) 0x7f5800058d90 con 0x7f58100a8620 2024-03-07T10:25:04.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 msgr2=0x7f57ec06d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 0x7f57ec06d990 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f57f8036000 tx=0x7f57f803d040 comp rx=0 tx=0).stop 2024-03-07T10:25:04.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 msgr2=0x7f58100a78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.086 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f580000e9b0 tx=0x7f580000ee70 comp rx=0 tx=0).stop 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 shutdown_connections 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f57ec06b4d0 0x7f57ec06d990 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5810156fb0 0x7f5810155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5810150aa0 0x7f5810154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 --2- 172.21.15.194:0/92534110 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58100a8620 0x7f58100a78a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.084+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 >> 172.21.15.194:0/92534110 conn(0x7f581006cd60 msgr2=0x7f58100bfd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.085+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 shutdown_connections 2024-03-07T10:25:04.087 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.085+0000 7f580f200640 1 -- 172.21.15.194:0/92534110 wait complete. 2024-03-07T10:25:04.106 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-03-07T10:25:04.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.363+0000 7fd029400640 1 Processor -- start 2024-03-07T10:25:04.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.363+0000 7fd029400640 1 -- start start 2024-03-07T10:25:04.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.364+0000 7fd029400640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7fd024156400 0x7fd0240c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.364+0000 7fd029400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0240c72e0 0x7fd0240c9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.364+0000 7fd029400640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0240c9970 con 0x7fd0240c5ec0 2024-03-07T10:25:04.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.364+0000 7fd029400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0240c0690 con 0x7fd0240c72e0 2024-03-07T10:25:04.366 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.364+0000 7fd029400640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0240c6880 con 0x7fd024156400 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0240c72e0 0x7fd0240c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd0240c72e0 0x7fd0240c9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51368/0 (socket says 172.21.15.194:51368) 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 -- 172.21.15.194:0/4204709679 learned_addr learned my addr 172.21.15.194:0/4204709679 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd019e00640 1 --2- 172.21.15.194:0/4204709679 >> v2:172.21.15.196:3300/0 conn(0x7fd024156400 0x7fd0240c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 -- 172.21.15.194:0/4204709679 >> v2:172.21.15.196:3300/0 conn(0x7fd024156400 msgr2=0x7fd0240c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 --2- 172.21.15.194:0/4204709679 >> v2:172.21.15.196:3300/0 conn(0x7fd024156400 0x7fd0240c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 -- 172.21.15.194:0/4204709679 >> v1:172.21.15.196:6789/0 conn(0x7fd0240c5ec0 legacy=0x7fd024152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.365+0000 7fd023200640 1 -- 172.21.15.194:0/4204709679 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240c6b60 con 0x7fd0240c72e0 2024-03-07T10:25:04.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.367+0000 7fd023200640 1 --2- 172.21.15.194:0/4204709679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c72e0 0x7fd0240c9430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd0240c8b10 tx=0x7fd01c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c3bc0515cc43f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:04.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd021e00640 1 -- 172.21.15.194:0/4204709679 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c035020 con 0x7fd0240c72e0 2024-03-07T10:25:04.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd021e00640 1 -- 172.21.15.194:0/4204709679 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd01c031870 con 0x7fd0240c72e0 2024-03-07T10:25:04.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd021e00640 1 -- 172.21.15.194:0/4204709679 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01c031c60 con 0x7fd0240c72e0 2024-03-07T10:25:04.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 -- 172.21.15.194:0/4204709679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c72e0 msgr2=0x7fd0240c9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 --2- 172.21.15.194:0/4204709679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c72e0 0x7fd0240c9430 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd0240c8b10 tx=0x7fd01c02b910 comp rx=0 tx=0).stop 2024-03-07T10:25:04.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 -- 172.21.15.194:0/4204709679 shutdown_connections 2024-03-07T10:25:04.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 --2- 172.21.15.194:0/4204709679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c72e0 0x7fd0240c9430 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 --2- 172.21.15.194:0/4204709679 >> v2:172.21.15.196:3300/0 conn(0x7fd024156400 0x7fd0240c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.368+0000 7fd029400640 1 -- 172.21.15.194:0/4204709679 >> 172.21.15.194:0/4204709679 conn(0x7fd0240acde0 msgr2=0x7fd0240ad1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:04.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.369+0000 7fd029400640 1 -- 172.21.15.194:0/4204709679 shutdown_connections 2024-03-07T10:25:04.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.369+0000 7fd029400640 1 -- 172.21.15.194:0/4204709679 wait complete. 2024-03-07T10:25:04.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.370+0000 7fd029400640 1 Processor -- start 2024-03-07T10:25:04.372 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.371+0000 7fd029400640 1 -- start start 2024-03-07T10:25:04.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0240c72e0 0x7fd02414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0240ac780 0x7fd0240afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0241534d0 con 0x7fd0240c5ec0 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240c0b20 con 0x7fd0240c72e0 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd029400640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024153650 con 0x7fd0240ac780 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51382/0 (socket says 172.21.15.194:51382) 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 -- 172.21.15.194:0/1439041399 learned_addr learned my addr 172.21.15.194:0/1439041399 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd019e00640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0240c72e0 0x7fd02414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd023200640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0240ac780 0x7fd0240afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 -- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0240ac780 msgr2=0x7fd0240afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0240ac780 0x7fd0240afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 -- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0240c72e0 msgr2=0x7fd02414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:04.375 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0240c72e0 0x7fd02414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.372+0000 7fd022800640 1 -- 172.21.15.194:0/1439041399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0241ef830 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd022800640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c790 tx=0x7fd01400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014016020 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd014006d50 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014003bd0 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0241eea70 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.373+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0241ef030 con 0x7fd0240c5ec0 2024-03-07T10:25:04.376 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.374+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0240cae10 con 0x7fd0240c5ec0 2024-03-07T10:25:04.377 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.375+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7fd01400a850 con 0x7fd0240c5ec0 2024-03-07T10:25:04.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.376+0000 7fd01b400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 0x7fd00006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:04.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.377+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6981+0+0 (secure 0 0 0) 0x7fd01408a400 con 0x7fd0240c5ec0 2024-03-07T10:25:04.378 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.377+0000 7fd019e00640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 0x7fd00006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:04.379 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.378+0000 7fd019e00640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 0x7fd00006d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd00c006fd0 tx=0x7fd00c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:04.383 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.382+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7fd0240cae10 con 0x7fd0240c5ec0 2024-03-07T10:25:04.584 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:04.582+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd024155590 con 0x7fd0240c5ec0 2024-03-07T10:25:05.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.212+0000 7fd01b400640 1 -- 172.21.15.194:0/1439041399 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v31) v1 ==== 166+0+0 (secure 0 0 0) 0x7fd014020020 con 0x7fd0240c5ec0 2024-03-07T10:25:05.214 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'a_metadata' removed 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 msgr2=0x7fd00006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 0x7fd00006d9c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd00c006fd0 tx=0x7fd00c008040 comp rx=0 tx=0).stop 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 msgr2=0x7fd024149f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c790 tx=0x7fd01400cc50 comp rx=0 tx=0).stop 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 shutdown_connections 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7fd00006b500 0x7fd00006d9c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7fd0240ac780 0x7fd0240afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7fd0240c72e0 0x7fd02414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 --2- 172.21.15.194:0/1439041399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0240c5ec0 0x7fd024149f50 secure :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd01400c790 tx=0x7fd01400cc50 comp rx=0 tx=0).stop 2024-03-07T10:25:05.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.216+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 >> 172.21.15.194:0/1439041399 conn(0x7fd0240acde0 msgr2=0x7fd0241559f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:05.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.217+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 shutdown_connections 2024-03-07T10:25:05.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.217+0000 7fd029400640 1 -- 172.21.15.194:0/1439041399 wait complete. 2024-03-07T10:25:05.248 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-03-07T10:25:05.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.439+0000 7f1bd5000640 1 Processor -- start 2024-03-07T10:25:05.440 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.439+0000 7f1bd5000640 1 -- start start 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.440+0000 7f1bd5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bd014f6b0 0x7f1bd00c2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.440+0000 7f1bd5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 0x7f1bd0159130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.440+0000 7f1bd5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd0155820 con 0x7f1bd00c33d0 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.440+0000 7f1bd5000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd0155b00 con 0x7f1bd014f6b0 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.440+0000 7f1bd5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd0155de0 con 0x7f1bd0158d00 2024-03-07T10:25:05.442 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bd014f6b0 0x7f1bd00c2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bd014f6b0 0x7f1bd00c2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51388/0 (socket says 172.21.15.194:51388) 2024-03-07T10:25:05.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 -- 172.21.15.194:0/1842831800 learned_addr learned my addr 172.21.15.194:0/1842831800 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:05.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bc7e00640 1 --1- 172.21.15.194:0/1842831800 >> v1:172.21.15.194:6789/0 conn(0x7f1bd00c33d0 0x7f1bd00c03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56578/0 (socket says 172.21.15.194:56578) 2024-03-07T10:25:05.443 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bce800640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 0x7f1bd0159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 -- 172.21.15.194:0/1842831800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 msgr2=0x7f1bd0159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 0x7f1bd0159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 -- 172.21.15.194:0/1842831800 >> v1:172.21.15.194:6789/0 conn(0x7f1bd00c33d0 legacy=0x7f1bd00c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcde00640 1 -- 172.21.15.194:0/1842831800 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd01560c0 con 0x7f1bd014f6b0 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bcd400640 1 -- 172.21.15.194:0/1842831800 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788242918 0 0) 0x7f1bd0155820 con 0x7f1bd00c33d0 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.441+0000 7f1bce800640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 0x7f1bd0159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:05.444 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.442+0000 7f1bcde00640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd014f6b0 0x7f1bd00c2e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009870 tx=0x7f1bc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a63b1bd44c6cd01 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bcd400640 1 -- 172.21.15.194:0/1842831800 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0035020 con 0x7f1bd014f6b0 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bcd400640 1 -- 172.21.15.194:0/1842831800 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bc0031640 con 0x7f1bd014f6b0 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bcd400640 1 -- 172.21.15.194:0/1842831800 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc002d040 con 0x7f1bd014f6b0 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 -- 172.21.15.194:0/1842831800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd014f6b0 msgr2=0x7f1bd00c2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd014f6b0 0x7f1bd00c2e90 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009870 tx=0x7f1bc002b8f0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 -- 172.21.15.194:0/1842831800 shutdown_connections 2024-03-07T10:25:05.445 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd0158d00 0x7f1bd0159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 --2- 172.21.15.194:0/1842831800 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd014f6b0 0x7f1bd00c2e90 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 -- 172.21.15.194:0/1842831800 >> 172.21.15.194:0/1842831800 conn(0x7f1bd00c6fc0 msgr2=0x7f1bd00c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 -- 172.21.15.194:0/1842831800 shutdown_connections 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.443+0000 7f1bd5000640 1 -- 172.21.15.194:0/1842831800 wait complete. 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.445+0000 7f1bd5000640 1 Processor -- start 2024-03-07T10:25:05.446 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.445+0000 7f1bd5000640 1 -- start start 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00c33d0 0x7f1bd014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd014f6b0 0x7f1bd01ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd014fc10 con 0x7f1bd0158d00 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd014fa90 con 0x7f1bd014f6b0 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bd5000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd006e5e0 con 0x7f1bd00c33d0 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bce800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bce800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51394/0 (socket says 172.21.15.194:51394) 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.446+0000 7f1bce800640 1 -- 172.21.15.194:0/3176219354 learned_addr learned my addr 172.21.15.194:0/3176219354 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bcde00640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00c33d0 0x7f1bd014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 -- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00c33d0 msgr2=0x7f1bd014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bc7e00640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd014f6b0 0x7f1bd01ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00c33d0 0x7f1bd014ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 -- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd014f6b0 msgr2=0x7f1bd01ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd014f6b0 0x7f1bd01ee7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 -- 172.21.15.194:0/3176219354 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00726e0 con 0x7f1bd0158d00 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bce800640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800cd50 tx=0x7f1bc800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800f680 con 0x7f1bd0158d00 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bc800f840 con 0x7f1bd0158d00 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800fc50 con 0x7f1bd0158d00 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd00729c0 con 0x7f1bd0158d00 2024-03-07T10:25:05.450 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.447+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd0071570 con 0x7f1bd0158d00 2024-03-07T10:25:05.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.448+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd014f210 con 0x7f1bd0158d00 2024-03-07T10:25:05.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.450+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1bc80213f0 con 0x7f1bd0158d00 2024-03-07T10:25:05.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.450+0000 7f1bc6000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 0x7f1bac06d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:05.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.451+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6553+0+0 (secure 0 0 0) 0x7f1bc808b4d0 con 0x7f1bd0158d00 2024-03-07T10:25:05.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.451+0000 7f1bcde00640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 0x7f1bac06d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:05.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.452+0000 7f1bcde00640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 0x7f1bac06d9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0036000 tx=0x7f1bc0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:05.456 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.455+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1bd014f210 con 0x7f1bd0158d00 2024-03-07T10:25:05.653 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:05.651+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1bd0068170 con 0x7f1bd0158d00 2024-03-07T10:25:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.223+0000 7f1bc6000640 1 -- 172.21.15.194:0/3176219354 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v32) v1 ==== 154+0+0 (secure 0 0 0) 0x7f1bc8014030 con 0x7f1bd0158d00 2024-03-07T10:25:06.225 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'a_data' removed 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 msgr2=0x7f1bac06d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 0x7f1bac06d9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0036000 tx=0x7f1bc0008030 comp rx=0 tx=0).stop 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 msgr2=0x7f1bd01eecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800cd50 tx=0x7f1bc800a650 comp rx=0 tx=0).stop 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 shutdown_connections 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1bac06b500 0x7f1bac06d9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.233 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd0158d00 0x7f1bd01eecf0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1bd014f6b0 0x7f1bd01ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 --2- 172.21.15.194:0/3176219354 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1bd00c33d0 0x7f1bd014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 >> 172.21.15.194:0/3176219354 conn(0x7f1bd00c6fc0 msgr2=0x7f1bd0153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:06.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 shutdown_connections 2024-03-07T10:25:06.234 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.231+0000 7f1bd5000640 1 -- 172.21.15.194:0/3176219354 wait complete. 2024-03-07T10:25:06.259 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-03-07T10:25:06.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:25:06.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.460+0000 7f7236800640 1 Processor -- start 2024-03-07T10:25:06.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.460+0000 7f7236800640 1 -- start start 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.461+0000 7f7236800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 0x7f72300c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.461+0000 7f7236800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7230158950 con 0x7f72300708c0 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.461+0000 7f7236800640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72301598f0 con 0x7f723006d7b0 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.461+0000 7f7236800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723006d320 con 0x7f7230158570 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7234a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f72300708c0 0x7f72300c8cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56594/0 (socket says 172.21.15.194:56594) 2024-03-07T10:25:06.463 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7234a00640 1 -- 172.21.15.194:0/249611291 learned_addr learned my addr 172.21.15.194:0/249611291 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7235400640 1 --2- 172.21.15.194:0/249611291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 0x7f72300c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202461281 0 0) 0x7f7230158950 con 0x7f72300708c0 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7218003520 con 0x7f72300708c0 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 <== mon.1 v1:172.21.15.196:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172614366 0 0) 0x7f72301598f0 con 0x7f723006d7b0 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 --> v1:172.21.15.196:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7230158950 con 0x7f723006d7b0 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7235400640 1 -- 172.21.15.194:0/249611291 >> v1:172.21.15.196:6789/0 conn(0x7f723006d7b0 legacy=0x7f723015ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.464 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7235400640 1 -- 172.21.15.194:0/249611291 >> v1:172.21.15.194:6789/0 conn(0x7f72300708c0 legacy=0x7f72300c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.462+0000 7f7235400640 1 -- 172.21.15.194:0/249611291 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723006cfb0 con 0x7f7230158570 2024-03-07T10:25:06.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.463+0000 7f7235400640 1 --2- 172.21.15.194:0/249611291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 0x7f72300c86e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72240097d0 tx=0x7f722402b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=953ae91848535c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 <== mon.2 v2:172.21.15.196:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224034070 con 0x7f7230158570 2024-03-07T10:25:06.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 <== mon.2 v2:172.21.15.196:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7224030800 con 0x7f7230158570 2024-03-07T10:25:06.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f722fe00640 1 -- 172.21.15.194:0/249611291 <== mon.2 v2:172.21.15.196:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224030bf0 con 0x7f7230158570 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 -- 172.21.15.194:0/249611291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 msgr2=0x7f72300c86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 --2- 172.21.15.194:0/249611291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 0x7f72300c86e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72240097d0 tx=0x7f722402b940 comp rx=0 tx=0).stop 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 -- 172.21.15.194:0/249611291 shutdown_connections 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 --2- 172.21.15.194:0/249611291 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f7230158570 0x7f72300c86e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 -- 172.21.15.194:0/249611291 >> 172.21.15.194:0/249611291 conn(0x7f72300aac60 msgr2=0x7f72300ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 -- 172.21.15.194:0/249611291 shutdown_connections 2024-03-07T10:25:06.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.464+0000 7f7236800640 1 -- 172.21.15.194:0/249611291 wait complete. 2024-03-07T10:25:06.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.466+0000 7f7236800640 1 Processor -- start 2024-03-07T10:25:06.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.466+0000 7f7236800640 1 -- start start 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72300708c0 0x7f72300adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7230158570 0x7f72300a8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c3850 con 0x7f723006d7b0 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c36d0 con 0x7f7230158570 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7236800640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300c93e0 con 0x7f72300708c0 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7235400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.469 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7235400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51404/0 (socket says 172.21.15.194:51404) 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7235400640 1 -- 172.21.15.194:0/3110334900 learned_addr learned my addr 172.21.15.194:0/3110334900 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7234a00640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72300708c0 0x7f72300adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.467+0000 7f7235e00640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7230158570 0x7f72300a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 -- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72300708c0 msgr2=0x7f72300adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72300708c0 0x7f72300adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 -- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7230158570 msgr2=0x7f72300a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7230158570 0x7f72300a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.470 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 -- 172.21.15.194:0/3110334900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230156c70 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f7235400640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f72240098f0 tx=0x7f72240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.468+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224034040 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.469+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7224030e50 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.469+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72240443f0 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.469+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72300aa5c0 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.469+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72300ae470 con 0x7f723006d7b0 2024-03-07T10:25:06.471 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.470+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230068880 con 0x7f723006d7b0 2024-03-07T10:25:06.472 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.471+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f722404b060 con 0x7f723006d7b0 2024-03-07T10:25:06.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.472+0000 7f722d600640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 0x7f721006d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.473 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.472+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6033+0+0 (secure 0 0 0) 0x7f72240ac1e0 con 0x7f723006d7b0 2024-03-07T10:25:06.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.472+0000 7f7234a00640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 0x7f721006d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.474 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.473+0000 7f7234a00640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 0x7f721006d9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7230156bb0 tx=0x7f721c007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.478 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.477+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f722403f070 con 0x7f723006d7b0 2024-03-07T10:25:06.712 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.711+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72300c74e0 con 0x7f723006d7b0 2024-03-07T10:25:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.712+0000 7f722d600640 1 -- 172.21.15.194:0/3110334900 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f722407a820 con 0x7f723006d7b0 2024-03-07T10:25:06.714 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:06.714 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4277918804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4277918804},{"type":"v1","addr":"172.21.15.194:6833","nonce":4277918804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1443192949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1443192949},{"type":"v1","addr":"172.21.15.194:6835","nonce":1443192949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:25:06.714 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 32 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 msgr2=0x7f721006d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 0x7f721006d9c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7230156bb0 tx=0x7f721c007d50 comp rx=0 tx=0).stop 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 msgr2=0x7f72300abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f72240098f0 tx=0x7f72240046c0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 shutdown_connections 2024-03-07T10:25:06.717 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f721006b500 0x7f721006d9c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f7230158570 0x7f72300a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f72300708c0 0x7f72300adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 --2- 172.21.15.194:0/3110334900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f723006d7b0 0x7f72300abb10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 >> 172.21.15.194:0/3110334900 conn(0x7f72300aac60 msgr2=0x7f7230155770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.715+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 shutdown_connections 2024-03-07T10:25:06.718 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.716+0000 7f7236800640 1 -- 172.21.15.194:0/3110334900 wait complete. 2024-03-07T10:25:06.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:25:06.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.945+0000 7f019b600640 1 Processor -- start 2024-03-07T10:25:06.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.945+0000 7f019b600640 1 -- start start 2024-03-07T10:25:06.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.946+0000 7f019b600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f0194150b70 0x7f01940a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.946+0000 7f019b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0194156c20 0x7f019406d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.946+0000 7f019b600640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0194153980 con 0x7f01940a9a10 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.946+0000 7f019b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019406e550 con 0x7f0194156c20 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.946+0000 7f019b600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0194153c60 con 0x7f0194150b70 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0194156c20 0x7f019406d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0194156c20 0x7f019406d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51406/0 (socket says 172.21.15.194:51406) 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 -- 172.21.15.194:0/140084095 learned_addr learned my addr 172.21.15.194:0/140084095 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f0198c00640 1 --2- 172.21.15.194:0/140084095 >> v2:172.21.15.196:3300/0 conn(0x7f0194150b70 0x7f01940a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 -- 172.21.15.194:0/140084095 >> v2:172.21.15.196:3300/0 conn(0x7f0194150b70 msgr2=0x7f01940a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:06.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 --2- 172.21.15.194:0/140084095 >> v2:172.21.15.196:3300/0 conn(0x7f0194150b70 0x7f01940a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 -- 172.21.15.194:0/140084095 >> v1:172.21.15.196:6789/0 conn(0x7f01940a9a10 legacy=0x7f019406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:06.950 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.947+0000 7f018be00640 1 -- 172.21.15.194:0/140084095 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194153f40 con 0x7f0194156c20 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.948+0000 7f018be00640 1 --2- 172.21.15.194:0/140084095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019406d900 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0194073240 tx=0x7f017c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f8083731e82346 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.948+0000 7f0193e00640 1 -- 172.21.15.194:0/140084095 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c02e070 con 0x7f0194156c20 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f0193e00640 1 -- 172.21.15.194:0/140084095 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f017c037070 con 0x7f0194156c20 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f0193e00640 1 -- 172.21.15.194:0/140084095 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017c031a20 con 0x7f0194156c20 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 -- 172.21.15.194:0/140084095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 msgr2=0x7f019406d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 --2- 172.21.15.194:0/140084095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019406d900 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0194073240 tx=0x7f017c02b880 comp rx=0 tx=0).stop 2024-03-07T10:25:06.951 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 -- 172.21.15.194:0/140084095 shutdown_connections 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 --2- 172.21.15.194:0/140084095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019406d900 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 --2- 172.21.15.194:0/140084095 >> v2:172.21.15.196:3300/0 conn(0x7f0194150b70 0x7f01940a94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 -- 172.21.15.194:0/140084095 >> 172.21.15.194:0/140084095 conn(0x7f019406b840 msgr2=0x7f01940c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 -- 172.21.15.194:0/140084095 shutdown_connections 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.949+0000 7f019b600640 1 -- 172.21.15.194:0/140084095 wait complete. 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.951+0000 7f019b600640 1 Processor -- start 2024-03-07T10:25:06.952 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.951+0000 7f019b600640 1 -- start start 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01940a9a10 0x7f019414e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0194150b70 0x7f019414ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0194153630 con 0x7f0194156c20 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01940c7a30 con 0x7f0194150b70 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f019b600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01940ac460 con 0x7f01940a9a10 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f0199600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f0199600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51420/0 (socket says 172.21.15.194:51420) 2024-03-07T10:25:06.954 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.952+0000 7f0199600640 1 -- 172.21.15.194:0/4206594132 learned_addr learned my addr 172.21.15.194:0/4206594132 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f018be00640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0194150b70 0x7f019414ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0198c00640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01940a9a10 0x7f019414e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 -- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01940a9a10 msgr2=0x7f019414e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01940a9a10 0x7f019414e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 -- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0194150b70 msgr2=0x7f019414ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0194150b70 0x7f019414ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:06.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 -- 172.21.15.194:0/4206594132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0194153360 con 0x7f0194156c20 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0199600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b970 tx=0x7f018c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c019070 con 0x7f0194156c20 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f018c00cb40 con 0x7f0194156c20 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01941eb7d0 con 0x7f0194156c20 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.953+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c014440 con 0x7f0194156c20 2024-03-07T10:25:06.956 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.954+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01941519d0 con 0x7f0194156c20 2024-03-07T10:25:06.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.955+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0194068170 con 0x7f0194156c20 2024-03-07T10:25:06.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.956+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f018c01c070 con 0x7f0194156c20 2024-03-07T10:25:06.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.956+0000 7f0191600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 0x7f017006d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:06.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.957+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6033+0+0 (secure 0 0 0) 0x7f018c089f40 con 0x7f0194156c20 2024-03-07T10:25:06.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.957+0000 7f0198c00640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 0x7f017006d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:06.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.958+0000 7f0198c00640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 0x7f017006d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0184006fd0 tx=0x7f0184008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:06.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:06.961+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f018c058c60 con 0x7f0194156c20 2024-03-07T10:25:07.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.196+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01940aa8e0 con 0x7f0194156c20 2024-03-07T10:25:07.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.197+0000 7f0191600640 1 -- 172.21.15.194:0/4206594132 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4986 (secure 0 0 0) 0x7f018c058560 con 0x7f0194156c20 2024-03-07T10:25:07.199 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:07.199 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.196:6837/1953632658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6836","nonce":1953632658},{"type":"v1","addr":"172.21.15.196:6837","nonce":1953632658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":5346,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/4277918804","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4277918804},{"type":"v1","addr":"172.21.15.194:6833","nonce":4277918804}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":5628,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1443192949","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":1443192949},{"type":"v1","addr":"172.21.15.194:6835","nonce":1443192949}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-07T10:21:08.712900+0000","modified":"2024-03-07T10:24:01.015882+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4733},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4733":{"gid":4733,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":5,"addr":"172.21.15.196:6835/3343805854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6834","nonce":3343805854},{"type":"v1","addr":"172.21.15.196:6835","nonce":3343805854}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4733,"qdb_cluster":[4733]},"id":2}]} 2024-03-07T10:25:07.200 INFO:teuthology.orchestra.run.smithi194.stderr:dumped fsmap epoch 32 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 msgr2=0x7f017006d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 0x7f017006d990 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0184006fd0 tx=0x7f0184008040 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 msgr2=0x7f019413f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f018c00b970 tx=0x7f018c00be30 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 shutdown_connections 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f017006b4d0 0x7f017006d990 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0194156c20 0x7f019413f780 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f0194150b70 0x7f019414ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 --2- 172.21.15.194:0/4206594132 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f01940a9a10 0x7f019414e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.200+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 >> 172.21.15.194:0/4206594132 conn(0x7f019406b840 msgr2=0x7f019406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:07.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.201+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 shutdown_connections 2024-03-07T10:25:07.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.201+0000 7f019b600640 1 -- 172.21.15.194:0/4206594132 wait complete. 2024-03-07T10:25:07.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-07T10:25:07.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.421+0000 7f5afb600640 1 Processor -- start 2024-03-07T10:25:07.423 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.422+0000 7f5afb600640 1 -- start start 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f5af4152dc0 0x7f5af4159880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 0x7f5af40c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5af40c0930 0x7f5af4071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af4156610 con 0x7f5af40c0930 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af4159dc0 con 0x7f5af4152dc0 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.423+0000 7f5afb600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4155a00 con 0x7f5af40c12a0 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5af40c0930 0x7f5af4071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5af40c0930 0x7f5af4071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51422/0 (socket says 172.21.15.194:51422) 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 -- 172.21.15.194:0/4072462305 learned_addr learned my addr 172.21.15.194:0/4072462305 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af8c00640 1 --2- 172.21.15.194:0/4072462305 >> v2:172.21.15.196:3300/0 conn(0x7f5af4152dc0 0x7f5af4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af3e00640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 0x7f5af40c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 -- 172.21.15.194:0/4072462305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 msgr2=0x7f5af40c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 0x7f5af40c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 -- 172.21.15.194:0/4072462305 >> v2:172.21.15.196:3300/0 conn(0x7f5af4152dc0 msgr2=0x7f5af4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 --2- 172.21.15.194:0/4072462305 >> v2:172.21.15.196:3300/0 conn(0x7f5af4152dc0 0x7f5af4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af9600640 1 -- 172.21.15.194:0/4072462305 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af4155ce0 con 0x7f5af40c0930 2024-03-07T10:25:07.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.424+0000 7f5af3e00640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 0x7f5af40c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.425+0000 7f5af9600640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c0930 0x7f5af4071b90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5af406eff0 tx=0x7f5aec02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395483a051c9ec00 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5af3400640 1 -- 172.21.15.194:0/4072462305 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec02c960 con 0x7f5af40c0930 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5af3400640 1 -- 172.21.15.194:0/4072462305 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5aec02cb00 con 0x7f5af40c0930 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5af3400640 1 -- 172.21.15.194:0/4072462305 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0343f0 con 0x7f5af40c0930 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 -- 172.21.15.194:0/4072462305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c0930 msgr2=0x7f5af4071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c0930 0x7f5af4071b90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5af406eff0 tx=0x7f5aec02bdc0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 -- 172.21.15.194:0/4072462305 shutdown_connections 2024-03-07T10:25:07.428 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c0930 0x7f5af4071b90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 --2- 172.21.15.194:0/4072462305 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af40c12a0 0x7f5af40c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 --2- 172.21.15.194:0/4072462305 >> v2:172.21.15.196:3300/0 conn(0x7f5af4152dc0 0x7f5af4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 -- 172.21.15.194:0/4072462305 >> 172.21.15.194:0/4072462305 conn(0x7f5af406b840 msgr2=0x7f5af40c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 -- 172.21.15.194:0/4072462305 shutdown_connections 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.426+0000 7f5afb600640 1 -- 172.21.15.194:0/4072462305 wait complete. 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.428+0000 7f5afb600640 1 Processor -- start 2024-03-07T10:25:07.429 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.428+0000 7f5afb600640 1 -- start start 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af40c0930 0x7f5af41ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4152dc0 0x7f5af4158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41531a0 con 0x7f5af40c12a0 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af41562a0 con 0x7f5af40c0930 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5afb600640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4153320 con 0x7f5af4152dc0 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5af3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51438/0 (socket says 172.21.15.194:51438) 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.429+0000 7f5af3e00640 1 -- 172.21.15.194:0/3833245712 learned_addr learned my addr 172.21.15.194:0/3833245712 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:07.432 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af8c00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af40c0930 0x7f5af41ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 -- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4152dc0 msgr2=0x7f5af4158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4152dc0 0x7f5af4158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 -- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af40c0930 msgr2=0x7f5af41ef0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af40c0930 0x7f5af41ef0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 -- 172.21.15.194:0/3833245712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af41ef610 con 0x7f5af40c12a0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af3e00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c7f0 tx=0x7f5ae000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0015070 con 0x7f5af40c12a0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5ae0007820 con 0x7f5af40c12a0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af4072140 con 0x7f5af40c12a0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.430+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0007c30 con 0x7f5af40c12a0 2024-03-07T10:25:07.433 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.431+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4072700 con 0x7f5af40c12a0 2024-03-07T10:25:07.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.432+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af4068170 con 0x7f5af40c12a0 2024-03-07T10:25:07.434 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.432+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f5ae0018070 con 0x7f5af40c12a0 2024-03-07T10:25:07.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.433+0000 7f5af0c00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 0x7f5ad406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.433+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6033+0+0 (secure 0 0 0) 0x7f5ae008a4b0 con 0x7f5af40c12a0 2024-03-07T10:25:07.435 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.434+0000 7f5af8c00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 0x7f5ad406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.436 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.435+0000 7f5af8c00640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 0x7f5ad406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8006fd0 tx=0x7f5ae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.439 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.438+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f5ae0059150 con 0x7f5af40c12a0 2024-03-07T10:25:07.639 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.638+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5af40c29d0 con 0x7f5af40c12a0 2024-03-07T10:25:07.641 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.639+0000 7f5af0c00640 1 -- 172.21.15.194:0/3833245712 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+17224 (secure 0 0 0) 0x7f5ae0058a50 con 0x7f5af40c12a0 2024-03-07T10:25:07.641 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-03-07T10:25:07.642 INFO:teuthology.orchestra.run.smithi194.stdout:{"epoch":32,"fsid":"4f04f9a7-36ed-4153-a852-b0f479c9f76c","created":"2024-03-07T10:20:33.210988+0000","modified":"2024-03-07T10:25:06.214152+0000","last_up_change":"2024-03-07T10:20:45.730542+0000","last_in_change":"2024-03-07T10:20:36.795645+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-07T10:20:46.482552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-03-07T10:21:06.809543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-03-07T10:21:07.702778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d39fe2af-b684-48af-a9bc-636fe0b35f88","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6809","nonce":1656769343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6811","nonce":1656769343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6815","nonce":1656769343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":1656769343},{"type":"v1","addr":"172.21.15.194:6813","nonce":1656769343}]},"public_addr":"172.21.15.194:6809/1656769343","cluster_addr":"172.21.15.194:6811/1656769343","heartbeat_back_addr":"172.21.15.194:6815/1656769343","heartbeat_front_addr":"172.21.15.194:6813/1656769343","state":["exists","up"]},{"osd":1,"uuid":"cc5c6bdb-f7ee-4ae6-98eb-73408404882e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6801","nonce":3579621358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6803","nonce":3579621358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6807","nonce":3579621358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":3579621358},{"type":"v1","addr":"172.21.15.194:6805","nonce":3579621358}]},"public_addr":"172.21.15.194:6801/3579621358","cluster_addr":"172.21.15.194:6803/3579621358","heartbeat_back_addr":"172.21.15.194:6807/3579621358","heartbeat_front_addr":"172.21.15.194:6805/3579621358","state":["exists","up"]},{"osd":2,"uuid":"ea857442-96a8-4d54-90a1-676a21f19187","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6817","nonce":1248623532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6818","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6819","nonce":1248623532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6826","nonce":1248623532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":1248623532},{"type":"v1","addr":"172.21.15.194:6822","nonce":1248623532}]},"public_addr":"172.21.15.194:6817/1248623532","cluster_addr":"172.21.15.194:6819/1248623532","heartbeat_back_addr":"172.21.15.194:6826/1248623532","heartbeat_front_addr":"172.21.15.194:6822/1248623532","state":["exists","up"]},{"osd":3,"uuid":"30652334-9476-4e7e-ac3c-7c86613af6a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6823","nonce":1209571580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6827","nonce":1209571580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6830","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6831","nonce":1209571580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":1209571580},{"type":"v1","addr":"172.21.15.194:6829","nonce":1209571580}]},"public_addr":"172.21.15.194:6823/1209571580","cluster_addr":"172.21.15.194:6827/1209571580","heartbeat_back_addr":"172.21.15.194:6831/1209571580","heartbeat_front_addr":"172.21.15.194:6829/1209571580","state":["exists","up"]},{"osd":4,"uuid":"5f6a4990-fd54-42e0-9e35-7c9e76ebc040","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6806","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6808","nonce":2284178707}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6810","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6811","nonce":2284178707}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6814","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6815","nonce":2284178707}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6812","nonce":2284178707},{"type":"v1","addr":"172.21.15.196:6813","nonce":2284178707}]},"public_addr":"172.21.15.196:6808/2284178707","cluster_addr":"172.21.15.196:6811/2284178707","heartbeat_back_addr":"172.21.15.196:6815/2284178707","heartbeat_front_addr":"172.21.15.196:6813/2284178707","state":["exists","up"]},{"osd":5,"uuid":"e1cfefda-e9fc-4c5c-b062-0267b166630c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6800","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6801","nonce":2704867987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6802","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6803","nonce":2704867987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6807","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6809","nonce":2704867987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6804","nonce":2704867987},{"type":"v1","addr":"172.21.15.196:6805","nonce":2704867987}]},"public_addr":"172.21.15.196:6801/2704867987","cluster_addr":"172.21.15.196:6803/2704867987","heartbeat_back_addr":"172.21.15.196:6809/2704867987","heartbeat_front_addr":"172.21.15.196:6805/2704867987","state":["exists","up"]},{"osd":6,"uuid":"b3ff1bad-a1a2-4d35-a39f-a401591e80e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6816","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6817","nonce":2495219852}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6819","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6821","nonce":2495219852}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6827","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6829","nonce":2495219852}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6823","nonce":2495219852},{"type":"v1","addr":"172.21.15.196:6825","nonce":2495219852}]},"public_addr":"172.21.15.196:6817/2495219852","cluster_addr":"172.21.15.196:6821/2495219852","heartbeat_back_addr":"172.21.15.196:6829/2495219852","heartbeat_front_addr":"172.21.15.196:6825/2495219852","state":["exists","up"]},{"osd":7,"uuid":"156119d0-ad52-47a5-88e2-86732978a1fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6818","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6820","nonce":311786582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6822","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6824","nonce":311786582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6830","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6831","nonce":311786582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.196:6826","nonce":311786582},{"type":"v1","addr":"172.21.15.196:6828","nonce":311786582}]},"public_addr":"172.21.15.196:6820/311786582","cluster_addr":"172.21.15.196:6824/311786582","heartbeat_back_addr":"172.21.15.196:6831/311786582","heartbeat_front_addr":"172.21.15.196:6828/311786582","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.137487+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.075035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.170580+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.125149+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.163158+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.389739+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.188367+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-07T10:20:42.129611+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6835/3339340096":"2024-03-08T10:25:03.073208+0000","172.21.15.194:6834/3339340096":"2024-03-08T10:25:03.073208+0000","172.21.15.196:6835/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6832/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.196:6834/1848630458":"2024-03-08T10:23:37.999292+0000","172.21.15.194:6835/1436303034":"2024-03-08T10:22:52.989185+0000","172.21.15.194:6833/1582324990":"2024-03-08T10:23:58.005535+0000","172.21.15.194:6834/1436303034":"2024-03-08T10:22:52.989185+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 msgr2=0x7f5ad406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 0x7f5ad406d990 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8006fd0 tx=0x7f5ae8008040 comp rx=0 tx=0).stop 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 msgr2=0x7f5af41eb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c7f0 tx=0x7f5ae000ccb0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 shutdown_connections 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f5ad406b4d0 0x7f5ad406d990 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f5af4152dc0 0x7f5af4158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.644 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5af40c12a0 0x7f5af41eb8b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 --2- 172.21.15.194:0/3833245712 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f5af40c0930 0x7f5af41ef0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.642+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 >> 172.21.15.194:0/3833245712 conn(0x7f5af406b840 msgr2=0x7f5af4153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:07.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.643+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 shutdown_connections 2024-03-07T10:25:07.645 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.643+0000 7f5afb600640 1 -- 172.21.15.194:0/3833245712 wait complete. 2024-03-07T10:25:07.664 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-03-07T10:25:07.867 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.866+0000 7f1f7ec00640 1 Processor -- start 2024-03-07T10:25:07.868 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.866+0000 7f1f7ec00640 1 -- start start 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7ec00640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f1f78150b70 0x7f1f780a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f7806e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f78153980 con 0x7f1f78156c20 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7ec00640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7806e550 con 0x7f1f78150b70 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78153c60 con 0x7f1f780a9a10 2024-03-07T10:25:07.869 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f6f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1f78156c20 0x7f1f7806d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56606/0 (socket says 172.21.15.194:56606) 2024-03-07T10:25:07.870 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f6f400640 1 -- 172.21.15.194:0/2433084902 learned_addr learned my addr 172.21.15.194:0/2433084902 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f7806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f77e00640 1 --2- 172.21.15.194:0/2433084902 >> v2:172.21.15.196:3300/0 conn(0x7f1f78150b70 0x7f1f780a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.868+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055454145 0 0) 0x7f1f78153980 con 0x7f1f78156c20 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f5c003520 con 0x7f1f78156c20 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 633135987 0 0) 0x7f1f5c003520 con 0x7f1f78156c20 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 msgr2=0x7f1f7806e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f7806e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 >> v2:172.21.15.196:3300/0 conn(0x7f1f78150b70 msgr2=0x7f1f780a94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 --2- 172.21.15.194:0/2433084902 >> v2:172.21.15.196:3300/0 conn(0x7f1f78150b70 0x7f1f780a94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78153f40 con 0x7f1f78156c20 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4101117027 0 0) 0x7f1f60001670 con 0x7f1f78156c20 2024-03-07T10:25:07.872 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 >> v1:172.21.15.194:6789/0 conn(0x7f1f78156c20 legacy=0x7f1f7806d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c0039b0 0x7f1f5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c004d40 0x7f1f5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7806e550 con 0x7f1f5c004d40 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78153c60 con 0x7f1f5c0039b0 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5c00b9c0 con 0x7f1f780a9a10 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.869+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c004d40 0x7f1f5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f6f400640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f77e00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c0039b0 0x7f1f5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 msgr2=0x7f1f5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f780a9a10 0x7f1f5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c0039b0 msgr2=0x7f1f5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f5c0039b0 0x7f1f5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.873 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.870+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2433084902 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c003520 con 0x7f1f5c004d40 2024-03-07T10:25:07.874 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.871+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c004d40 0x7f1f5c0051c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fc0 tx=0x7f1f5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5411932f4b9ccfa server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.871+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70039070 con 0x7f1f5c004d40 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.871+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f7002cc20 con 0x7f1f5c004d40 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.871+0000 7f1f77400640 1 -- 172.21.15.194:0/2433084902 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70009c10 con 0x7f1f5c004d40 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2433084902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c004d40 msgr2=0x7f1f5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2433084902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f5c004d40 0x7f1f5c0051c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1f70009fc0 tx=0x7f1f5c005830 comp rx=0 tx=0).stop 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2433084902 reap_dead start 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2433084902 shutdown_connections 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2433084902 >> 172.21.15.194:0/2433084902 conn(0x7f1f7806b840 msgr2=0x7f1f780c6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2433084902 shutdown_connections 2024-03-07T10:25:07.875 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.872+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2433084902 wait complete. 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.874+0000 7f1f7ec00640 1 Processor -- start 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.874+0000 7f1f7ec00640 1 -- start start 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f5c004d40 0x7f1f78156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 0x7f1f780c0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.877 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f78153630 con 0x7f1f78152f50 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f780c7a30 con 0x7f1f780c5f40 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7ec00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f780ac460 con 0x7f1f5c004d40 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51458/0 (socket says 172.21.15.194:51458) 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2130136921 learned_addr learned my addr 172.21.15.194:0/2130136921 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.875+0000 7f1f77e00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f5c004d40 0x7f1f78156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f6f400640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 0x7f1f780c0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f5c004d40 msgr2=0x7f1f78156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f5c004d40 0x7f1f78156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.878 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 msgr2=0x7f1f780c0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:07.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 0x7f1f780c0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:07.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 -- 172.21.15.194:0/2130136921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78156850 con 0x7f1f78152f50 2024-03-07T10:25:07.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f6f400640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 0x7f1f780c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-07T10:25:07.879 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7cc00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1f7002c690 tx=0x7f1f70009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70042030 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1f7003a040 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f70039070 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f78149e50 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.876+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f780c6700 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.878+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f78068170 con 0x7f1f78152f50 2024-03-07T10:25:07.880 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.878+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f1f70045070 con 0x7f1f78152f50 2024-03-07T10:25:07.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.879+0000 7f1f74c00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 0x7f1f5406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:07.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.879+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6033+0+0 (secure 0 0 0) 0x7f1f700ac0d0 con 0x7f1f78152f50 2024-03-07T10:25:07.881 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.880+0000 7f1f77e00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 0x7f1f5406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:07.882 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.881+0000 7f1f77e00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 0x7f1f5406d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009a90 tx=0x7f1f68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:07.885 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:07.883+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f1f7004c020 con 0x7f1f78152f50 2024-03-07T10:25:08.123 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.120+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) v1 -- 0x7f1f7806cd20 con 0x7f1f78152f50 2024-03-07T10:25:08.127 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.124+0000 7f1f74c00640 1 -- 172.21.15.194:0/2130136921 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 151+0+0 (secure 0 0 0) 0x7f1f7007ad60 con 0x7f1f78152f50 2024-03-07T10:25:08.127 INFO:teuthology.orchestra.run.smithi194.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-07T10:25:08.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 msgr2=0x7f1f5406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 0x7f1f5406d990 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1f68009a90 tx=0x7f1f68008040 comp rx=0 tx=0).stop 2024-03-07T10:25:08.129 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 msgr2=0x7f1f78151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1f7002c690 tx=0x7f1f70009750 comp rx=0 tx=0).stop 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 shutdown_connections 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f1f5406b4d0 0x7f1f5406d990 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f78152f50 0x7f1f78151370 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f1f780c5f40 0x7f1f780c0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.130 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 --2- 172.21.15.194:0/2130136921 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f1f5c004d40 0x7f1f78156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.127+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 >> 172.21.15.194:0/2130136921 conn(0x7f1f7806b840 msgr2=0x7f1f780c6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:08.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.128+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 shutdown_connections 2024-03-07T10:25:08.131 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.128+0000 7f1f7ec00640 1 -- 172.21.15.194:0/2130136921 wait complete. 2024-03-07T10:25:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-03-07T10:25:08.171 INFO:tasks.ceph.mds.b.smithi196.stderr: -2431> 2024-03-07T10:24:03.107+0000 7fec16400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-07T10:25:08.261 INFO:tasks.ceph.mds.b.smithi196.stdout:starting mds.b at 2024-03-07T10:25:08.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.356+0000 7ff8dca00640 1 Processor -- start 2024-03-07T10:25:08.359 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.356+0000 7ff8dca00640 1 -- start start 2024-03-07T10:25:08.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8dca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff8d81598b0 0x7ff8d81610b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:08.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8dca00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80c2ae0 con 0x7ff8d8152c00 2024-03-07T10:25:08.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8dca00640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d806dd10 con 0x7ff8d80c3f80 2024-03-07T10:25:08.360 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8dca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d8158d10 con 0x7ff8d81598b0 2024-03-07T10:25:08.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8d5e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff8d8152c00 0x7ff8d80ad8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:56622/0 (socket says 172.21.15.194:56622) 2024-03-07T10:25:08.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8d5e00640 1 -- 172.21.15.194:0/4059583856 learned_addr learned my addr 172.21.15.194:0/4059583856 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:08.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8d6800640 1 --2- 172.21.15.194:0/4059583856 >> v2:172.21.15.194:3300/0 conn(0x7ff8d81598b0 0x7ff8d81610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:08.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8d5400640 1 -- 172.21.15.194:0/4059583856 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819137732 0 0) 0x7ff8d80c2ae0 con 0x7ff8d8152c00 2024-03-07T10:25:08.361 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.358+0000 7ff8d5400640 1 -- 172.21.15.194:0/4059583856 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8bc003520 con 0x7ff8d8152c00 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.359+0000 7ff8d6800640 1 -- 172.21.15.194:0/4059583856 >> v1:172.21.15.196:6789/0 conn(0x7ff8d80c3f80 legacy=0x7ff8d81591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.359+0000 7ff8d6800640 1 -- 172.21.15.194:0/4059583856 >> v1:172.21.15.194:6789/0 conn(0x7ff8d8152c00 legacy=0x7ff8d80ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.359+0000 7ff8d6800640 1 -- 172.21.15.194:0/4059583856 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d80c2d50 con 0x7ff8d81598b0 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8d6800640 1 --2- 172.21.15.194:0/4059583856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d81610b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d90 tx=0x7ff8d002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10437f9f3e03118 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8d5400640 1 -- 172.21.15.194:0/4059583856 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0039070 con 0x7ff8d81598b0 2024-03-07T10:25:08.362 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8d5400640 1 -- 172.21.15.194:0/4059583856 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff8d002cbd0 con 0x7ff8d81598b0 2024-03-07T10:25:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8d5400640 1 -- 172.21.15.194:0/4059583856 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0034440 con 0x7ff8d81598b0 2024-03-07T10:25:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8dca00640 1 -- 172.21.15.194:0/4059583856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 msgr2=0x7ff8d81610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8dca00640 1 --2- 172.21.15.194:0/4059583856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d81610b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d90 tx=0x7ff8d002be20 comp rx=0 tx=0).stop 2024-03-07T10:25:08.363 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8dca00640 1 -- 172.21.15.194:0/4059583856 shutdown_connections 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8dca00640 1 --2- 172.21.15.194:0/4059583856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d81610b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.360+0000 7ff8dca00640 1 -- 172.21.15.194:0/4059583856 >> 172.21.15.194:0/4059583856 conn(0x7ff8d80c4b40 msgr2=0x7ff8d80c4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.361+0000 7ff8dca00640 1 -- 172.21.15.194:0/4059583856 shutdown_connections 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.361+0000 7ff8dca00640 1 -- 172.21.15.194:0/4059583856 wait complete. 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.362+0000 7ff8dca00640 1 Processor -- start 2024-03-07T10:25:08.364 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.362+0000 7ff8dca00640 1 -- start start 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8d80c3f80 0x7ff8d814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8d8152c00 0x7ff8d814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80c3b60 con 0x7ff8d81598b0 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8156610 con 0x7ff8d80c3f80 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8dca00640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d80adff0 con 0x7ff8d8152c00 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8d6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8d6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:51488/0 (socket says 172.21.15.194:51488) 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.363+0000 7ff8d6800640 1 -- 172.21.15.194:0/909183389 learned_addr learned my addr 172.21.15.194:0/909183389 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 -- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8d8152c00 msgr2=0x7ff8d814a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8d8152c00 0x7ff8d814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.367 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 -- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8d80c3f80 msgr2=0x7ff8d814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d5e00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8d80c3f80 0x7ff8d814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8d80c3f80 0x7ff8d814f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 -- 172.21.15.194:0/909183389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d806ed40 con 0x7ff8d81598b0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8d6800640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d90 tx=0x7ff8d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0039050 con 0x7ff8d81598b0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff8d0045070 con 0x7ff8d81598b0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d8149910 con 0x7ff8d81598b0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d003e870 con 0x7ff8d81598b0 2024-03-07T10:25:08.368 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.364+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d8149f00 con 0x7ff8d81598b0 2024-03-07T10:25:08.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.365+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d8068170 con 0x7ff8d81598b0 2024-03-07T10:25:08.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.366+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7ff8d003ea10 con 0x7ff8d81598b0 2024-03-07T10:25:08.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.367+0000 7ff8cea00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 0x7ff8b406d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:08.369 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.367+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6119+0+0 (secure 0 0 0) 0x7ff8d00ad1a0 con 0x7ff8d81598b0 2024-03-07T10:25:08.370 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.368+0000 7ff8d5e00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 0x7ff8b406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:08.371 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.369+0000 7ff8d5e00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 0x7ff8b406d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000f60 tx=0x7ff8c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:08.374 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.372+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7ff8d0032e20 con 0x7ff8d81598b0 2024-03-07T10:25:08.595 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:08.592+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff8d80c4820 con 0x7ff8d81598b0 2024-03-07T10:25:09.252 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.250+0000 7ff8cea00640 1 -- 172.21.15.194:0/909183389 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 99+0+0 (secure 0 0 0) 0x7ff8d007bf90 con 0x7ff8d81598b0 2024-03-07T10:25:09.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 msgr2=0x7ff8b406d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 0x7ff8b406d990 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000f60 tx=0x7ff8c8009040 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 msgr2=0x7ff8d814ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009d90 tx=0x7ff8d0004a40 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 shutdown_connections 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7ff8b406b4d0 0x7ff8b406d990 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff8d81598b0 0x7ff8d814ab60 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7ff8d8152c00 0x7ff8d814a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 --2- 172.21.15.194:0/909183389 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7ff8d80c3f80 0x7ff8d814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 >> 172.21.15.194:0/909183389 conn(0x7ff8d80c4b40 msgr2=0x7ff8d8061b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 shutdown_connections 2024-03-07T10:25:09.257 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.254+0000 7ff8dca00640 1 -- 172.21.15.194:0/909183389 wait complete. 2024-03-07T10:25:09.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-03-07T10:25:09.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.482+0000 7f34d7200640 1 Processor -- start 2024-03-07T10:25:09.485 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.482+0000 7f34d7200640 1 -- start start 2024-03-07T10:25:09.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f34d00717a0 0x7f34d0071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:09.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d01559a0 con 0x7f34d00c58e0 2024-03-07T10:25:09.486 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d7200640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d0155c80 con 0x7f34d0152e60 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d0153240 con 0x7f34d00717a0 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d5400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f34d00c58e0 0x7f34d00c5d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:47862/0 (socket says 172.21.15.194:47862) 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d5400640 1 -- 172.21.15.194:0/3412722865 learned_addr learned my addr 172.21.15.194:0/3412722865 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d6800640 1 --2- 172.21.15.194:0/3412722865 >> v2:172.21.15.194:3300/0 conn(0x7f34d00717a0 0x7f34d0071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.484+0000 7f34d4a00640 1 -- 172.21.15.194:0/3412722865 <== mon.0 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955410201 0 0) 0x7f34d01559a0 con 0x7f34d00c58e0 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.485+0000 7f34d4a00640 1 -- 172.21.15.194:0/3412722865 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34bc003520 con 0x7f34d00c58e0 2024-03-07T10:25:09.487 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.485+0000 7f34d6800640 1 -- 172.21.15.194:0/3412722865 >> v1:172.21.15.196:6789/0 conn(0x7f34d0152e60 legacy=0x7f34d00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.485+0000 7f34d6800640 1 -- 172.21.15.194:0/3412722865 >> v1:172.21.15.194:6789/0 conn(0x7f34d00c58e0 legacy=0x7f34d00c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.485+0000 7f34d6800640 1 -- 172.21.15.194:0/3412722865 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d0155f60 con 0x7f34d00717a0 2024-03-07T10:25:09.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.486+0000 7f34d6800640 1 --2- 172.21.15.194:0/3412722865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00717a0 0x7f34d0071bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23437079b40d5717 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:09.488 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.486+0000 7f34d4a00640 1 -- 172.21.15.194:0/3412722865 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc035020 con 0x7f34d00717a0 2024-03-07T10:25:09.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.486+0000 7f34d4a00640 1 -- 172.21.15.194:0/3412722865 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f34cc031830 con 0x7f34d00717a0 2024-03-07T10:25:09.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.486+0000 7f34d4a00640 1 -- 172.21.15.194:0/3412722865 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34cc031c20 con 0x7f34d00717a0 2024-03-07T10:25:09.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 -- 172.21.15.194:0/3412722865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00717a0 msgr2=0x7f34d0071bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.489 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 --2- 172.21.15.194:0/3412722865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00717a0 0x7f34d0071bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f34cc0097a0 tx=0x7f34cc02b8d0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 -- 172.21.15.194:0/3412722865 shutdown_connections 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 --2- 172.21.15.194:0/3412722865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00717a0 0x7f34d0071bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 -- 172.21.15.194:0/3412722865 >> 172.21.15.194:0/3412722865 conn(0x7f34d00acad0 msgr2=0x7f34d00acee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 -- 172.21.15.194:0/3412722865 shutdown_connections 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.487+0000 7f34d7200640 1 -- 172.21.15.194:0/3412722865 wait complete. 2024-03-07T10:25:09.490 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.488+0000 7f34d7200640 1 Processor -- start 2024-03-07T10:25:09.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.488+0000 7f34d7200640 1 -- start start 2024-03-07T10:25:09.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34d00717a0 0x7f34d00c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:09.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:09.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34d0152e60 0x7f34d014b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:09.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0156520 con 0x7f34d00c58e0 2024-03-07T10:25:09.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d0155760 con 0x7f34d0152e60 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.489+0000 7f34d7200640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d00c9570 con 0x7f34d00717a0 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40672/0 (socket says 172.21.15.194:40672) 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 -- 172.21.15.194:0/986706986 learned_addr learned my addr 172.21.15.194:0/986706986 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 -- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34d00717a0 msgr2=0x7f34d00c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34d00717a0 0x7f34d00c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 -- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34d0152e60 msgr2=0x7f34d014b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34d0152e60 0x7f34d014b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:09.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 -- 172.21.15.194:0/986706986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d01ee1a0 con 0x7f34d00c58e0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d5400640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c500 tx=0x7f34c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0017070 con 0x7f34d00c58e0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f34c0005ce0 con 0x7f34d00c58e0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c0007350 con 0x7f34d00c58e0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.490+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d01ee480 con 0x7f34d00c58e0 2024-03-07T10:25:09.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.491+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d01eea40 con 0x7f34d00c58e0 2024-03-07T10:25:09.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.492+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d0075600 con 0x7f34d00c58e0 2024-03-07T10:25:09.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.493+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f34c001a070 con 0x7f34d00c58e0 2024-03-07T10:25:09.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.493+0000 7f34c6000640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 0x7f34b406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:09.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.494+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6119+0+0 (secure 0 0 0) 0x7f34c00897a0 con 0x7f34d00c58e0 2024-03-07T10:25:09.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.494+0000 7f34d5e00640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 0x7f34b406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:09.497 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.495+0000 7f34d5e00640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 0x7f34b406d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f34c80012e0 tx=0x7f34c8007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:09.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.498+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f34c00585d0 con 0x7f34d00c58e0 2024-03-07T10:25:09.696 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:09.694+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f34d0072910 con 0x7f34d00c58e0 2024-03-07T10:25:10.256 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.253+0000 7f34c6000640 1 -- 172.21.15.194:0/986706986 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v34) v1 ==== 166+0+0 (secure 0 0 0) 0x7f34c0057ed0 con 0x7f34d00c58e0 2024-03-07T10:25:10.256 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'b_metadata' removed 2024-03-07T10:25:10.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 msgr2=0x7f34b406d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:10.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 0x7f34b406d9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f34c80012e0 tx=0x7f34c8007d30 comp rx=0 tx=0).stop 2024-03-07T10:25:10.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 msgr2=0x7f34d00abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:10.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f34c000c500 tx=0x7f34c000c9c0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 shutdown_connections 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f34b406b500 0x7f34b406d9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f34d0152e60 0x7f34d014b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34d00c58e0 0x7f34d00abc00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 --2- 172.21.15.194:0/986706986 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f34d00717a0 0x7f34d00c34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.257+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 >> 172.21.15.194:0/986706986 conn(0x7f34d00acad0 msgr2=0x7f34d0154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.258+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 shutdown_connections 2024-03-07T10:25:10.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.258+0000 7f34d7200640 1 -- 172.21.15.194:0/986706986 wait complete. 2024-03-07T10:25:10.284 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-03-07T10:25:10.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.488+0000 7f1242000640 1 Processor -- start 2024-03-07T10:25:10.491 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.488+0000 7f1242000640 1 -- start start 2024-03-07T10:25:10.492 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.489+0000 7f1242000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f123c14fa60 0x7f123c1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.489+0000 7f1242000640 1 --2- >> v2:172.21.15.196:3300/0 conn(0x7f123c0c1e20 0x7f123c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f1242000640 1 -- --> v1:172.21.15.196:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0c16e0 con 0x7f123c153ee0 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f1242000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c06d8d0 con 0x7f123c14fa60 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f1242000640 1 -- --> v2:172.21.15.196:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c06c9e0 con 0x7f123c0c1e20 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f123c14fa60 0x7f123c1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f123c14fa60 0x7f123c1524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40676/0 (socket says 172.21.15.194:40676) 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 -- 172.21.15.194:0/3374474137 learned_addr learned my addr 172.21.15.194:0/3374474137 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 -- 172.21.15.194:0/3374474137 >> v2:172.21.15.196:3300/0 conn(0x7f123c0c1e20 msgr2=0x7f123c1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 --2- 172.21.15.194:0/3374474137 >> v2:172.21.15.196:3300/0 conn(0x7f123c0c1e20 0x7f123c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 -- 172.21.15.194:0/3374474137 >> v1:172.21.15.196:6789/0 conn(0x7f123c153ee0 legacy=0x7f123c06dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-07T10:25:10.493 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.490+0000 7f123b400640 1 -- 172.21.15.194:0/3374474137 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c06ccc0 con 0x7f123c14fa60 2024-03-07T10:25:10.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.491+0000 7f123b400640 1 --2- 172.21.15.194:0/3374474137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c14fa60 0x7f123c1524b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f123c0a9fa0 tx=0x7f122c02da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ba8ce13c04891d server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:10.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f123aa00640 1 -- 172.21.15.194:0/3374474137 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c02f850 con 0x7f123c14fa60 2024-03-07T10:25:10.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f123aa00640 1 -- 172.21.15.194:0/3374474137 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f122c02f9f0 con 0x7f123c14fa60 2024-03-07T10:25:10.494 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f123aa00640 1 -- 172.21.15.194:0/3374474137 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c02fde0 con 0x7f123c14fa60 2024-03-07T10:25:10.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 -- 172.21.15.194:0/3374474137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c14fa60 msgr2=0x7f123c1524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:10.495 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 --2- 172.21.15.194:0/3374474137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c14fa60 0x7f123c1524b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f123c0a9fa0 tx=0x7f122c02da90 comp rx=0 tx=0).stop 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 -- 172.21.15.194:0/3374474137 shutdown_connections 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 --2- 172.21.15.194:0/3374474137 >> v2:172.21.15.196:3300/0 conn(0x7f123c0c1e20 0x7f123c1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 --2- 172.21.15.194:0/3374474137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c14fa60 0x7f123c1524b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.492+0000 7f1242000640 1 -- 172.21.15.194:0/3374474137 >> 172.21.15.194:0/3374474137 conn(0x7f123c0c6fc0 msgr2=0x7f123c0c73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.493+0000 7f1242000640 1 -- 172.21.15.194:0/3374474137 shutdown_connections 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.493+0000 7f1242000640 1 -- 172.21.15.194:0/3374474137 wait complete. 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.494+0000 7f1242000640 1 Processor -- start 2024-03-07T10:25:10.496 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.494+0000 7f1242000640 1 -- start start 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 --2- >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f123c0c1e20 0x7f123c1e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 --2- >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f123c14fa60 0x7f123c14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c06d560 con 0x7f123c153ee0 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 -- --> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c06d280 con 0x7f123c14fa60 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f1242000640 1 -- --> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c14fe40 con 0x7f123c0c1e20 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f123be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f123be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:40678/0 (socket says 172.21.15.194:40678) 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.495+0000 7f123be00640 1 -- 172.21.15.194:0/2609263833 learned_addr learned my addr 172.21.15.194:0/2609263833 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-03-07T10:25:10.499 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123b400640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f123c0c1e20 0x7f123c1e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f1232a00640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f123c14fa60 0x7f123c14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 -- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f123c0c1e20 msgr2=0x7f123c1e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f123c0c1e20 0x7f123c1e7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 -- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f123c14fa60 msgr2=0x7f123c14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f123c14fa60 0x7f123c14e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 -- 172.21.15.194:0/2609263833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c1e7000 con 0x7f123c153ee0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f123be00640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f123400c390 tx=0x7f123400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234017070 con 0x7f123c153ee0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f12340035f0 con 0x7f123c153ee0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1234003a00 con 0x7f123c153ee0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.496+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c144020 con 0x7f123c153ee0 2024-03-07T10:25:10.500 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.497+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c1e7560 con 0x7f123c153ee0 2024-03-07T10:25:10.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.498+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c068170 con 0x7f123c153ee0 2024-03-07T10:25:10.501 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.499+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89778+0+0 (secure 0 0 0) 0x7f123401a070 con 0x7f123c153ee0 2024-03-07T10:25:10.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.499+0000 7f1233e00640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 0x7f121806d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-07T10:25:10.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.500+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5691+0+0 (secure 0 0 0) 0x7f12340896c0 con 0x7f123c153ee0 2024-03-07T10:25:10.502 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.500+0000 7f123b400640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 0x7f121806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-07T10:25:10.503 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.501+0000 7f123b400640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 0x7f121806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f122c038000 tx=0x7f122c03b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-07T10:25:10.506 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.504+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183808 (secure 0 0 0) 0x7f123c1e7000 con 0x7f123c153ee0 2024-03-07T10:25:10.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:10.699+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f123c153680 con 0x7f123c153ee0 2024-03-07T10:25:11.282 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.280+0000 7f1233e00640 1 -- 172.21.15.194:0/2609263833 <== mon.0 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v35) v1 ==== 154+0+0 (secure 0 0 0) 0x7f12340584c0 con 0x7f123c153ee0 2024-03-07T10:25:11.283 INFO:teuthology.orchestra.run.smithi194.stderr:pool 'b_data' removed 2024-03-07T10:25:11.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 msgr2=0x7f121806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:11.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 0x7f121806d990 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f122c038000 tx=0x7f122c03b040 comp rx=0 tx=0).stop 2024-03-07T10:25:11.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 msgr2=0x7f123c0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-07T10:25:11.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f123400c390 tx=0x7f123400c850 comp rx=0 tx=0).stop 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 shutdown_connections 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:6832/3213558195,v1:172.21.15.196:6833/3213558195] conn(0x7f121806b4d0 0x7f121806d990 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f123c153ee0 0x7f123c0c4bb0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3300/0,v1:172.21.15.196:6789/0] conn(0x7f123c14fa60 0x7f123c14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 --2- 172.21.15.194:0/2609263833 >> [v2:172.21.15.196:3301/0,v1:172.21.15.196:6790/0] conn(0x7f123c0c1e20 0x7f123c1e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-07T10:25:11.287 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 >> 172.21.15.194:0/2609263833 conn(0x7f123c0c6fc0 msgr2=0x7f123c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-07T10:25:11.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.284+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 shutdown_connections 2024-03-07T10:25:11.288 INFO:teuthology.orchestra.run.smithi194.stderr:2024-03-07T10:25:11.285+0000 7f1242000640 1 -- 172.21.15.194:0/2609263833 wait complete. 2024-03-07T10:25:11.315 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-07T10:25:11.315 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-07T10:25:11.315 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.335 INFO:tasks.ceph.mds.a:Stopped 2024-03-07T10:25:11.335 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-07T10:25:11.335 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.404 INFO:tasks.ceph.mds.c:Stopped 2024-03-07T10:25:11.404 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-07T10:25:11.404 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.424 INFO:tasks.ceph.mds.b:Stopped 2024-03-07T10:25:11.425 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-07T10:25:11.425 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.497 INFO:tasks.ceph.mds.d:Stopped 2024-03-07T10:25:11.497 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-07T10:25:11.497 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-07T10:25:11.497 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.553 INFO:tasks.ceph.osd.0:Stopped 2024-03-07T10:25:11.553 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-07T10:25:11.553 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.604 INFO:tasks.ceph.osd.1:Stopped 2024-03-07T10:25:11.604 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-07T10:25:11.604 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.670 INFO:tasks.ceph.osd.2:Stopped 2024-03-07T10:25:11.670 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-07T10:25:11.670 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.734 INFO:tasks.ceph.osd.3:Stopped 2024-03-07T10:25:11.735 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-07T10:25:11.735 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.785 INFO:tasks.ceph.osd.4:Stopped 2024-03-07T10:25:11.785 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-07T10:25:11.786 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.836 INFO:tasks.ceph.osd.5:Stopped 2024-03-07T10:25:11.836 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-07T10:25:11.836 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.896 INFO:tasks.ceph.osd.6:Stopped 2024-03-07T10:25:11.896 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-07T10:25:11.896 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:11.969 INFO:tasks.ceph.osd.7:Stopped 2024-03-07T10:25:11.970 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-07T10:25:11.970 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-07T10:25:11.970 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:12.037 INFO:tasks.ceph.mgr.y:Stopped 2024-03-07T10:25:12.038 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-07T10:25:12.038 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:12.109 INFO:tasks.ceph.mgr.x:Stopped 2024-03-07T10:25:12.110 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-07T10:25:12.110 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-07T10:25:12.110 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:12.150 INFO:tasks.ceph.mon.a:Stopped 2024-03-07T10:25:12.151 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-07T10:25:12.151 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:12.188 INFO:tasks.ceph.mon.b:Stopped 2024-03-07T10:25:12.188 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-07T10:25:12.188 INFO:teuthology.orchestra.run:waiting for 300 2024-03-07T10:25:12.257 INFO:tasks.ceph.mon.c:Stopped 2024-03-07T10:25:12.257 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-07T10:25:12.258 DEBUG:teuthology.orchestra.run.smithi194:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'Replacing daemon mds' | head -n 1 2024-03-07T10:25:12.371 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:12.371 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-07T10:25:12.686 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:12.686 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-07T10:25:12.829 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:12.829 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-07T10:25:12.977 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:12.977 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-07T10:25:13.127 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:13.128 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-07T10:25:13.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:13.622 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-07T10:25:13.771 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:13.771 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-07T10:25:13.917 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:13.918 DEBUG:teuthology.orchestra.run.smithi196:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-07T10:25:14.079 INFO:tasks.ceph:Archiving mon data... 2024-03-07T10:25:14.081 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/data/mon.a.tgz 2024-03-07T10:25:14.081 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-03-07T10:25:14.131 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.1OZvb8XpY6 2024-03-07T10:25:14.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.1OZvb8XpY6 2024-03-07T10:25:14.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.1OZvb8XpY6 2024-03-07T10:25:14.441 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.1OZvb8XpY6 is 349KB 2024-03-07T10:25:14.536 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.1OZvb8XpY6 2024-03-07T10:25:14.583 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/data/mon.b.tgz 2024-03-07T10:25:14.583 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-07T10:25:14.640 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.HcYACS3S50 2024-03-07T10:25:14.640 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.HcYACS3S50 2024-03-07T10:25:14.857 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.HcYACS3S50 2024-03-07T10:25:15.008 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.HcYACS3S50 is 465KB 2024-03-07T10:25:15.118 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.HcYACS3S50 2024-03-07T10:25:15.174 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/data/mon.c.tgz 2024-03-07T10:25:15.174 DEBUG:teuthology.orchestra.run.smithi196:> mktemp 2024-03-07T10:25:15.225 INFO:teuthology.orchestra.run.smithi196.stdout:/tmp/tmp.VtwQDkXp1L 2024-03-07T10:25:15.226 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.VtwQDkXp1L 2024-03-07T10:25:15.422 DEBUG:teuthology.orchestra.run.smithi196:> sudo chmod 0666 /tmp/tmp.VtwQDkXp1L 2024-03-07T10:25:15.568 DEBUG:teuthology.orchestra.remote:smithi196:/tmp/tmp.VtwQDkXp1L is 465KB 2024-03-07T10:25:15.676 DEBUG:teuthology.orchestra.run.smithi196:> rm -fr /tmp/tmp.VtwQDkXp1L 2024-03-07T10:25:15.729 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-07T10:25:15.729 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-07T10:25:15.737 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-07T10:25:15.878 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-07T10:25:16.140 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-07T10:25:16.140 INFO:tasks.ceph:Archiving crash dumps... 2024-03-07T10:25:16.236 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi194/crash 2024-03-07T10:25:16.239 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-07T10:25:16.331 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi196/crash 2024-03-07T10:25:16.332 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-07T10:25:16.424 INFO:tasks.ceph:Shutting down logrotate 2024-03-07T10:25:16.424 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:25:16.431 DEBUG:teuthology.orchestra.run.smithi196:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-07T10:25:16.569 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-07T10:25:16.666 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-07T10:25:16.763 INFO:tasks.ceph:Compressing logs... 2024-03-07T10:25:16.763 DEBUG:teuthology.orchestra.run.smithi194:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-07T10:25:16.771 DEBUG:teuthology.orchestra.run.smithi196:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-07T10:25:16.854 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-03-07T10:25:16.856 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51701.log 2024-03-07T10:25:16.857 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49297.log 2024-03-07T10:25:16.857 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-03-07T10:25:16.858 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50570.log 2024-03-07T10:25:16.858 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51701.log.gz 2024-03-07T10:25:16.859 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48359.log 2024-03-07T10:25:16.860 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49297.log.gz 2024-03-07T10:25:16.860 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-07T10:25:16.861 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42978.log 2024-03-07T10:25:16.861 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50570.log.gz 2024-03-07T10:25:16.862 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36964.log 2024-03-07T10:25:16.862 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49875.log 2024-03-07T10:25:16.862 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48359.log.gz 2024-03-07T10:25:16.863 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48602.log 2024-03-07T10:25:16.864 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42978.log.gz 2024-03-07T10:25:16.865 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37004.log 2024-03-07T10:25:16.865 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36804.log 2024-03-07T10:25:16.865 INFO:teuthology.orchestra.run.smithi196.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36964.log.gz 2024-03-07T10:25:16.865 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42622.log 2024-03-07T10:25:16.865 INFO:teuthology.orchestra.run.smithi196.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37004.log.gz 2024-03-07T10:25:16.866 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36804.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36804.log.gz 2024-03-07T10:25:16.866 INFO:teuthology.orchestra.run.smithi196.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49875.log.gz 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48602.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48602.log.gz 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46061.log 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2024-03-07T10:25:16.867 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49503.log 2024-03-07T10:25:16.869 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-03-07T10:25:16.869 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46061.log.gz 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.1.42622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42622.log.gz 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36764.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42641.log 2024-03-07T10:25:16.870 INFO:teuthology.orchestra.run.smithi196.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-07T10:25:16.871 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36884.log 2024-03-07T10:25:16.871 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.1.42641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42641.log.gz 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42428.log 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49503.log.gz 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44334.log 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48986.log 2024-03-07T10:25:16.872 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42428.log.gz 2024-03-07T10:25:16.873 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-03-07T10:25:16.874 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44334.log.gz 2024-03-07T10:25:16.874 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-07T10:25:16.874 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36884.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-07T10:25:16.874 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.7.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36884.log.gz 2024-03-07T10:25:16.875 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48786.log 2024-03-07T10:25:16.875 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48986.log.gz 2024-03-07T10:25:16.875 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37044.log 2024-03-07T10:25:16.876 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51136.log 2024-03-07T10:25:16.876 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-03-07T10:25:16.877 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2024-03-07T10:25:16.877 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48786.log.gz 2024-03-07T10:25:16.877 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-07T10:25:16.878 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2024-03-07T10:25:16.878 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51136.log.gz 2024-03-07T10:25:16.878 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.37044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36844.log 2024-03-07T10:25:16.878 INFO:teuthology.orchestra.run.smithi196.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37044.log.gz 2024-03-07T10:25:16.879 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2024-03-07T10:25:16.879 INFO:teuthology.orchestra.run.smithi194.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2024-03-07T10:25:16.879 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-07T10:25:16.880 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 2024-03-07T10:25:16.880 INFO:teuthology.orchestra.run.smithi194.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2024-03-07T10:25:16.882 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36844.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36844.log.gz 2024-03-07T10:25:16.882 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5/var/log/ceph/ceph.log: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-07T10:25:16.882 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44014.log 2024-03-07T10:25:16.883 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz 2024-03-07T10:25:16.883 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50282.log 2024-03-07T10:25:16.883 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2024-03-07T10:25:16.885 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51430.log 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44014.log.gz 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50282.log.gz 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36924.log 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi196.stderr: 91.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-07T10:25:16.886 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-07T10:25:16.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50324.log 2024-03-07T10:25:16.887 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51430.log.gz 2024-03-07T10:25:16.887 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-03-07T10:25:16.887 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2024-03-07T10:25:16.889 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2024-03-07T10:25:16.889 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50324.log.gz 2024-03-07T10:25:16.889 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-client.admin.36924.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36924.log.gz 2024-03-07T10:25:16.889 INFO:teuthology.orchestra.run.smithi196.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-07T10:25:16.890 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2024-03-07T10:25:16.890 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-03-07T10:25:16.890 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2024-03-07T10:25:16.891 INFO:teuthology.orchestra.run.smithi196.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-07T10:25:16.891 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2024-03-07T10:25:16.892 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42124.log 2024-03-07T10:25:16.892 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2024-03-07T10:25:16.893 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-03-07T10:25:16.893 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-03-07T10:25:16.894 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2024-03-07T10:25:16.894 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42124.log.gz 2024-03-07T10:25:16.895 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51220.log 2024-03-07T10:25:16.895 INFO:teuthology.orchestra.run.smithi194.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-03-07T10:25:16.896 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49563.log 2024-03-07T10:25:16.896 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2024-03-07T10:25:16.897 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45767.log 2024-03-07T10:25:16.897 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51220.log.gz 2024-03-07T10:25:16.898 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43751.log 2024-03-07T10:25:16.898 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49563.log.gz 2024-03-07T10:25:16.899 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2024-03-07T10:25:16.900 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45767.log.gz 2024-03-07T10:25:16.901 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2024-03-07T10:25:16.901 INFO:teuthology.orchestra.run.smithi194.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43751.log.gz 2024-03-07T10:25:16.902 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2024-03-07T10:25:16.902 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2024-03-07T10:25:16.903 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47847.log 2024-03-07T10:25:16.903 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2024-03-07T10:25:16.904 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45893.log 2024-03-07T10:25:16.904 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2024-03-07T10:25:16.905 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44332.log 2024-03-07T10:25:16.905 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47847.log.gz 2024-03-07T10:25:16.906 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2024-03-07T10:25:16.906 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45893.log.gz 2024-03-07T10:25:16.907 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44333.log 2024-03-07T10:25:16.908 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44332.log.gz 2024-03-07T10:25:16.909 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42301.log 2024-03-07T10:25:16.909 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2024-03-07T10:25:16.910 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44333.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44333.log.gz 2024-03-07T10:25:16.910 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47805.log 2024-03-07T10:25:16.911 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46103.log 2024-03-07T10:25:16.911 INFO:teuthology.orchestra.run.smithi194.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42301.log.gz 2024-03-07T10:25:16.912 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47805.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30901.log 2024-03-07T10:25:16.912 INFO:teuthology.orchestra.run.smithi194.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47805.log.gz 2024-03-07T10:25:16.913 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2024-03-07T10:25:16.913 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46103.log.gz 2024-03-07T10:25:16.914 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.tmp-client.admin.30901.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30901.log.gz 2024-03-07T10:25:16.914 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42512.log 2024-03-07T10:25:16.915 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51346.log 2024-03-07T10:25:16.916 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2024-03-07T10:25:16.916 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49112.log 2024-03-07T10:25:16.917 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42512.log.gz 2024-03-07T10:25:16.917 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50240.log 2024-03-07T10:25:16.918 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51346.log.gz 2024-03-07T10:25:16.919 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51844.log 2024-03-07T10:25:16.919 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49112.log.gz 2024-03-07T10:25:16.920 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-03-07T10:25:16.920 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50240.log.gz 2024-03-07T10:25:16.921 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49833.log 2024-03-07T10:25:16.921 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51844.log.gz 2024-03-07T10:25:16.922 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51802.log 2024-03-07T10:25:16.922 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-03-07T10:25:16.923 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37264.log 2024-03-07T10:25:16.923 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49833.log.gz 2024-03-07T10:25:16.924 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51802.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51802.log.gz 2024-03-07T10:25:16.924 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-03-07T10:25:16.925 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46767.log 2024-03-07T10:25:16.925 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37264.log.gz 2024-03-07T10:25:16.926 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49028.log 2024-03-07T10:25:16.926 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-03-07T10:25:16.927 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50366.log 2024-03-07T10:25:16.928 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46767.log.gz 2024-03-07T10:25:16.929 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49070.log 2024-03-07T10:25:16.929 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49028.log.gz 2024-03-07T10:25:16.930 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45809.log 2024-03-07T10:25:16.930 INFO:teuthology.orchestra.run.smithi194.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50366.log.gz 2024-03-07T10:25:16.930 INFO:teuthology.orchestra.run.smithi196.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-07T10:25:16.931 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48099.log 2024-03-07T10:25:16.931 INFO:teuthology.orchestra.run.smithi194.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49070.log.gz 2024-03-07T10:25:16.932 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52325.log 2024-03-07T10:25:16.932 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45809.log.gz 2024-03-07T10:25:16.933 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2024-03-07T10:25:16.933 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48099.log.gz 2024-03-07T10:25:16.934 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52325.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52325.log.gz 2024-03-07T10:25:16.934 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51388.log 2024-03-07T10:25:16.935 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43104.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.42343.log 2024-03-07T10:25:16.935 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2024-03-07T10:25:16.936 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2024-03-07T10:25:16.936 INFO:teuthology.orchestra.run.smithi194.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51388.log.gz 2024-03-07T10:25:16.937 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51472.log 2024-03-07T10:25:16.937 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42343.log.gz 2024-03-07T10:25:16.938 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-03-07T10:25:16.939 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2024-03-07T10:25:16.940 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2024-03-07T10:25:16.940 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51472.log.gz 2024-03-07T10:25:16.941 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50696.log 2024-03-07T10:25:16.941 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-03-07T10:25:16.941 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-07T10:25:16.942 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2024-03-07T10:25:16.943 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-03-07T10:25:16.943 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50696.log.gz 2024-03-07T10:25:16.944 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52115.log 2024-03-07T10:25:16.945 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50654.log 2024-03-07T10:25:16.945 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-03-07T10:25:16.946 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-07T10:25:16.946 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52115.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52115.log.gz 2024-03-07T10:25:16.946 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2024-03-07T10:25:16.947 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2024-03-07T10:25:16.948 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50654.log.gz 2024-03-07T10:25:16.948 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48229.log 2024-03-07T10:25:16.948 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2024-03-07T10:25:16.949 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51658.log 2024-03-07T10:25:16.950 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2024-03-07T10:25:16.951 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48229.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.48229.log.gz --verbose 2024-03-07T10:25:16.951 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.51052.log 2024-03-07T10:25:16.952 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51658.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.51658.log.gz 2024-03-07T10:25:16.952 INFO:teuthology.orchestra.run.smithi194.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2024-03-07T10:25:16.953 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-07T10:25:16.953 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2024-03-07T10:25:16.953 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-03-07T10:25:16.954 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47973.log 2024-03-07T10:25:16.954 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2024-03-07T10:25:16.955 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43318.log 2024-03-07T10:25:16.955 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2024-03-07T10:25:16.956 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47973.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47973.log.gz 2024-03-07T10:25:16.956 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2024-03-07T10:25:16.957 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51304.log 2024-03-07T10:25:16.957 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43318.log.gz 2024-03-07T10:25:16.958 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52073.log 2024-03-07T10:25:16.959 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2024-03-07T10:25:16.959 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2024-03-07T10:25:16.959 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51304.log.gz 2024-03-07T10:25:16.960 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42386.log 2024-03-07T10:25:16.961 INFO:teuthology.orchestra.run.smithi194.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52073.log.gz 2024-03-07T10:25:16.962 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49311.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2024-03-07T10:25:16.962 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50114.log 2024-03-07T10:25:16.962 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-03-07T10:25:16.963 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42386.log.gz 2024-03-07T10:25:16.963 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51970.log 2024-03-07T10:25:16.964 INFO:teuthology.orchestra.run.smithi194.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50114.log.gz 2024-03-07T10:25:16.965 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42600.log 2024-03-07T10:25:16.965 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-03-07T10:25:16.966 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51970.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51970.log.gz 2024-03-07T10:25:16.966 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44000.log 2024-03-07T10:25:16.967 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48401.log 2024-03-07T10:25:16.967 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42600.log.gz 2024-03-07T10:25:16.968 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2024-03-07T10:25:16.968 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44000.log.gz 2024-03-07T10:25:16.969 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-03-07T10:25:16.969 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48401.log.gz 2024-03-07T10:25:16.970 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48461.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2024-03-07T10:25:16.970 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44739.log 2024-03-07T10:25:16.971 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42768.log 2024-03-07T10:25:16.971 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-03-07T10:25:16.973 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2024-03-07T10:25:16.973 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44739.log.gz 2024-03-07T10:25:16.974 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46596.log 2024-03-07T10:25:16.974 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42768.log.gz 2024-03-07T10:25:16.975 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2024-03-07T10:25:16.975 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43541.log 2024-03-07T10:25:16.976 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.46596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46596.log.gz 2024-03-07T10:25:16.976 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-03-07T10:25:16.977 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47300.log 2024-03-07T10:25:16.977 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43541.log.gz 2024-03-07T10:25:16.978 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2024-03-07T10:25:16.978 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-03-07T10:25:16.979 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52030.log 2024-03-07T10:25:16.979 INFO:teuthology.orchestra.run.smithi194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2024-03-07T10:25:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50968.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2024-03-07T10:25:16.980 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-03-07T10:25:16.981 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47931.log 2024-03-07T10:25:16.981 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52030.log.gz 2024-03-07T10:25:16.982 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44945.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-07T10:25:16.982 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-03-07T10:25:16.983 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2024-03-07T10:25:16.984 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47931.log.gz 2024-03-07T10:25:16.984 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42852.log 2024-03-07T10:25:16.985 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46809.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.47721.log -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2024-03-07T10:25:16.986 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-03-07T10:25:16.987 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2024-03-07T10:25:16.987 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42852.log.gz 2024-03-07T10:25:16.988 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47721.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47721.log.gz 2024-03-07T10:25:16.988 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2024-03-07T10:25:16.989 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46935.log 2024-03-07T10:25:16.990 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz 2024-03-07T10:25:16.990 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43230.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-03-07T10:25:16.991 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2024-03-07T10:25:16.991 INFO:teuthology.orchestra.run.smithi196.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-07T10:25:16.992 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52367.log 2024-03-07T10:25:16.992 INFO:teuthology.orchestra.run.smithi194.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.46935.log.gz 2024-03-07T10:25:16.993 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50444.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2024-03-07T10:25:16.993 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52157.log 2024-03-07T10:25:16.994 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43411.log 2024-03-07T10:25:16.995 INFO:teuthology.orchestra.run.smithi194.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52367.log.gz 2024-03-07T10:25:16.996 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52157.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52157.log.gz 2024-03-07T10:25:16.996 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-03-07T10:25:16.997 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46145.log 2024-03-07T10:25:16.998 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43411.log.gz 2024-03-07T10:25:16.998 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45029.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-03-07T10:25:16.999 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51262.log 2024-03-07T10:25:17.000 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52241.log 2024-03-07T10:25:17.000 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51262.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46145.log.gz 2024-03-07T10:25:17.001 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51262.log.gz 2024-03-07T10:25:17.001 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49665.log 2024-03-07T10:25:17.002 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-03-07T10:25:17.002 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52241.log.gz 2024-03-07T10:25:17.003 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42470.log 2024-03-07T10:25:17.004 INFO:teuthology.orchestra.run.smithi194.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49665.log.gz 2024-03-07T10:25:17.005 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45491.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2024-03-07T10:25:17.005 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-03-07T10:25:17.006 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-03-07T10:25:17.006 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42470.log.gz 2024-03-07T10:25:17.007 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42556.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2024-03-07T10:25:17.007 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2024-03-07T10:25:17.008 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51514.log 2024-03-07T10:25:17.009 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2024-03-07T10:25:17.010 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49605.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2024-03-07T10:25:17.010 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42025.log 2024-03-07T10:25:17.011 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43583.log 2024-03-07T10:25:17.011 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42025.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51514.log.gz 2024-03-07T10:25:17.012 INFO:teuthology.orchestra.run.smithi194.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42025.log.gz 2024-03-07T10:25:17.012 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2024-03-07T10:25:17.013 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44666.log 2024-03-07T10:25:17.014 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43583.log.gz 2024-03-07T10:25:17.014 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42642.log 2024-03-07T10:25:17.015 INFO:teuthology.orchestra.run.smithi194.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gz 2024-03-07T10:25:17.015 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44666.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44666.log.gz 2024-03-07T10:25:17.016 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47763.log 2024-03-07T10:25:17.017 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-03-07T10:25:17.017 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42642.log.gz 2024-03-07T10:25:17.018 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47763.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47763.log.gz 2024-03-07T10:25:17.018 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2024-03-07T10:25:17.019 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46725.log 2024-03-07T10:25:17.019 INFO:teuthology.orchestra.run.smithi194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-03-07T10:25:17.020 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 88.6% 2024-03-07T10:25:17.020 INFO:teuthology.orchestra.run.smithi194.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2024-03-07T10:25:17.021 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-07T10:25:17.021 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46725.log.gz 2024-03-07T10:25:17.022 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45935.log 2024-03-07T10:25:17.022 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2024-03-07T10:25:17.023 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2024-03-07T10:25:17.024 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45935.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45935.log.gz 2024-03-07T10:25:17.024 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44017.log 2024-03-07T10:25:17.025 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42810.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2024-03-07T10:25:17.026 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48556.log 2024-03-07T10:25:17.026 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44629.log 2024-03-07T10:25:17.027 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48556.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44017.log.gz 2024-03-07T10:25:17.028 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48556.log.gz 2024-03-07T10:25:17.028 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-03-07T10:25:17.029 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44629.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44629.log.gz 2024-03-07T10:25:17.029 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48313.log 2024-03-07T10:25:17.030 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50528.log 2024-03-07T10:25:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48313.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-03-07T10:25:17.031 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51010.log 2024-03-07T10:25:17.032 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48313.log.gz 2024-03-07T10:25:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49425.log 2024-03-07T10:25:17.036 INFO:teuthology.orchestra.run.smithi194.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50528.log.gz 2024-03-07T10:25:17.036 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51010.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51010.log.gz 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45977.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49425.log.gz 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45851.log 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-03-07T10:25:17.037 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42894.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-03-07T10:25:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-03-07T10:25:17.038 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43625.log 2024-03-07T10:25:17.039 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45851.log.gz 2024-03-07T10:25:17.040 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47637.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-03-07T10:25:17.040 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44316.log 2024-03-07T10:25:17.041 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51616.log 2024-03-07T10:25:17.042 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43625.log.gz 2024-03-07T10:25:17.042 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44316.log.gz 2024-03-07T10:25:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-03-07T10:25:17.043 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47019.log 2024-03-07T10:25:17.044 INFO:teuthology.orchestra.run.smithi194.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51616.log.gz 2024-03-07T10:25:17.045 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-03-07T10:25:17.045 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.50926.log 2024-03-07T10:25:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47019.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47019.log.gz 2024-03-07T10:25:17.046 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-03-07T10:25:17.047 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42726.log 2024-03-07T10:25:17.048 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43369.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-03-07T10:25:17.048 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.48663.log -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-03-07T10:25:17.048 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-03-07T10:25:17.050 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42726.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42726.log.gz 2024-03-07T10:25:17.050 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-07T10:25:17.051 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52199.log 2024-03-07T10:25:17.051 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48663.log.gz 2024-03-07T10:25:17.052 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48503.log 2024-03-07T10:25:17.053 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50156.log 2024-03-07T10:25:17.053 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52199.log.gz 2024-03-07T10:25:17.054 INFO:teuthology.orchestra.run.smithi196.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-07T10:25:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44660.log 2024-03-07T10:25:17.055 INFO:teuthology.orchestra.run.smithi194.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48503.log.gz 2024-03-07T10:25:17.055 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50612.log 2024-03-07T10:25:17.056 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50156.log.gz 2024-03-07T10:25:17.057 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-03-07T10:25:17.057 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44660.log.gz 2024-03-07T10:25:17.057 INFO:teuthology.orchestra.run.smithi194.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-07T10:25:17.058 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50198.log 2024-03-07T10:25:17.059 INFO:teuthology.orchestra.run.smithi194.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50612.log.gz 2024-03-07T10:25:17.059 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45071.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2024-03-07T10:25:17.059 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43793.log 2024-03-07T10:25:17.060 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2024-03-07T10:25:17.061 INFO:teuthology.orchestra.run.smithi194.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50198.log.gz 2024-03-07T10:25:17.062 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44016.log 2024-03-07T10:25:17.062 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43793.log.gz 2024-03-07T10:25:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49154.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2024-03-07T10:25:17.063 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-03-07T10:25:17.064 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52283.log 2024-03-07T10:25:17.065 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44016.log.gz 2024-03-07T10:25:17.066 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43020.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz --verbose 2024-03-07T10:25:17.066 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.49707.log 2024-03-07T10:25:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.52283.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52283.log.gz 2024-03-07T10:25:17.067 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-03-07T10:25:17.068 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2024-03-07T10:25:17.068 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49707.log.gz 2024-03-07T10:25:17.069 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45281.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-07T10:25:17.069 INFO:teuthology.orchestra.run.smithi194.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-03-07T10:25:17.070 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44441.log: gzip -5 88.6% --verbose -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2024-03-07T10:25:17.071 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.51886.log 2024-03-07T10:25:17.071 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51928.log 2024-03-07T10:25:17.073 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-03-07T10:25:17.073 INFO:teuthology.orchestra.run.smithi194.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51886.log.gz 2024-03-07T10:25:17.074 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.51928.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51928.log.gzgzip 2024-03-07T10:25:17.074 INFO:teuthology.orchestra.run.smithi194.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2024-03-07T10:25:17.075 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2024-03-07T10:25:17.076 INFO:teuthology.orchestra.run.smithi194.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-03-07T10:25:17.077 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz --verbose 2024-03-07T10:25:17.077 INFO:teuthology.orchestra.run.smithi194.stderr: -- /var/log/ceph/ceph-client.admin.47595.log 2024-03-07T10:25:17.077 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50486.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-07T10:25:17.078 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2024-03-07T10:25:17.079 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49196.log 2024-03-07T10:25:17.079 INFO:teuthology.orchestra.run.smithi194.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 2024-03-07T10:25:17.080 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-07T10:25:17.081 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49196.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49196.log.gz 2024-03-07T10:25:17.081 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2024-03-07T10:25:17.082 INFO:teuthology.orchestra.run.smithi194.stderr: 85.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-07T10:25:17.084 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43835.log 2024-03-07T10:25:17.084 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45113.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2024-03-07T10:25:17.084 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47385.log 2024-03-07T10:25:17.085 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2024-03-07T10:25:17.085 INFO:teuthology.orchestra.run.smithi194.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43835.log.gz 2024-03-07T10:25:17.086 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47385.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47385.log.gz 2024-03-07T10:25:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49791.log 2024-03-07T10:25:17.087 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47679.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2024-03-07T10:25:17.088 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-07T10:25:17.089 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2024-03-07T10:25:17.089 INFO:teuthology.orchestra.run.smithi194.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49791.log.gz 2024-03-07T10:25:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50020.log 2024-03-07T10:25:17.092 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47889.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz 2024-03-07T10:25:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.50020.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50020.log.gz 2024-03-07T10:25:17.094 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44320.log 2024-03-07T10:25:17.095 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49917.log 2024-03-07T10:25:17.097 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44320.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44320.log.gz 2024-03-07T10:25:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.49917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49917.log.gz 2024-03-07T10:25:17.098 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2024-03-07T10:25:17.100 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43499.log 2024-03-07T10:25:17.101 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47511.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2024-03-07T10:25:17.102 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43499.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2024-03-07T10:25:17.103 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36880.log 2024-03-07T10:25:17.105 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44005.log 2024-03-07T10:25:17.106 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.36880.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36880.log.gz 2024-03-07T10:25:17.107 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44005.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44005.log.gz 2024-03-07T10:25:17.108 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47103.log 2024-03-07T10:25:17.110 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-03-07T10:25:17.111 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47103.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47103.log.gz 2024-03-07T10:25:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45701.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-03-07T10:25:17.113 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44344.log 2024-03-07T10:25:17.115 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44684.log 2024-03-07T10:25:17.116 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44344.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44344.log.gz 2024-03-07T10:25:17.117 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44684.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44684.log.gz 2024-03-07T10:25:17.118 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2024-03-07T10:25:17.120 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2024-03-07T10:25:17.121 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47146.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2024-03-07T10:25:17.123 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48900.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2024-03-07T10:25:17.123 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2024-03-07T10:25:17.124 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46577.log 2024-03-07T10:25:17.126 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45197.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-03-07T10:25:17.127 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.0.46577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46577.log.gz 2024-03-07T10:25:17.127 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42220.log 2024-03-07T10:25:17.129 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49749.log 2024-03-07T10:25:17.130 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42220.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42220.log.gz 2024-03-07T10:25:17.131 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49749.log: /var/log/ceph/ceph-client.admin.48271.log 2024-03-07T10:25:17.131 INFO:teuthology.orchestra.run.smithi194.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49749.log.gz 2024-03-07T10:25:17.132 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48057.log 2024-03-07T10:25:17.134 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.48271.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48271.log.gz 2024-03-07T10:25:17.135 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48057.log: /var/log/ceph/ceph-client.admin.46019.log 2024-03-07T10:25:17.135 INFO:teuthology.orchestra.run.smithi194.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48057.log.gz 2024-03-07T10:25:17.136 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42684.log 2024-03-07T10:25:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.46019.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46019.log.gz 2024-03-07T10:25:17.138 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43709.log 2024-03-07T10:25:17.139 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.42684.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42684.log.gz 2024-03-07T10:25:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43709.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43709.log.gz 2024-03-07T10:25:17.141 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-03-07T10:25:17.143 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-07T10:25:17.145 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45365.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-03-07T10:25:17.147 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-03-07T10:25:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47254.log 2024-03-07T10:25:17.150 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43453.log 2024-03-07T10:25:17.150 INFO:teuthology.orchestra.run.smithi194.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-03-07T10:25:17.153 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.43453.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43453.log.gz 2024-03-07T10:25:17.154 INFO:teuthology.orchestra.run.smithi194.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2024-03-07T10:25:17.155 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.47254.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47254.log.gz 2024-03-07T10:25:17.155 INFO:teuthology.orchestra.run.smithi196.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-07T10:25:17.157 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.44903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37146.log 2024-03-07T10:25:17.157 INFO:teuthology.orchestra.run.smithi194.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2024-03-07T10:25:17.161 INFO:teuthology.orchestra.run.smithi194.stderr:/var/log/ceph/ceph-client.admin.37146.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37146.log.gz 2024-03-07T10:25:17.170 INFO:teuthology.orchestra.run.smithi196.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-07T10:25:17.173 INFO:teuthology.orchestra.run.smithi194.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-07T10:25:17.174 INFO:teuthology.orchestra.run.smithi194.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-07T10:25:17.183 INFO:teuthology.orchestra.run.smithi194.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-07T10:25:17.187 INFO:teuthology.orchestra.run.smithi196.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-07T10:25:17.202 INFO:teuthology.orchestra.run.smithi196.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-07T10:25:17.206 INFO:teuthology.orchestra.run.smithi196.stderr: 2024-03-07T10:25:17.206 INFO:teuthology.orchestra.run.smithi196.stderr:real 0m0.384s 2024-03-07T10:25:17.206 INFO:teuthology.orchestra.run.smithi196.stderr:user 0m1.520s 2024-03-07T10:25:17.206 INFO:teuthology.orchestra.run.smithi196.stderr:sys 0m0.252s 2024-03-07T10:25:17.264 INFO:teuthology.orchestra.run.smithi194.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-07T10:25:17.300 INFO:teuthology.orchestra.run.smithi194.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-07T10:25:17.352 INFO:teuthology.orchestra.run.smithi194.stderr: 93.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-07T10:25:17.360 INFO:teuthology.orchestra.run.smithi194.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-07T10:25:17.365 INFO:teuthology.orchestra.run.smithi194.stderr: 2024-03-07T10:25:17.365 INFO:teuthology.orchestra.run.smithi194.stderr:real 0m0.551s 2024-03-07T10:25:17.365 INFO:teuthology.orchestra.run.smithi194.stderr:user 0m1.517s 2024-03-07T10:25:17.365 INFO:teuthology.orchestra.run.smithi194.stderr:sys 0m0.771s 2024-03-07T10:25:17.366 INFO:tasks.ceph:Archiving logs... 2024-03-07T10:25:17.366 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi194/log 2024-03-07T10:25:17.367 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-07T10:25:17.855 DEBUG:teuthology.misc:Transferring archived files from smithi196:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi196/log 2024-03-07T10:25:17.856 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-07T10:25:18.164 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-07T10:25:18.183 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-07T10:25:18.184 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-07T10:25:18.192 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-07T10:25:18.339 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-07T10:25:18.350 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-07T10:25:18.350 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T10:25:18.359 DEBUG:teuthology.orchestra.run.smithi196:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-07T10:25:18.403 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-03-07T10:25:18.413 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +1081us[+1079us] +/- 122ms 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -832us[ -834us] +/- 59ms 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 34 +382us[ +382us] +/- 69ms 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:25:18.414 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: ntpq: command not found 2024-03-07T10:25:18.424 INFO:teuthology.orchestra.run.smithi196.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-07T10:25:18.424 INFO:teuthology.orchestra.run.smithi196.stdout:=============================================================================== 2024-03-07T10:25:18.425 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +1112us[+1112us] +/- 122ms 2024-03-07T10:25:18.425 INFO:teuthology.orchestra.run.smithi196.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -805us[ -806us] +/- 59ms 2024-03-07T10:25:18.425 INFO:teuthology.orchestra.run.smithi196.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +387us[ +387us] +/- 69ms 2024-03-07T10:25:18.425 INFO:teuthology.orchestra.run.smithi196.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-07T10:25:18.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-07T10:25:18.436 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-07T10:25:18.437 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-07T10:25:18.468 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-07T10:25:18.685 DEBUG:teuthology.orchestra.run.smithi196:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-07T10:25:18.892 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-07T10:25:18.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:18.994 DEBUG:teuthology.orchestra.run.smithi196:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-07T10:25:19.095 INFO:teuthology.orchestra.run.smithi196.stdout:type=AVC msg=audit(1709806254.017:187): avc: denied { checkpoint_restore } for pid=1150 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-07T10:25:19.096 DEBUG:teuthology.task.selinux:ubuntu@smithi196.front.sepia.ceph.com has 1 denials 2024-03-07T10:25:19.097 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi196.front.sepia.ceph.com: ['type=AVC msg=audit(1709806254.017:187): avc: denied { checkpoint_restore } for pid=1150 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-07T10:25:19.097 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-07T10:25:19.108 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-07T10:25:19.139 INFO:teuthology.task.internal:Duration was 865.482473 seconds 2024-03-07T10:25:19.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-07T10:25:19.173 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-07T10:25:19.173 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-07T10:25:19.181 DEBUG:teuthology.orchestra.run.smithi196:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-07T10:25:19.280 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-07T10:25:19.331 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-07T10:25:19.352 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: adjust-ulimits: command not found 2024-03-07T10:25:19.353 INFO:teuthology.orchestra.run.smithi196.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-07T10:25:19.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:19.356 ERROR:tasks.mds_thrash.fs.[a]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/mds_thrash.py", line 124, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/mds_thrash.py", line 247, in do_thrash status = self.fs.status() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs/filesystem.py", line 402, in status return FSStatus(self.mon_manager, epoch) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/cephfs/filesystem.py", line 88, in __init__ self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_8b896a9e145796119f0451201dc4d53ddac97db0/qa/tasks/ceph_manager.py", line 1629, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi194 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2024-03-07T10:25:19.657 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-07T10:25:19.657 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:19.657 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-07T10:25:19.718 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:19.718 DEBUG:teuthology.orchestra.run.smithi196:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-07T10:25:19.776 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-07T10:25:19.776 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-07T10:25:19.784 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-07T10:25:19.872 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-07T10:25:19.872 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-07T10:25:19.877 DEBUG:teuthology.orchestra.run.smithi196:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-07T10:25:20.054 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-07T10:25:20.065 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-07T10:25:20.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-07T10:25:20.153 DEBUG:teuthology.orchestra.run.smithi196:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-07T10:25:20.249 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-07T10:25:20.259 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-07T10:25:20.267 DEBUG:teuthology.orchestra.run.smithi196:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-07T10:25:20.367 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-03-07T10:25:20.376 INFO:teuthology.orchestra.run.smithi196.stdout:kernel.core_pattern = core 2024-03-07T10:25:20.428 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-07T10:25:20.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:20.477 DEBUG:teuthology.orchestra.run.smithi196:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-07T10:25:20.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:20.533 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-07T10:25:20.544 INFO:teuthology.task.internal:Transferring archived files... 2024-03-07T10:25:20.545 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi194 2024-03-07T10:25:20.545 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-07T10:25:20.651 DEBUG:teuthology.misc:Transferring archived files from smithi196:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102/remote/smithi196 2024-03-07T10:25:20.652 DEBUG:teuthology.orchestra.run.smithi196:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-07T10:25:20.755 INFO:teuthology.task.internal:Removing archive directory... 2024-03-07T10:25:20.755 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-07T10:25:20.765 DEBUG:teuthology.orchestra.run.smithi196:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-07T10:25:20.788 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.fs.[a] failed 2024-03-07T10:25:20.788 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-03-07T10:25:20.788 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-03-07T10:25:20.788 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:25:20.821 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-07T10:25:20.834 INFO:teuthology.task.internal:Not uploading archives. 2024-03-07T10:25:20.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-07T10:25:20.857 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-07T10:25:20.857 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-07T10:25:20.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053432,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498372k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249184k,nr_inodes=812296,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498372k,nr_inodes=819200,mode=755 0 0 2024-03-07T10:25:20.859 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-03-07T10:25:20.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:25:20.860 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-07T10:25:20.907 DEBUG:teuthology.orchestra.run.smithi196:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-07T10:25:20.948 INFO:teuthology.orchestra.run.smithi194.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 7 10:25 /home/ubuntu/cephtest 2024-03-07T10:25:20.951 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: cd: /home/ubuntu/cephtest: No such file or directory 2024-03-07T10:25:20.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:20.953 DEBUG:teuthology.orchestra.run.smithi196:> set -ex 2024-03-07T10:25:20.953 DEBUG:teuthology.orchestra.run.smithi196:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-07T10:25:20.962 INFO:teuthology.orchestra.run.smithi196.stdout: 393249 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 7 10:25 /home/ubuntu/cephtest 2024-03-07T10:25:20.964 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-07T10:25:20.976 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-07T10:25:21.017 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi196.front.sepia.ceph.com: ['type=AVC msg=audit(1709806254.017:187): avc: denied { checkpoint_restore } for pid=1150 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-07T10:25:21.017 INFO:teuthology.nuke:Checking targets against current locks 2024-03-07T10:25:21.023 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 2024-03-07T10:25:21.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi196.front.sepia.ceph.com 2024-03-07T10:25:21.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-07T10:25:21.023 DEBUG:teuthology.orchestra.run.smithi196:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-07T10:25:21.049 DEBUG:teuthology.nuke:shortname: smithi194 2024-03-07T10:25:21.049 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T10:25:21.070 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 10:00:57.384006', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLcuvnD9W9UEaovtugF5xdq6S//5bnBDPN4f4bV9+zKUMAwXxbuDt7k29czyZhbstjH4xgvLaqj/TXW42flZXHc='} 2024-03-07T10:25:21.075 DEBUG:teuthology.nuke:shortname: smithi196 2024-03-07T10:25:21.075 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-07T10:25:21.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi196.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-03-07_05:46:12-fs-wip-lusov-qdb-distro-default-smithi/7584102', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-07 10:00:57.382524', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEb6taPdbTC/BenGE1njNfdBR7s+nctwr0j2vFop1258j4Q543NzF1i+ButPWS8pLoDjH0WMPKvK7cRiSAtwnFI='} 2024-03-07T10:25:21.134 INFO:teuthology.orchestra.console.smithi194:Power off 2024-03-07T10:25:21.134 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T10:25:21.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-07T10:25:21.146 INFO:teuthology.orchestra.run.smithi196.stderr:bash: line 1: cd: /home/ubuntu/cephtest: No such file or directory 2024-03-07T10:25:21.171 INFO:teuthology.orchestra.console.smithi196:Power off 2024-03-07T10:25:21.172 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-07T10:25:21.182 DEBUG:teuthology.orchestra.console.smithi194:power off output: Chassis Power Control: Down/Off 2024-03-07T10:25:21.182 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:21.199 DEBUG:teuthology.orchestra.console.smithi196:power off output: Chassis Power Control: Down/Off 2024-03-07T10:25:21.199 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:21.211 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-07T10:25:21.226 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-07T10:25:25.213 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:25.227 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:25.325 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is on 2024-03-07T10:25:25.336 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is on 2024-03-07T10:25:29.328 DEBUG:teuthology.orchestra.console.smithi194:pexpect command: ipmitool -H smithi194.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:29.337 DEBUG:teuthology.orchestra.console.smithi196:pexpect command: ipmitool -H smithi196.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-07T10:25:29.438 DEBUG:teuthology.orchestra.console.smithi194:check power output: Chassis Power is off 2024-03-07T10:25:29.446 DEBUG:teuthology.orchestra.console.smithi196:check power output: Chassis Power is off 2024-03-07T10:25:29.540 INFO:teuthology.orchestra.console.smithi194:Power off completed 2024-03-07T10:25:29.547 INFO:teuthology.orchestra.console.smithi196:Power off completed 2024-03-07T10:25:29.653 INFO:teuthology.run:Summary data: client.0-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 client.1-kernel-sha1: dd5c1cd171679b4e0ceeab3e8d62f25c2b4e6412 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_trivial_sync}} duration: 865.4824726581573 failure_reason: 'SELinux denials found on ubuntu@smithi196.front.sepia.ceph.com: [''type=AVC msg=audit(1709806254.017:187): avc: denied { checkpoint_restore } for pid=1150 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_leonidus@teuthology status: fail success: false 2024-03-07T10:25:29.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-07T10:25:29.744 INFO:teuthology.run:FAIL